Nov 03 07:21:02 devstack cinder-volume[75318]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 03 07:21:02 devstack cinder-volume[75318]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 03 07:21:02 devstack cinder-volume[75318]: we strongly recommend against using it for new projects. Nov 03 07:21:02 devstack cinder-volume[75318]: If you are already using Eventlet, we recommend migrating to a different Nov 03 07:21:02 devstack cinder-volume[75318]: framework. For more detail see Nov 03 07:21:02 devstack cinder-volume[75318]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 03 07:21:02 devstack cinder-volume[75318]: import eventlet # noqa Nov 03 07:21:04 devstack cinder-volume[75318]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75318) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 07:21:04 devstack cinder-volume[75318]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75318) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 07:21:04 devstack cinder-volume[75318]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75318) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 07:21:05 devstack cinder-volume[75318]: INFO dbcounter [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] Registered counter for database cinder Nov 03 07:21:05 devstack cinder-volume[75318]: DEBUG oslo_db.sqlalchemy.engines [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75318) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 07:21:06 devstack cinder-volume[75318]: DEBUG dbcounter [-] [75318] Writer thread running {{(pid=75318) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 07:21:06 devstack cinder-volume[75318]: INFO cinder.rpc [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 03 07:21:06 devstack cinder-volume[75318]: INFO cinder.rpc [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 03 07:21:06 devstack cinder-volume[75318]: DEBUG oslo_db.sqlalchemy.engines [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75318) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 07:21:06 devstack cinder-volume[75318]: INFO cinder.volume.manager [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] Determined volume DB was empty at startup. Nov 03 07:21:06 devstack cinder-volume[75318]: DEBUG cinder.volume.manager [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75318) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 03 07:21:06 devstack cinder-volume[75318]: INFO cinder.volume.manager [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 03 07:21:06 devstack cinder-volume[75318]: WARNING stevedore.named [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 03 07:21:06 devstack cinder-volume[75318]: WARNING castellan.key_manager [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 07:21:06 devstack cinder-volume[75318]: WARNING cinder.keymgr.conf_key_mgr [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 07:21:06 devstack cinder-volume[75318]: DEBUG cinder.volume.drivers.lvm [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75318) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Nov 03 07:21:06 devstack cinder-volume[75318]: DEBUG oslo_concurrency.processutils [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_concurrency.processutils [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] CMD "cinder-rtstool verify" returned: 0 in 0.443s {{(pid=75318) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_db.sqlalchemy.engines [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75318) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 07:21:07 devstack cinder-volume[75318]: INFO cinder.rpc [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Nov 03 07:21:07 devstack cinder-volume[75318]: INFO cinder.rpc [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Nov 03 07:21:07 devstack cinder-volume[75318]: WARNING stevedore.named [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 03 07:21:07 devstack cinder-volume[75318]: WARNING castellan.key_manager [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 07:21:07 devstack cinder-volume[75318]: INFO cinder.volume.manager [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] Image-volume cache enabled for host devstack@lvmdriver-1. Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_db.sqlalchemy.engines [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75318) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 07:21:07 devstack cinder-volume[75318]: INFO oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] Starting 1 workers Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] Started child 75516 {{(pid=75318) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] Full set of CONF: {{(pid=75318) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] ******************************************************************************** {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] Configuration options gathered from: {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] ================================================================================ {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] allow_availability_zone_fallback = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] allow_compression_on_image_upload = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] allowed_direct_url_schemes = [] {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] api_rate_limit = True {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] auth_strategy = keystone {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] az_cache_duration = 3600 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_availability_zone = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_host = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_name = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_stats_polling_interval = 60 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backup_api_class = cinder.backup.api.API {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backup_name_template = backup-%s {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backup_use_same_host = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backup_use_temp_snapshot = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] chap_password = **** {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75516]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] chap_username = {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] cinder_internal_tenant_project_id = 55d20126cd5b49fa82036b2c336399dc {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] cinder_internal_tenant_user_id = 5d7487e56ad44ff8922c8d768920698d {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] cloned_volume_same_az = True {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] cluster = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] compression_format = gzip {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] compute_api_class = cinder.compute.nova.API {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] config_dir = [] {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] config_source = [] {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] control_exchange = openstack {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] debug = True {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] default_availability_zone = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] default_group_type = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] default_volume_type = lvmdriver-1 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] disk_geometry = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] driver_client_cert = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] driver_client_cert_key = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] driver_data_namespace = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] driver_ssl_cert_path = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] driver_ssl_cert_verify = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] driver_use_ssl = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] enable_force_upload = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] enable_new_services = True {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] enable_unsupported_driver = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] enabled_backends = ['lvmdriver-1'] {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] enforce_multipath_for_image_xfer = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] filter_function = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] glance_api_insecure = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] glance_api_servers = ['http://192.168.122.249/image'] {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] glance_api_ssl_compression = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] glance_ca_certificates_file = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] glance_catalog_info = image:glance:publicURL {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] glance_certfile = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] glance_keyfile = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] glance_num_retries = 3 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] glance_request_timeout = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] goodness_function = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] graceful_shutdown_timeout = 5 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] group_api_class = cinder.group.api.API {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] host = devstack {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] image_compress_on_upload = True {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] image_conversion_address_space_limit = 1 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] image_conversion_cpu_limit = 60 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] image_conversion_disable = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] image_introspection_address_space_limit = 1 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] image_introspection_cpu_limit = 60 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] image_upload_use_cinder_backend = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] image_upload_use_internal_tenant = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] image_volume_cache_enabled = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] image_volume_cache_max_count = 0 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] image_volume_cache_max_size_gb = 0 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] init_host_max_objects_retrieval = 0 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] instance_format = [instance: %(uuid)s] {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] iscsi_target_flags = {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] iscsi_write_cache = on {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] iser_helper = tgtadm {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] iser_ip_address = 192.168.122.249 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] iser_port = 3260 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] log_color = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] log_config_append = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] log_dir = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] log_file = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] log_options = True {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] log_rotate_interval = 1 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] log_rotate_interval_type = days {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] log_rotation_type = none {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] max_age = 0 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] max_logfile_count = 30 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] max_logfile_size_mb = 200 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] max_over_subscription_ratio = 20.0 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] message_reap_interval = 86400 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] message_ttl = 2592000 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] migration_create_volume_timeout_secs = 300 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] monkey_patch = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] monkey_patch_modules = [] {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] my_ip = 192.168.122.249 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] no_snapshot_gb_quota = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] num_iser_scan_tries = 3 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] num_shell_tries = 3 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] num_volume_device_scan_tries = 3 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] nvmeof_conn_info_version = 1 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] nvmet_ns_id = 10 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] nvmet_port_id = 1 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] osapi_max_limit = 1000 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] osapi_volume_ext_list = [] {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] osapi_volume_listen = 0.0.0.0 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] osapi_volume_listen_port = 8776 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] osapi_volume_use_ssl = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] osapi_volume_workers = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] per_volume_size_limit = -1 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] periodic_fuzzy_delay = 60 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] periodic_interval = 60 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] project_id_regex = [0-9a-f\-]+ {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] public_endpoint = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] publish_errors = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] quota_backup_gigabytes = 1000 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] quota_backups = 10 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] quota_gigabytes = 1000 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] quota_groups = 10 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] quota_snapshots = 10 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] quota_volumes = 10 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] rate_limit_burst = 0 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] rate_limit_except_level = CRITICAL {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] rate_limit_interval = 0 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] reinit_driver_count = 3 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] replication_device = **** {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] report_discard_supported = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] report_interval = 120 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] reservation_clean_interval = 86400 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] reservation_expire = 86400 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] reserved_image_namespaces = [] {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] reserved_percentage = 0 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] rpc_response_timeout = 120 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] run_external_periodic_tasks = True {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] scst_target_driver = iscsi {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] scst_target_iqn_name = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] service_down_time = 720 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] shell_completion = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] snapshot_name_template = snapshot-%s {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] snapshot_same_host = True {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] split_loggers = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] state_path = /opt/stack/data/cinder {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] storage_availability_zone = nova {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] storage_protocol = iSCSI {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] syslog_log_facility = LOG_USER {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] target_helper = lioadm {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] target_ip_address = 192.168.122.249 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] target_port = 3260 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] target_protocol = iscsi {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] target_secondary_ip_addresses = [] {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] trace_flags = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] transfer_api_class = cinder.transfer.api.API {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] transport_url = **** {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] until_refresh = 0 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] use_chap_auth = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] use_default_quota_class = True {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] use_journal = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] use_json = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] use_multipath_for_image_xfer = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] use_stderr = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] use_syslog = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] verify_glance_signatures = enabled {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] volume_api_class = cinder.volume.api.API {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] volume_backend_name = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] volume_clear = zero {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] volume_clear_ionice = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] volume_clear_size = 0 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75516]: INFO cinder.volume.manager [None req-614e8622-4463-4228-985e-c64493490537 None None] Starting volume driver LVMVolumeDriver (3.0.0) Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] volume_copy_bps_limit = 0 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] volume_dd_blocksize = 1M {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] volume_name_template = volume-%s {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] volume_service_inithost_offload = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] volume_usage_audit_period = month {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] zoning_mode = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_concurrency.disable_process_locking = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-614e8622-4463-4228-985e-c64493490537 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] keystone_authtoken.auth_section = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] keystone_authtoken.auth_type = password {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] keystone_authtoken.auth_version = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] keystone_authtoken.cache = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] keystone_authtoken.certfile = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] keystone_authtoken.delay_auth_decision = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] keystone_authtoken.http_connect_timeout = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] keystone_authtoken.include_service_catalog = True {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] keystone_authtoken.insecure = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] keystone_authtoken.interface = public {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] keystone_authtoken.keyfile = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] keystone_authtoken.memcache_password = **** {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] keystone_authtoken.memcache_username = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] keystone_authtoken.region_name = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] keystone_authtoken.service_token_roles_required = True {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] keystone_authtoken.service_type = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] keystone_authtoken.token_cache_time = 300 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.249/identity {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] cache.backend = dogpile.cache.null {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] cache.backend_argument = **** {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] cache.backend_expiration_time = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] cache.config_prefix = cache.oslo {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] cache.debug_cache_backend = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] cache.enable_retry_client = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] cache.enable_socket_keepalive = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] cache.enabled = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] cache.expiration_time = 600 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] cache.hashclient_retry_attempts = 2 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-614e8622-4463-4228-985e-c64493490537 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.052s {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] cache.memcache_dead_retry = 300 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] cache.memcache_pool_maxsize = 10 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] cache.memcache_sasl_enabled = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-614e8622-4463-4228-985e-c64493490537 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] cache.password = **** {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] cache.proxies = [] {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] cache.redis_db = 0 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] cache.redis_sentinel_service_name = mymaster {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] cache.redis_server = localhost:6379 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] cache.retry_attempts = 2 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] cache.retry_delay = 0.0 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] cache.socket_keepalive_count = 1 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] cache.socket_keepalive_idle = 1 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] cache.socket_keepalive_interval = 1 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] cache.socket_timeout = 1.0 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] cache.tls_allowed_ciphers = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] cache.tls_cafile = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] cache.tls_certfile = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] cache.tls_enabled = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] cache.tls_keyfile = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] cache.username = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] coordination.backend_url = **** {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] database.asyncio_connection = **** {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] database.asyncio_slave_connection = **** {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] database.backend = sqlalchemy {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] database.connection = **** {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] database.connection_debug = 0 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] database.connection_parameters = {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] database.connection_recycle_time = 3600 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] database.connection_trace = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] database.db_inc_retry_interval = True {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] database.db_max_retries = 20 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] database.db_max_retry_interval = 10 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] database.db_retry_interval = 1 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] database.max_overflow = 50 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] database.max_pool_size = 5 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] database.max_retries = 10 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] database.mysql_wsrep_sync_wait = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] database.pool_timeout = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] database.retry_interval = 10 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] database.slave_connection = **** {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] database.sqlite_synchronous = True {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] database.synchronous_reader = True {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] database.use_db_reconnect = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_messaging_tracing.insecure = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] profiler.connection_string = messaging:// {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] profiler.enabled = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] profiler.es_doc_type = notification {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] profiler.es_scroll_size = 10000 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] profiler.es_scroll_time = 2m {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] profiler.filter_error_trace = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] profiler.hmac_keys = **** {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] profiler.sentinel_service_name = mymaster {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] profiler.socket_timeout = 0.1 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] profiler.trace_requests = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] profiler.trace_sqlalchemy = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] profiler_jaeger.process_tags = {} {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] profiler_jaeger.service_name_prefix = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] profiler_otlp.service_name_prefix = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_policy.enforce_new_defaults = True {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_policy.policy_default_rule = default {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_policy.policy_file = policy.yaml {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_policy.remote_timeout = 60.0 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] privsep_osbrick.group = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] privsep_osbrick.helper_command = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] privsep_osbrick.user = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] cinder_sys_admin.group = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] cinder_sys_admin.helper_command = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-614e8622-4463-4228-985e-c64493490537 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.043s {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:21:07 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-614e8622-4463-4228-985e-c64493490537 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] cinder_sys_admin.user = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] service_user.auth_section = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] service_user.auth_type = password {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] service_user.cafile = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] service_user.certfile = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] service_user.collect_timing = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] service_user.insecure = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] service_user.keyfile = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] service_user.send_service_user_token = True {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] service_user.split_loggers = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] service_user.timeout = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] service_user.tls_ciphers = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] service_user.tls_min_version = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] glance.auth_section = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] glance.auth_type = password {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] glance.certfile = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] glance.collect_timing = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] glance.insecure = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] glance.keyfile = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] glance.region_name = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] glance.split_loggers = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] glance.timeout = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] glance.tls_ciphers = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] glance.tls_min_version = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.backend_availability_zone = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.chap_password = **** {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.chap_username = {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.disk_geometry = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.driver_client_cert = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.driver_client_cert_key = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.driver_data_namespace = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.driver_use_ssl = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.enable_unsupported_driver = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.extra_capabilities = {} {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.filter_function = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.goodness_function = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.iscsi_target_flags = {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.iscsi_write_cache = on {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.iser_helper = tgtadm {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.iser_ip_address = 192.168.122.249 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.iser_port = 3260 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.lvm_mirrors = 0 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-614e8622-4463-4228-985e-c64493490537 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:21:07 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-614e8622-4463-4228-985e-c64493490537 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.lvm_share_target = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.lvm_type = auto {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.num_shell_tries = 3 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.nvmet_port_id = 1 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.replication_device = **** {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.report_discard_supported = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.reserved_percentage = 0 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.scst_target_driver = iscsi {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.scst_target_iqn_name = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.storage_protocol = iSCSI {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.target_helper = tgtadm {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.target_ip_address = 192.168.122.249 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.target_port = 3260 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.target_protocol = iscsi {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.trace_flags = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.unique_fqdn_network = True {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.use_chap_auth = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.volume_backend_name = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.volume_clear = zero {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.volume_clear_ionice = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.volume_clear_size = 0 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.volume_group = cinder-volumes {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_reports.file_event_handler = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_reports.log_dir = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.backend_availability_zone = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.backend_host = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.chap_password = **** {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.chap_username = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.chiscsi_conf = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.disk_geometry = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.driver_client_cert = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.driver_data_namespace = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack sudo[75527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Nov 03 07:21:07 devstack sudo[75527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.driver_use_ssl = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.extra_capabilities = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.filter_function = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.goodness_function = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.iser_helper = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.iser_ip_address = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.iser_port = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.iser_target_prefix = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.lvm_conf_file = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.lvm_mirrors = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.lvm_share_target = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.lvm_type = auto {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.num_shell_tries = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.nvmet_port_id = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.replication_device = **** {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.report_discard_supported = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.reserved_percentage = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.scst_target_driver = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.storage_protocol = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.target_helper = lioadm {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.target_ip_address = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.target_port = 3260 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.target_protocol = iscsi {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.trace_flags = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.use_chap_auth = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.volume_clear = zero {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.volume_clear_size = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] lvmdriver-1.volumes_dir = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_messaging_rabbit.ssl = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_messaging_rabbit.ssl_version = {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_messaging_notifications.driver = [] {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_messaging_notifications.retry = -1 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] oslo_messaging_notifications.transport_url = **** {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] key_manager.fixed_key = **** {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] barbican.barbican_api_version = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] barbican.barbican_endpoint = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] barbican.barbican_endpoint_type = public {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] barbican.barbican_region_name = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] barbican.cafile = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] barbican.certfile = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] barbican.collect_timing = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] barbican.insecure = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] barbican.keyfile = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] barbican.number_of_retries = 60 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] barbican.retry_delay = 1 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] barbican.send_service_user_token = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] barbican.split_loggers = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] barbican.timeout = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] barbican.tls_ciphers = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] barbican.tls_min_version = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] barbican.verify_ssl = True {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] barbican.verify_ssl_path = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] barbican_service_user.auth_section = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] barbican_service_user.auth_type = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] barbican_service_user.cafile = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] barbican_service_user.certfile = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] barbican_service_user.collect_timing = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] barbican_service_user.insecure = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] barbican_service_user.keyfile = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] barbican_service_user.split_loggers = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] barbican_service_user.timeout = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] barbican_service_user.tls_ciphers = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] barbican_service_user.tls_min_version = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] vault.approle_role_id = **** {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] vault.approle_secret_id = **** {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] vault.auth_method = approle {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] vault.auth_path = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] vault.kv_mountpoint = secret {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] vault.kv_path = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] vault.kv_version = 2 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] vault.namespace = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] vault.root_token_id = **** {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] vault.ssl_ca_crt_file = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] vault.timeout = 60.0 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] vault.token_file = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] vault.token_role = None {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] vault.use_ssl = False {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:21:07 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] ******************************************************************************** {{(pid=75318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 03 07:21:07 devstack sudo[75527]: pam_unix(sudo:session): session closed for user root Nov 03 07:21:07 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-614e8622-4463-4228-985e-c64493490537 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.364s {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:21:07 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-614e8622-4463-4228-985e-c64493490537 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:21:08 devstack sudo[75678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 07:21:08 devstack sudo[75678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:21:08 devstack sudo[75678]: pam_unix(sudo:session): session closed for user root Nov 03 07:21:08 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-614e8622-4463-4228-985e-c64493490537 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.330s {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:21:08 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-614e8622-4463-4228-985e-c64493490537 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:21:08 devstack cinder-volume[75516]: INFO cinder.brick.local_dev.lvm [None req-614e8622-4463-4228-985e-c64493490537 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Nov 03 07:21:08 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-614e8622-4463-4228-985e-c64493490537 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:21:08 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-614e8622-4463-4228-985e-c64493490537 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:21:08 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-614e8622-4463-4228-985e-c64493490537 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:21:08 devstack sudo[75770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 07:21:08 devstack sudo[75770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:21:08 devstack sudo[75770]: pam_unix(sudo:session): session closed for user root Nov 03 07:21:08 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-614e8622-4463-4228-985e-c64493490537 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.345s {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:21:08 devstack cinder-volume[75516]: DEBUG cinder.brick.local_dev.lvm [None req-614e8622-4463-4228-985e-c64493490537 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75516) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Nov 03 07:21:08 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-614e8622-4463-4228-985e-c64493490537 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:21:08 devstack sudo[75859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 07:21:08 devstack sudo[75859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:21:09 devstack sudo[75859]: pam_unix(sudo:session): session closed for user root Nov 03 07:21:09 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-614e8622-4463-4228-985e-c64493490537 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.559s {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:21:09 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-614e8622-4463-4228-985e-c64493490537 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:21:09 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-614e8622-4463-4228-985e-c64493490537 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:21:09 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-614e8622-4463-4228-985e-c64493490537 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:21:09 devstack sudo[76051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 07:21:09 devstack sudo[76051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:21:09 devstack sudo[76051]: pam_unix(sudo:session): session closed for user root Nov 03 07:21:09 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-614e8622-4463-4228-985e-c64493490537 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.362s {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:21:09 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-614e8622-4463-4228-985e-c64493490537 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:21:09 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-614e8622-4463-4228-985e-c64493490537 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:21:09 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-614e8622-4463-4228-985e-c64493490537 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:21:09 devstack sudo[76131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Nov 03 07:21:09 devstack sudo[76131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:21:10 devstack sudo[76131]: pam_unix(sudo:session): session closed for user root Nov 03 07:21:10 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-614e8622-4463-4228-985e-c64493490537 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.350s {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:21:10 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-614e8622-4463-4228-985e-c64493490537 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:21:10 devstack sudo[76213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 07:21:10 devstack sudo[76213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:21:10 devstack sudo[76213]: pam_unix(sudo:session): session closed for user root Nov 03 07:21:10 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-614e8622-4463-4228-985e-c64493490537 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.325s {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:21:10 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-614e8622-4463-4228-985e-c64493490537 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:21:10 devstack sudo[76218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 07:21:10 devstack sudo[76218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:21:10 devstack sudo[76218]: pam_unix(sudo:session): session closed for user root Nov 03 07:21:10 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-614e8622-4463-4228-985e-c64493490537 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.341s {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:21:10 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-614e8622-4463-4228-985e-c64493490537 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:21:10 devstack sudo[76258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 07:21:10 devstack sudo[76258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:21:11 devstack sudo[76258]: pam_unix(sudo:session): session closed for user root Nov 03 07:21:11 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-614e8622-4463-4228-985e-c64493490537 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.335s {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:21:11 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-614e8622-4463-4228-985e-c64493490537 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:21:11 devstack sudo[76310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 07:21:11 devstack sudo[76310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:21:11 devstack sudo[76310]: pam_unix(sudo:session): session closed for user root Nov 03 07:21:11 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-614e8622-4463-4228-985e-c64493490537 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.305s {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:21:11 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-614e8622-4463-4228-985e-c64493490537 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:21:11 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-614e8622-4463-4228-985e-c64493490537 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:21:11 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-614e8622-4463-4228-985e-c64493490537 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:21:11 devstack sudo[76320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 07:21:11 devstack sudo[76320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:21:11 devstack sudo[76320]: pam_unix(sudo:session): session closed for user root Nov 03 07:21:11 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-614e8622-4463-4228-985e-c64493490537 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.277s {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:21:11 devstack cinder-volume[75516]: INFO cinder.volume.drivers.lvm [None req-614e8622-4463-4228-985e-c64493490537 None None] Enabling LVM thin provisioning by default because a thin pool exists. Nov 03 07:21:11 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-614e8622-4463-4228-985e-c64493490537 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:21:11 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-614e8622-4463-4228-985e-c64493490537 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:21:11 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-614e8622-4463-4228-985e-c64493490537 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:21:11 devstack sudo[76324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 07:21:11 devstack sudo[76324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:21:11 devstack sudo[76324]: pam_unix(sudo:session): session closed for user root Nov 03 07:21:11 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-614e8622-4463-4228-985e-c64493490537 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.300s {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:21:11 devstack cinder-volume[75516]: DEBUG cinder.volume.drivers.lvm [None req-614e8622-4463-4228-985e-c64493490537 None None] Updating volume stats {{(pid=75516) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 07:21:11 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-614e8622-4463-4228-985e-c64493490537 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:21:11 devstack sudo[76327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 07:21:11 devstack sudo[76327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:21:12 devstack sudo[76327]: pam_unix(sudo:session): session closed for user root Nov 03 07:21:12 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-614e8622-4463-4228-985e-c64493490537 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.319s {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:21:12 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-614e8622-4463-4228-985e-c64493490537 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:21:12 devstack sudo[76330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 07:21:12 devstack sudo[76330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:21:12 devstack sudo[76330]: pam_unix(sudo:session): session closed for user root Nov 03 07:21:12 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-614e8622-4463-4228-985e-c64493490537 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:21:12 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-614e8622-4463-4228-985e-c64493490537 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:21:12 devstack sudo[76333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 07:21:12 devstack sudo[76333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:21:12 devstack sudo[76333]: pam_unix(sudo:session): session closed for user root Nov 03 07:21:12 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-614e8622-4463-4228-985e-c64493490537 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.316s {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:21:12 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-614e8622-4463-4228-985e-c64493490537 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:21:12 devstack sudo[76336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 07:21:12 devstack sudo[76336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:21:13 devstack sudo[76336]: pam_unix(sudo:session): session closed for user root Nov 03 07:21:13 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-614e8622-4463-4228-985e-c64493490537 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:21:13 devstack cinder-volume[75516]: INFO cinder.volume.driver [None req-614e8622-4463-4228-985e-c64493490537 None None] Driver hasn't implemented _init_vendor_properties() Nov 03 07:21:13 devstack cinder-volume[75516]: DEBUG cinder.volume.driver [None req-614e8622-4463-4228-985e-c64493490537 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75516) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 03 07:21:13 devstack cinder-volume[75516]: DEBUG oslo_db.sqlalchemy.engines [None req-614e8622-4463-4228-985e-c64493490537 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75516) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 07:21:13 devstack cinder-volume[75516]: DEBUG dbcounter [-] [75516] Writer thread running {{(pid=75516) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 07:21:13 devstack cinder-volume[75516]: DEBUG cinder.db.api [None req-614e8622-4463-4228-985e-c64493490537 None None] Building query based on filter {{(pid=75516) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}} Nov 03 07:21:13 devstack cinder-volume[75516]: DEBUG cinder.image.image_utils [None req-614e8622-4463-4228-985e-c64493490537 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75516) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 03 07:21:13 devstack cinder-volume[75516]: INFO cinder.keymgr.migration [None req-8fdbfc22-e07a-4018-8e7b-aa9c33260103 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 03 07:21:13 devstack cinder-volume[75516]: DEBUG cinder.volume.drivers.lvm [None req-614e8622-4463-4228-985e-c64493490537 None None] Updating volume stats {{(pid=75516) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 07:21:13 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-614e8622-4463-4228-985e-c64493490537 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:21:13 devstack sudo[76341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 07:21:13 devstack sudo[76341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:21:13 devstack sudo[76341]: pam_unix(sudo:session): session closed for user root Nov 03 07:21:13 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-614e8622-4463-4228-985e-c64493490537 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:21:13 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-614e8622-4463-4228-985e-c64493490537 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:21:13 devstack sudo[76345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 07:21:13 devstack sudo[76345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:21:13 devstack sudo[76345]: pam_unix(sudo:session): session closed for user root Nov 03 07:21:13 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-614e8622-4463-4228-985e-c64493490537 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.302s {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:21:13 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-614e8622-4463-4228-985e-c64493490537 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:21:13 devstack sudo[76349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 07:21:13 devstack sudo[76349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:21:14 devstack sudo[76349]: pam_unix(sudo:session): session closed for user root Nov 03 07:21:14 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-614e8622-4463-4228-985e-c64493490537 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.281s {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:21:14 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-614e8622-4463-4228-985e-c64493490537 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:21:14 devstack sudo[76352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 07:21:14 devstack sudo[76352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:21:14 devstack sudo[76352]: pam_unix(sudo:session): session closed for user root Nov 03 07:21:14 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-614e8622-4463-4228-985e-c64493490537 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:21:14 devstack cinder-volume[75516]: DEBUG cinder.manager [None req-614e8622-4463-4228-985e-c64493490537 None None] Notifying Schedulers of capabilities ... {{(pid=75516) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:21:14 devstack cinder-volume[75516]: INFO cinder.volume.manager [None req-614e8622-4463-4228-985e-c64493490537 None None] Driver initialization completed successfully. Nov 03 07:21:14 devstack cinder-volume[75516]: INFO cinder.manager [None req-614e8622-4463-4228-985e-c64493490537 None None] Initiating service 2 cleanup Nov 03 07:21:14 devstack cinder-volume[75516]: INFO cinder.manager [None req-614e8622-4463-4228-985e-c64493490537 None None] Service 2 cleanup completed. Nov 03 07:21:14 devstack cinder-volume[75516]: DEBUG cinder.service [None req-614e8622-4463-4228-985e-c64493490537 None None] Creating RPC server for service cinder-volume {{(pid=75516) start /opt/stack/cinder/cinder/service.py:231}} Nov 03 07:21:14 devstack cinder-volume[75516]: DEBUG cinder.service [None req-614e8622-4463-4228-985e-c64493490537 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75516) start /opt/stack/cinder/cinder/service.py:237}} Nov 03 07:21:14 devstack cinder-volume[75516]: INFO cinder.volume.manager [None req-614e8622-4463-4228-985e-c64493490537 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Nov 03 07:21:14 devstack cinder-volume[75516]: DEBUG cinder.volume.drivers.lvm [None req-614e8622-4463-4228-985e-c64493490537 None None] Updating volume stats {{(pid=75516) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 07:21:14 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-614e8622-4463-4228-985e-c64493490537 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:21:14 devstack sudo[76367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 07:21:14 devstack sudo[76367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:21:15 devstack sudo[76367]: pam_unix(sudo:session): session closed for user root Nov 03 07:21:15 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-614e8622-4463-4228-985e-c64493490537 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.300s {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:21:15 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-614e8622-4463-4228-985e-c64493490537 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:21:15 devstack sudo[76370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 07:21:15 devstack sudo[76370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:21:15 devstack sudo[76370]: pam_unix(sudo:session): session closed for user root Nov 03 07:21:15 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-614e8622-4463-4228-985e-c64493490537 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:21:15 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-614e8622-4463-4228-985e-c64493490537 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:21:15 devstack sudo[76373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 07:21:15 devstack sudo[76373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:21:15 devstack sudo[76373]: pam_unix(sudo:session): session closed for user root Nov 03 07:21:15 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-614e8622-4463-4228-985e-c64493490537 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.298s {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:21:15 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-614e8622-4463-4228-985e-c64493490537 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:21:15 devstack sudo[76376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 07:21:15 devstack sudo[76376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:21:15 devstack sudo[76376]: pam_unix(sudo:session): session closed for user root Nov 03 07:21:15 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-614e8622-4463-4228-985e-c64493490537 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:21:15 devstack cinder-volume[75516]: INFO cinder.volume.manager [None req-614e8622-4463-4228-985e-c64493490537 None None] Driver post RPC initialization completed successfully. Nov 03 07:21:17 devstack cinder-volume[75318]: DEBUG dbcounter [-] [75318] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75318) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:21:24 devstack cinder-volume[75516]: DEBUG dbcounter [-] [75516] Writing DB stats cinder:SELECT=3 {{(pid=75516) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:21:25 devstack cinder-volume[75516]: DEBUG dbcounter [-] [75516] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75516) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:21:30 devstack cinder-volume[75516]: DEBUG oslo_service.periodic_task [None req-f87e9c78-f993-4170-936b-652089b09fc7 None None] Running periodic task VolumeManager._thread_info {{(pid=75516) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:21:30 devstack cinder-volume[75516]: DEBUG cinder.volume.manager [None req-f87e9c78-f993-4170-936b-652089b09fc7 None None] thread count: 6 {{(pid=75516) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:21:30 devstack cinder-volume[75516]: DEBUG cinder.volume.manager [None req-f87e9c78-f993-4170-936b-652089b09fc7 None None] thread info: [<_MainThread(MainThread, started 134433166909568)>, , , , , ] {{(pid=75516) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:22:30 devstack cinder-volume[75516]: DEBUG oslo_service.periodic_task [None req-f87e9c78-f993-4170-936b-652089b09fc7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75516) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:22:30 devstack cinder-volume[75516]: DEBUG cinder.volume.drivers.lvm [None req-f87e9c78-f993-4170-936b-652089b09fc7 None None] Updating volume stats {{(pid=75516) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 07:22:30 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-f87e9c78-f993-4170-936b-652089b09fc7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:22:30 devstack sudo[78860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 07:22:30 devstack sudo[78860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:22:31 devstack sudo[78860]: pam_unix(sudo:session): session closed for user root Nov 03 07:22:31 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-f87e9c78-f993-4170-936b-652089b09fc7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.305s {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:22:31 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-f87e9c78-f993-4170-936b-652089b09fc7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:22:31 devstack sudo[78863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 07:22:31 devstack sudo[78863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:22:31 devstack sudo[78863]: pam_unix(sudo:session): session closed for user root Nov 03 07:22:31 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-f87e9c78-f993-4170-936b-652089b09fc7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.292s {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:22:31 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-f87e9c78-f993-4170-936b-652089b09fc7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:22:31 devstack sudo[78866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 07:22:31 devstack sudo[78866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:22:31 devstack sudo[78866]: pam_unix(sudo:session): session closed for user root Nov 03 07:22:31 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-f87e9c78-f993-4170-936b-652089b09fc7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:22:31 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-f87e9c78-f993-4170-936b-652089b09fc7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:22:31 devstack sudo[78869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 07:22:31 devstack sudo[78869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:22:32 devstack sudo[78869]: pam_unix(sudo:session): session closed for user root Nov 03 07:22:32 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-f87e9c78-f993-4170-936b-652089b09fc7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.295s {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:22:32 devstack cinder-volume[75516]: DEBUG cinder.manager [None req-f87e9c78-f993-4170-936b-652089b09fc7 None None] Notifying Schedulers of capabilities ... {{(pid=75516) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:22:32 devstack cinder-volume[75516]: DEBUG oslo_service.periodic_task [None req-f87e9c78-f993-4170-936b-652089b09fc7 None None] Running periodic task VolumeManager._thread_info {{(pid=75516) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:22:32 devstack cinder-volume[75516]: DEBUG cinder.volume.manager [None req-f87e9c78-f993-4170-936b-652089b09fc7 None None] thread count: 6 {{(pid=75516) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:22:32 devstack cinder-volume[75516]: DEBUG cinder.volume.manager [None req-f87e9c78-f993-4170-936b-652089b09fc7 None None] thread info: [<_MainThread(MainThread, started 134433166909568)>, , , , , ] {{(pid=75516) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:23:25 devstack cinder-volume[75516]: DEBUG dbcounter [-] [75516] Writing DB stats cinder:SELECT=1 {{(pid=75516) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:23:25 devstack cinder-volume[75516]: DEBUG dbcounter [-] [75516] Writing DB stats cinder:UPDATE=1 {{(pid=75516) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:23:30 devstack cinder-volume[75516]: DEBUG oslo_service.periodic_task [None req-f87e9c78-f993-4170-936b-652089b09fc7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75516) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:23:30 devstack cinder-volume[75516]: DEBUG cinder.volume.drivers.lvm [None req-f87e9c78-f993-4170-936b-652089b09fc7 None None] Updating volume stats {{(pid=75516) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 07:23:30 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-f87e9c78-f993-4170-936b-652089b09fc7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:23:30 devstack sudo[81732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 07:23:30 devstack sudo[81732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:23:31 devstack sudo[81732]: pam_unix(sudo:session): session closed for user root Nov 03 07:23:31 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-f87e9c78-f993-4170-936b-652089b09fc7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.289s {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:23:31 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-f87e9c78-f993-4170-936b-652089b09fc7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:23:31 devstack sudo[81751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 07:23:31 devstack sudo[81751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:23:31 devstack sudo[81751]: pam_unix(sudo:session): session closed for user root Nov 03 07:23:31 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-f87e9c78-f993-4170-936b-652089b09fc7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.312s {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:23:31 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-f87e9c78-f993-4170-936b-652089b09fc7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:23:31 devstack sudo[81754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 07:23:31 devstack sudo[81754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:23:31 devstack sudo[81754]: pam_unix(sudo:session): session closed for user root Nov 03 07:23:31 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-f87e9c78-f993-4170-936b-652089b09fc7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.271s {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:23:31 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-f87e9c78-f993-4170-936b-652089b09fc7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:23:31 devstack sudo[81757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 07:23:31 devstack sudo[81757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:23:32 devstack sudo[81757]: pam_unix(sudo:session): session closed for user root Nov 03 07:23:32 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-f87e9c78-f993-4170-936b-652089b09fc7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.293s {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:23:32 devstack cinder-volume[75516]: DEBUG cinder.manager [None req-f87e9c78-f993-4170-936b-652089b09fc7 None None] Notifying Schedulers of capabilities ... {{(pid=75516) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:23:32 devstack cinder-volume[75516]: DEBUG oslo_service.periodic_task [None req-f87e9c78-f993-4170-936b-652089b09fc7 None None] Running periodic task VolumeManager._thread_info {{(pid=75516) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:23:32 devstack cinder-volume[75516]: DEBUG cinder.volume.manager [None req-f87e9c78-f993-4170-936b-652089b09fc7 None None] thread count: 6 {{(pid=75516) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:23:32 devstack cinder-volume[75516]: DEBUG cinder.volume.manager [None req-f87e9c78-f993-4170-936b-652089b09fc7 None None] thread info: [<_MainThread(MainThread, started 134433166909568)>, , , , , ] {{(pid=75516) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:24:30 devstack cinder-volume[75516]: DEBUG oslo_service.periodic_task [None req-f87e9c78-f993-4170-936b-652089b09fc7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75516) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:24:30 devstack cinder-volume[75516]: DEBUG cinder.volume.drivers.lvm [None req-f87e9c78-f993-4170-936b-652089b09fc7 None None] Updating volume stats {{(pid=75516) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 07:24:30 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-f87e9c78-f993-4170-936b-652089b09fc7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:24:30 devstack sudo[83800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 07:24:30 devstack sudo[83800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:24:31 devstack sudo[83800]: pam_unix(sudo:session): session closed for user root Nov 03 07:24:31 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-f87e9c78-f993-4170-936b-652089b09fc7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.383s {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:24:31 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-f87e9c78-f993-4170-936b-652089b09fc7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:24:31 devstack sudo[83809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 07:24:31 devstack sudo[83809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:24:31 devstack sudo[83809]: pam_unix(sudo:session): session closed for user root Nov 03 07:24:31 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-f87e9c78-f993-4170-936b-652089b09fc7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.321s {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:24:31 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-f87e9c78-f993-4170-936b-652089b09fc7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:24:31 devstack sudo[83816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 07:24:31 devstack sudo[83816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:24:31 devstack sudo[83816]: pam_unix(sudo:session): session closed for user root Nov 03 07:24:31 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-f87e9c78-f993-4170-936b-652089b09fc7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.302s {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:24:31 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-f87e9c78-f993-4170-936b-652089b09fc7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:24:31 devstack sudo[83830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 07:24:31 devstack sudo[83830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:24:32 devstack sudo[83830]: pam_unix(sudo:session): session closed for user root Nov 03 07:24:32 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-f87e9c78-f993-4170-936b-652089b09fc7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.337s {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:24:32 devstack cinder-volume[75516]: DEBUG cinder.manager [None req-f87e9c78-f993-4170-936b-652089b09fc7 None None] Notifying Schedulers of capabilities ... {{(pid=75516) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:24:32 devstack cinder-volume[75516]: DEBUG oslo_service.periodic_task [None req-f87e9c78-f993-4170-936b-652089b09fc7 None None] Running periodic task VolumeManager._thread_info {{(pid=75516) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:24:32 devstack cinder-volume[75516]: DEBUG cinder.volume.manager [None req-f87e9c78-f993-4170-936b-652089b09fc7 None None] thread count: 6 {{(pid=75516) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:24:32 devstack cinder-volume[75516]: DEBUG cinder.volume.manager [None req-f87e9c78-f993-4170-936b-652089b09fc7 None None] thread info: [<_MainThread(MainThread, started 134433166909568)>, , , , , ] {{(pid=75516) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:25:25 devstack cinder-volume[75516]: DEBUG dbcounter [-] [75516] Writing DB stats cinder:SELECT=1 {{(pid=75516) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:25:25 devstack cinder-volume[75516]: DEBUG dbcounter [-] [75516] Writing DB stats cinder:UPDATE=1 {{(pid=75516) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:25:30 devstack cinder-volume[75516]: DEBUG oslo_service.periodic_task [None req-f87e9c78-f993-4170-936b-652089b09fc7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75516) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:25:30 devstack cinder-volume[75516]: DEBUG cinder.volume.drivers.lvm [None req-f87e9c78-f993-4170-936b-652089b09fc7 None None] Updating volume stats {{(pid=75516) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 07:25:30 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-f87e9c78-f993-4170-936b-652089b09fc7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:30 devstack sudo[85325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 07:25:30 devstack sudo[85325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:31 devstack sudo[85325]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:31 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-f87e9c78-f993-4170-936b-652089b09fc7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.302s {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:31 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-f87e9c78-f993-4170-936b-652089b09fc7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:31 devstack sudo[85328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 07:25:31 devstack sudo[85328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:31 devstack sudo[85328]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:31 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-f87e9c78-f993-4170-936b-652089b09fc7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.312s {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:31 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-f87e9c78-f993-4170-936b-652089b09fc7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:31 devstack sudo[85334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 07:25:31 devstack sudo[85334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:31 devstack sudo[85334]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:31 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-f87e9c78-f993-4170-936b-652089b09fc7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.297s {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:31 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-f87e9c78-f993-4170-936b-652089b09fc7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:25:31 devstack sudo[85337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 07:25:31 devstack sudo[85337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:25:32 devstack sudo[85337]: pam_unix(sudo:session): session closed for user root Nov 03 07:25:32 devstack cinder-volume[75516]: DEBUG oslo_concurrency.processutils [None req-f87e9c78-f993-4170-936b-652089b09fc7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.309s {{(pid=75516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:25:32 devstack cinder-volume[75516]: DEBUG cinder.manager [None req-f87e9c78-f993-4170-936b-652089b09fc7 None None] Notifying Schedulers of capabilities ... {{(pid=75516) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:25:32 devstack cinder-volume[75516]: DEBUG oslo_service.periodic_task [None req-f87e9c78-f993-4170-936b-652089b09fc7 None None] Running periodic task VolumeManager._thread_info {{(pid=75516) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:25:32 devstack cinder-volume[75516]: DEBUG cinder.volume.manager [None req-f87e9c78-f993-4170-936b-652089b09fc7 None None] thread count: 6 {{(pid=75516) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:25:32 devstack cinder-volume[75516]: DEBUG cinder.volume.manager [None req-f87e9c78-f993-4170-936b-652089b09fc7 None None] thread info: [<_MainThread(MainThread, started 134433166909568)>, , , , , ] {{(pid=75516) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:26:03 devstack cinder-volume[75318]: INFO oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] Caught SIGTERM, stopping children Nov 03 07:26:03 devstack cinder-volume[75318]: DEBUG oslo_concurrency.lockutils [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] Acquiring lock "singleton_lock" {{(pid=75318) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 07:26:03 devstack cinder-volume[75318]: DEBUG oslo_concurrency.lockutils [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] Acquired lock "singleton_lock" {{(pid=75318) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 07:26:03 devstack cinder-volume[75318]: DEBUG oslo_concurrency.lockutils [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] Releasing lock "singleton_lock" {{(pid=75318) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 07:26:03 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] Stop services. {{(pid=75318) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 03 07:26:03 devstack cinder-volume[75318]: DEBUG oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] Killing children. {{(pid=75318) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 03 07:26:03 devstack cinder-volume[75318]: INFO oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] Waiting on 1 children to exit Nov 03 07:26:04 devstack cinder-volume[75516]: DEBUG oslo_concurrency.lockutils [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] Acquiring lock "singleton_lock" {{(pid=75516) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 07:26:04 devstack cinder-volume[75516]: DEBUG oslo_concurrency.lockutils [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] Acquired lock "singleton_lock" {{(pid=75516) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 07:26:04 devstack cinder-volume[75516]: DEBUG oslo_concurrency.lockutils [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] Releasing lock "singleton_lock" {{(pid=75516) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 07:26:04 devstack cinder-volume[75516]: WARNING amqp [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 03 07:26:04 devstack cinder-volume[75516]: WARNING amqp [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 03 07:26:04 devstack cinder-volume[75318]: INFO oslo_service.backend._eventlet.service [None req-dd702c89-d351-4e13-8492-ae8e1bb94d1b None None] Child 75516 exited with status 0 Nov 03 07:26:05 devstack cinder-volume[86004]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 03 07:26:05 devstack cinder-volume[86004]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 03 07:26:05 devstack cinder-volume[86004]: we strongly recommend against using it for new projects. Nov 03 07:26:05 devstack cinder-volume[86004]: If you are already using Eventlet, we recommend migrating to a different Nov 03 07:26:05 devstack cinder-volume[86004]: framework. For more detail see Nov 03 07:26:05 devstack cinder-volume[86004]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 03 07:26:05 devstack cinder-volume[86004]: import eventlet # noqa Nov 03 07:26:07 devstack cinder-volume[86004]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86004) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 07:26:07 devstack cinder-volume[86004]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86004) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 07:26:07 devstack cinder-volume[86004]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86004) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 07:26:08 devstack cinder-volume[86004]: INFO dbcounter [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] Registered counter for database cinder Nov 03 07:26:08 devstack cinder-volume[86004]: DEBUG oslo_db.sqlalchemy.engines [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86004) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 07:26:08 devstack cinder-volume[86004]: DEBUG dbcounter [-] [86004] Writer thread running {{(pid=86004) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 07:26:08 devstack cinder-volume[86004]: INFO cinder.rpc [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 03 07:26:08 devstack cinder-volume[86004]: INFO cinder.rpc [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_db.sqlalchemy.engines [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86004) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 07:26:09 devstack cinder-volume[86004]: INFO cinder.volume.manager [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] Determined volume DB was empty at startup. Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG cinder.volume.manager [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86004) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 03 07:26:09 devstack cinder-volume[86004]: INFO cinder.volume.manager [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 03 07:26:09 devstack cinder-volume[86004]: WARNING stevedore.named [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 03 07:26:09 devstack cinder-volume[86004]: WARNING castellan.key_manager [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 07:26:09 devstack cinder-volume[86004]: WARNING cinder.keymgr.conf_key_mgr [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 07:26:09 devstack cinder-volume[86004]: INFO cinder.volume.manager [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_db.sqlalchemy.engines [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86004) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 07:26:09 devstack cinder-volume[86004]: INFO oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] Starting 1 workers Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] Started child 86263 {{(pid=86004) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] Full set of CONF: {{(pid=86004) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] ******************************************************************************** {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] Configuration options gathered from: {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] ================================================================================ {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] allow_availability_zone_fallback = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] allow_compression_on_image_upload = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86263]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] allowed_direct_url_schemes = [] {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] api_rate_limit = True {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] auth_strategy = keystone {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_availability_zone = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_host = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_name = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_stats_polling_interval = 60 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backup_api_class = cinder.backup.api.API {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backup_name_template = backup-%s {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backup_use_same_host = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backup_use_temp_snapshot = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] chap_password = **** {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] chap_username = {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] cinder_internal_tenant_project_id = 55d20126cd5b49fa82036b2c336399dc {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] cinder_internal_tenant_user_id = 5d7487e56ad44ff8922c8d768920698d {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] cluster = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] compression_format = gzip {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] compute_api_class = cinder.compute.nova.API {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] config_dir = [] {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] config_source = [] {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] control_exchange = openstack {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] debug = True {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] default_availability_zone = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] default_group_type = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] default_volume_type = QuobyteHD {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] disk_geometry = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] driver_client_cert = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] driver_client_cert_key = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] driver_data_namespace = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] driver_ssl_cert_path = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] driver_ssl_cert_verify = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] driver_use_ssl = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] enable_new_services = True {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] enable_unsupported_driver = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] enabled_backends = ['QuobyteHD'] {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] enforce_multipath_for_image_xfer = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] filter_function = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] glance_api_insecure = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] glance_api_servers = ['http://192.168.122.249/image'] {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] glance_api_ssl_compression = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] glance_ca_certificates_file = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] glance_catalog_info = image:glance:publicURL {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] glance_certfile = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] glance_keyfile = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] glance_num_retries = 3 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] glance_request_timeout = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] goodness_function = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] graceful_shutdown_timeout = 5 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] group_api_class = cinder.group.api.API {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] host = devstack {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] image_compress_on_upload = True {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] image_conversion_address_space_limit = 1 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] image_conversion_cpu_limit = 60 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] image_conversion_disable = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] image_introspection_address_space_limit = 1 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] image_introspection_cpu_limit = 60 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] image_upload_use_cinder_backend = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] image_upload_use_internal_tenant = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] image_volume_cache_enabled = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] image_volume_cache_max_count = 0 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] image_volume_cache_max_size_gb = 0 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] init_host_max_objects_retrieval = 0 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] instance_format = [instance: %(uuid)s] {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] iscsi_target_flags = {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] iscsi_write_cache = on {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] iser_helper = tgtadm {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] iser_ip_address = 192.168.122.249 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] iser_port = 3260 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] log_color = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] log_config_append = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] log_dir = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] log_file = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] log_options = True {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] log_rotate_interval = 1 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] log_rotate_interval_type = days {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] log_rotation_type = none {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] max_age = 0 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] max_logfile_count = 30 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] max_logfile_size_mb = 200 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] max_over_subscription_ratio = 20.0 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] message_reap_interval = 86400 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] message_ttl = 2592000 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] migration_create_volume_timeout_secs = 300 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] monkey_patch = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] monkey_patch_modules = [] {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] my_ip = 192.168.122.249 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] no_snapshot_gb_quota = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] num_iser_scan_tries = 3 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] num_shell_tries = 3 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] num_volume_device_scan_tries = 3 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] nvmeof_conn_info_version = 1 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] nvmet_ns_id = 10 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] nvmet_port_id = 1 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86263]: INFO cinder.volume.manager [None req-b9ee657d-4486-4f0d-a46d-4a4647b8da69 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] osapi_max_limit = 1000 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86263]: DEBUG cinder.volume.drivers.remotefs [None req-b9ee657d-4486-4f0d-a46d-4a4647b8da69 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86263) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] osapi_volume_ext_list = [] {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] osapi_volume_listen = 0.0.0.0 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] osapi_volume_listen_port = 8776 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] osapi_volume_use_ssl = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] osapi_volume_workers = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] per_volume_size_limit = -1 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] periodic_fuzzy_delay = 60 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] periodic_interval = 60 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] project_id_regex = [0-9a-f\-]+ {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] public_endpoint = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] publish_errors = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] quota_backup_gigabytes = 1000 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] quota_backups = 10 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] quota_gigabytes = 1000 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] quota_groups = 10 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] quota_snapshots = 10 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] quota_volumes = 10 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] rate_limit_burst = 0 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] rate_limit_except_level = CRITICAL {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] rate_limit_interval = 0 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] reinit_driver_count = 3 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] replication_device = **** {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] report_discard_supported = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] report_interval = 120 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] reservation_clean_interval = 86400 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] reservation_expire = 86400 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] reserved_image_namespaces = [] {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] reserved_percentage = 0 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] rpc_response_timeout = 120 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] run_external_periodic_tasks = True {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] scst_target_driver = iscsi {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] scst_target_iqn_name = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] service_down_time = 720 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] shell_completion = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] snapshot_name_template = snapshot-%s {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] split_loggers = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] state_path = /opt/stack/data/cinder {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] storage_availability_zone = nova {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] storage_protocol = iSCSI {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] syslog_log_facility = LOG_USER {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] target_helper = lioadm {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] target_ip_address = 192.168.122.249 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] target_port = 3260 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] target_protocol = iscsi {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] target_secondary_ip_addresses = [] {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] trace_flags = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] transfer_api_class = cinder.transfer.api.API {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] transport_url = **** {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] until_refresh = 0 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] use_chap_auth = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] use_default_quota_class = True {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] use_journal = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] use_json = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] use_multipath_for_image_xfer = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] use_stderr = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] use_syslog = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] verify_glance_signatures = enabled {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] volume_api_class = cinder.volume.api.API {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] volume_backend_name = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] volume_clear = zero {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] volume_clear_ionice = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] volume_clear_size = 0 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] volume_copy_bps_limit = 0 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] volume_dd_blocksize = 1M {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] volume_name_template = volume-%s {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] volume_service_inithost_offload = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] volume_usage_audit_period = month {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] zoning_mode = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_concurrency.disable_process_locking = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] keystone_authtoken.auth_section = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] keystone_authtoken.auth_type = password {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] keystone_authtoken.auth_version = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] keystone_authtoken.cache = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] keystone_authtoken.certfile = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] keystone_authtoken.delay_auth_decision = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] keystone_authtoken.http_connect_timeout = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] keystone_authtoken.include_service_catalog = True {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] keystone_authtoken.insecure = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] keystone_authtoken.interface = public {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] keystone_authtoken.keyfile = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] keystone_authtoken.memcache_password = **** {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] keystone_authtoken.memcache_username = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] keystone_authtoken.region_name = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] keystone_authtoken.service_token_roles_required = True {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] keystone_authtoken.service_type = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] keystone_authtoken.token_cache_time = 300 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.249/identity {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] cache.backend = dogpile.cache.null {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] cache.backend_argument = **** {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] cache.backend_expiration_time = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] cache.config_prefix = cache.oslo {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] cache.debug_cache_backend = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] cache.enable_retry_client = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] cache.enable_socket_keepalive = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] cache.enabled = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] cache.expiration_time = 600 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] cache.hashclient_retry_attempts = 2 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] cache.memcache_dead_retry = 300 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] cache.memcache_pool_maxsize = 10 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] cache.memcache_sasl_enabled = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] cache.password = **** {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] cache.proxies = [] {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] cache.redis_db = 0 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] cache.redis_sentinel_service_name = mymaster {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] cache.redis_server = localhost:6379 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] cache.retry_attempts = 2 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] cache.retry_delay = 0.0 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] cache.socket_keepalive_count = 1 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] cache.socket_keepalive_idle = 1 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] cache.socket_keepalive_interval = 1 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] cache.socket_timeout = 1.0 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] cache.tls_allowed_ciphers = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] cache.tls_cafile = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86263]: DEBUG cinder.volume.drivers.quobyte [None req-b9ee657d-4486-4f0d-a46d-4a4647b8da69 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86263) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] cache.tls_certfile = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] cache.tls_enabled = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86263]: WARNING cinder.volume.drivers.quobyte [None req-b9ee657d-4486-4f0d-a46d-4a4647b8da69 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] cache.tls_keyfile = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] cache.username = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] coordination.backend_url = **** {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] database.asyncio_connection = **** {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] database.asyncio_slave_connection = **** {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] database.backend = sqlalchemy {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] database.connection = **** {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86263]: WARNING cinder.volume.drivers.quobyte [None req-b9ee657d-4486-4f0d-a46d-4a4647b8da69 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] database.connection_debug = 0 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] database.connection_parameters = {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] database.connection_recycle_time = 3600 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] database.connection_trace = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] database.db_inc_retry_interval = True {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] database.db_max_retries = 20 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] database.db_max_retry_interval = 10 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] database.db_retry_interval = 1 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] database.max_overflow = 50 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] database.max_pool_size = 5 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] database.max_retries = 10 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86263]: DEBUG oslo_concurrency.processutils [None req-b9ee657d-4486-4f0d-a46d-4a4647b8da69 None None] Running cmd (subprocess): mount.quobyte {{(pid=86263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] database.mysql_wsrep_sync_wait = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] database.pool_timeout = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] database.retry_interval = 10 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] database.slave_connection = **** {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] database.sqlite_synchronous = True {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] database.synchronous_reader = True {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] database.use_db_reconnect = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_messaging_tracing.insecure = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] profiler.connection_string = messaging:// {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] profiler.enabled = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] profiler.es_doc_type = notification {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] profiler.es_scroll_size = 10000 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] profiler.es_scroll_time = 2m {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] profiler.filter_error_trace = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] profiler.hmac_keys = **** {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] profiler.sentinel_service_name = mymaster {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] profiler.socket_timeout = 0.1 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] profiler.trace_requests = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] profiler.trace_sqlalchemy = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] profiler_jaeger.process_tags = {} {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] profiler_jaeger.service_name_prefix = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] profiler_otlp.service_name_prefix = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_policy.enforce_new_defaults = True {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_policy.policy_default_rule = default {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_policy.policy_file = policy.yaml {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_policy.remote_timeout = 60.0 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] privsep_osbrick.group = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] privsep_osbrick.helper_command = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] privsep_osbrick.user = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] cinder_sys_admin.group = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] cinder_sys_admin.helper_command = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] cinder_sys_admin.user = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] service_user.auth_section = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] service_user.auth_type = password {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] service_user.cafile = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] service_user.certfile = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] service_user.collect_timing = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] service_user.insecure = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] service_user.keyfile = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] service_user.send_service_user_token = True {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] service_user.split_loggers = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] service_user.timeout = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] service_user.tls_ciphers = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] service_user.tls_min_version = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] glance.auth_section = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] glance.auth_type = password {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] glance.certfile = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] glance.collect_timing = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] glance.insecure = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] glance.keyfile = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] glance.region_name = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] glance.split_loggers = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] glance.timeout = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] glance.tls_ciphers = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] glance.tls_min_version = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.backend_availability_zone = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.chap_password = **** {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.chap_username = {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.disk_geometry = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.driver_client_cert = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.driver_client_cert_key = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.driver_data_namespace = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.driver_use_ssl = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.enable_unsupported_driver = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.extra_capabilities = {} {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.filter_function = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.goodness_function = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.iscsi_target_flags = {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.iscsi_write_cache = on {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.iser_helper = tgtadm {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.iser_ip_address = 192.168.122.249 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.iser_port = 3260 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.nas_host = {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.nas_login = admin {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.nas_mount_options = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.nas_password = **** {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.nas_private_key = {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.nas_share_path = {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.nas_ssh_port = 22 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.num_shell_tries = 3 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.nvmet_port_id = 1 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.quobyte_client_cfg = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.quobyte_volume_url = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.replication_device = **** {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.report_discard_supported = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.reserved_percentage = 0 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.scst_target_driver = iscsi {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.scst_target_iqn_name = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.storage_protocol = iSCSI {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.target_helper = tgtadm {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.target_ip_address = 192.168.122.249 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.target_port = 3260 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.target_protocol = iscsi {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.trace_flags = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.unique_fqdn_network = True {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.use_chap_auth = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.volume_backend_name = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.volume_clear = zero {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.volume_clear_ionice = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86263]: DEBUG oslo_concurrency.processutils [None req-b9ee657d-4486-4f0d-a46d-4a4647b8da69 None None] CMD "mount.quobyte" returned: 1 in 0.073s {{(pid=86263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.volume_clear_size = 0 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86263]: DEBUG oslo_concurrency.lockutils [None req-b9ee657d-4486-4f0d-a46d-4a4647b8da69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86263) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:26:09 devstack cinder-volume[86263]: DEBUG oslo_concurrency.lockutils [None req-b9ee657d-4486-4f0d-a46d-4a4647b8da69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86263) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:26:09 devstack cinder-volume[86263]: DEBUG cinder.volume.drivers.quobyte [None req-b9ee657d-4486-4f0d-a46d-4a4647b8da69 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86263) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:26:09 devstack cinder-volume[86263]: INFO cinder.volume.drivers.quobyte [None req-b9ee657d-4486-4f0d-a46d-4a4647b8da69 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 ... Nov 03 07:26:09 devstack cinder-volume[86263]: DEBUG oslo_concurrency.processutils [None req-b9ee657d-4486-4f0d-a46d-4a4647b8da69 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 -c /etc/quobyte/client-cinder.cfg {{(pid=86263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_reports.file_event_handler = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_reports.log_dir = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.backend_availability_zone = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.backend_host = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.chap_password = **** {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.chap_username = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.chiscsi_conf = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.disk_geometry = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.driver_client_cert = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.driver_client_cert_key = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.driver_data_namespace = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.driver_use_ssl = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.extra_capabilities = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.filter_function = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.goodness_function = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.iscsi_target_flags = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.iscsi_write_cache = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack sudo[86265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 -c /etc/quobyte/client-cinder.cfg Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.iser_helper = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.iser_ip_address = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.iser_port = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.iser_target_prefix = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.nas_host = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.nas_login = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack sudo[86265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.nas_mount_options = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.nas_password = **** {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.nas_private_key = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.nas_share_path = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.nas_ssh_port = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.num_shell_tries = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.nvmet_ns_id = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.nvmet_port_id = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.replication_device = **** {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.report_discard_supported = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.reserved_percentage = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.scst_target_driver = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.storage_protocol = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.target_helper = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.target_ip_address = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.target_port = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.target_prefix = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.target_protocol = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.trace_flags = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.unique_fqdn_network = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.use_chap_auth = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.volume_clear = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.volume_clear_ionice = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.volume_clear_size = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] QuobyteHD.volumes_dir = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_messaging_rabbit.ssl = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_messaging_rabbit.ssl_version = {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_messaging_notifications.driver = [] {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_messaging_notifications.retry = -1 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] oslo_messaging_notifications.transport_url = **** {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] key_manager.fixed_key = **** {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] barbican.barbican_api_version = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] barbican.barbican_endpoint = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] barbican.barbican_endpoint_type = public {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] barbican.barbican_region_name = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] barbican.cafile = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] barbican.certfile = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] barbican.collect_timing = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] barbican.insecure = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] barbican.keyfile = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] barbican.number_of_retries = 60 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] barbican.retry_delay = 1 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] barbican.send_service_user_token = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] barbican.split_loggers = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] barbican.timeout = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] barbican.tls_ciphers = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] barbican.tls_min_version = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] barbican.verify_ssl = True {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] barbican.verify_ssl_path = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] barbican_service_user.auth_section = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] barbican_service_user.auth_type = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] barbican_service_user.cafile = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] barbican_service_user.certfile = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] barbican_service_user.collect_timing = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] barbican_service_user.insecure = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] barbican_service_user.keyfile = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] barbican_service_user.split_loggers = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] barbican_service_user.timeout = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] barbican_service_user.tls_ciphers = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] barbican_service_user.tls_min_version = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] vault.approle_role_id = **** {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] vault.approle_secret_id = **** {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] vault.auth_method = approle {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] vault.auth_path = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] vault.kv_mountpoint = secret {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] vault.kv_path = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] vault.kv_version = 2 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] vault.namespace = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] vault.root_token_id = **** {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] vault.ssl_ca_crt_file = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] vault.timeout = 60.0 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] vault.token_file = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] vault.token_role = None {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] vault.use_ssl = False {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:09 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] ******************************************************************************** {{(pid=86004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 03 07:26:09 devstack sudo[86265]: pam_unix(sudo:session): session closed for user root Nov 03 07:26:09 devstack cinder-volume[86263]: DEBUG oslo_concurrency.processutils [None req-b9ee657d-4486-4f0d-a46d-4a4647b8da69 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.478s {{(pid=86263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:26:09 devstack cinder-volume[86263]: INFO cinder.volume.drivers.quobyte [None req-b9ee657d-4486-4f0d-a46d-4a4647b8da69 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 succeeded Nov 03 07:26:09 devstack cinder-volume[86263]: DEBUG cinder.volume.drivers.quobyte [None req-b9ee657d-4486-4f0d-a46d-4a4647b8da69 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86263) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:26:09 devstack cinder-volume[86263]: DEBUG oslo_concurrency.lockutils [None req-b9ee657d-4486-4f0d-a46d-4a4647b8da69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.489s {{(pid=86263) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:26:09 devstack cinder-volume[86263]: DEBUG oslo_concurrency.processutils [None req-b9ee657d-4486-4f0d-a46d-4a4647b8da69 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:26:09 devstack sudo[86367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:26:09 devstack sudo[86367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:26:10 devstack sudo[86367]: pam_unix(sudo:session): session closed for user root Nov 03 07:26:10 devstack cinder-volume[86263]: DEBUG oslo_concurrency.processutils [None req-b9ee657d-4486-4f0d-a46d-4a4647b8da69 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.281s {{(pid=86263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:26:10 devstack cinder-volume[86263]: INFO cinder.volume.driver [None req-b9ee657d-4486-4f0d-a46d-4a4647b8da69 None None] Driver hasn't implemented _init_vendor_properties() Nov 03 07:26:10 devstack cinder-volume[86263]: DEBUG cinder.volume.driver [None req-b9ee657d-4486-4f0d-a46d-4a4647b8da69 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6651611328125, 'free_capacity_gb': 1773.6651611328125, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86263) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 03 07:26:10 devstack cinder-volume[86263]: DEBUG oslo_db.sqlalchemy.engines [None req-b9ee657d-4486-4f0d-a46d-4a4647b8da69 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86263) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 07:26:10 devstack cinder-volume[86263]: DEBUG dbcounter [-] [86263] Writer thread running {{(pid=86263) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 07:26:10 devstack cinder-volume[86263]: DEBUG cinder.db.api [None req-b9ee657d-4486-4f0d-a46d-4a4647b8da69 None None] Building query based on filter {{(pid=86263) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}} Nov 03 07:26:10 devstack cinder-volume[86263]: DEBUG cinder.image.image_utils [None req-b9ee657d-4486-4f0d-a46d-4a4647b8da69 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86263) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 03 07:26:10 devstack cinder-volume[86263]: INFO cinder.keymgr.migration [None req-18c220e6-a6db-4a9c-9581-7b155bc2d44e None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 03 07:26:10 devstack cinder-volume[86263]: DEBUG oslo_concurrency.lockutils [None req-b9ee657d-4486-4f0d-a46d-4a4647b8da69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86263) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:26:10 devstack cinder-volume[86263]: DEBUG oslo_concurrency.lockutils [None req-b9ee657d-4486-4f0d-a46d-4a4647b8da69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86263) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:26:10 devstack cinder-volume[86263]: DEBUG cinder.volume.drivers.quobyte [None req-b9ee657d-4486-4f0d-a46d-4a4647b8da69 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86263) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:26:10 devstack cinder-volume[86263]: DEBUG cinder.volume.drivers.quobyte [None req-b9ee657d-4486-4f0d-a46d-4a4647b8da69 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86263) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:26:10 devstack cinder-volume[86263]: DEBUG oslo_concurrency.lockutils [None req-b9ee657d-4486-4f0d-a46d-4a4647b8da69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86263) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:26:10 devstack cinder-volume[86263]: DEBUG oslo_concurrency.processutils [None req-b9ee657d-4486-4f0d-a46d-4a4647b8da69 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:26:10 devstack sudo[86377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:26:10 devstack sudo[86377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:26:10 devstack sudo[86377]: pam_unix(sudo:session): session closed for user root Nov 03 07:26:10 devstack cinder-volume[86263]: DEBUG oslo_concurrency.processutils [None req-b9ee657d-4486-4f0d-a46d-4a4647b8da69 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.356s {{(pid=86263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:26:10 devstack cinder-volume[86263]: DEBUG cinder.manager [None req-b9ee657d-4486-4f0d-a46d-4a4647b8da69 None None] Notifying Schedulers of capabilities ... {{(pid=86263) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:26:10 devstack cinder-volume[86263]: INFO cinder.volume.manager [None req-b9ee657d-4486-4f0d-a46d-4a4647b8da69 None None] Driver initialization completed successfully. Nov 03 07:26:10 devstack cinder-volume[86263]: INFO cinder.manager [None req-b9ee657d-4486-4f0d-a46d-4a4647b8da69 None None] Initiating service 3 cleanup Nov 03 07:26:10 devstack cinder-volume[86263]: INFO cinder.manager [None req-b9ee657d-4486-4f0d-a46d-4a4647b8da69 None None] Service 3 cleanup completed. Nov 03 07:26:10 devstack cinder-volume[86263]: DEBUG cinder.service [None req-b9ee657d-4486-4f0d-a46d-4a4647b8da69 None None] Creating RPC server for service cinder-volume {{(pid=86263) start /opt/stack/cinder/cinder/service.py:231}} Nov 03 07:26:10 devstack cinder-volume[86263]: DEBUG cinder.service [None req-b9ee657d-4486-4f0d-a46d-4a4647b8da69 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86263) start /opt/stack/cinder/cinder/service.py:237}} Nov 03 07:26:11 devstack cinder-volume[86263]: INFO cinder.volume.manager [None req-b9ee657d-4486-4f0d-a46d-4a4647b8da69 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 03 07:26:11 devstack cinder-volume[86263]: DEBUG oslo_concurrency.lockutils [None req-b9ee657d-4486-4f0d-a46d-4a4647b8da69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86263) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:26:11 devstack cinder-volume[86263]: DEBUG oslo_concurrency.lockutils [None req-b9ee657d-4486-4f0d-a46d-4a4647b8da69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86263) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:26:11 devstack cinder-volume[86263]: DEBUG cinder.volume.drivers.quobyte [None req-b9ee657d-4486-4f0d-a46d-4a4647b8da69 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86263) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:26:11 devstack cinder-volume[86263]: DEBUG cinder.volume.drivers.quobyte [None req-b9ee657d-4486-4f0d-a46d-4a4647b8da69 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86263) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:26:11 devstack cinder-volume[86263]: DEBUG oslo_concurrency.lockutils [None req-b9ee657d-4486-4f0d-a46d-4a4647b8da69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86263) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:26:11 devstack cinder-volume[86263]: DEBUG oslo_concurrency.processutils [None req-b9ee657d-4486-4f0d-a46d-4a4647b8da69 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:26:11 devstack sudo[86399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:26:11 devstack sudo[86399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:26:11 devstack sudo[86399]: pam_unix(sudo:session): session closed for user root Nov 03 07:26:11 devstack cinder-volume[86263]: DEBUG oslo_concurrency.processutils [None req-b9ee657d-4486-4f0d-a46d-4a4647b8da69 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.348s {{(pid=86263) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:26:11 devstack cinder-volume[86263]: INFO cinder.volume.manager [None req-b9ee657d-4486-4f0d-a46d-4a4647b8da69 None None] Driver post RPC initialization completed successfully. Nov 03 07:26:15 devstack cinder-volume[86004]: INFO oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] Caught SIGTERM, stopping children Nov 03 07:26:15 devstack cinder-volume[86004]: DEBUG oslo_concurrency.lockutils [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] Acquiring lock "singleton_lock" {{(pid=86004) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 07:26:15 devstack cinder-volume[86004]: DEBUG oslo_concurrency.lockutils [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] Acquired lock "singleton_lock" {{(pid=86004) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 07:26:15 devstack cinder-volume[86004]: DEBUG oslo_concurrency.lockutils [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] Releasing lock "singleton_lock" {{(pid=86004) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 07:26:15 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] Stop services. {{(pid=86004) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 03 07:26:15 devstack cinder-volume[86004]: DEBUG oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] Killing children. {{(pid=86004) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 03 07:26:15 devstack cinder-volume[86004]: INFO oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] Waiting on 1 children to exit Nov 03 07:26:19 devstack cinder-volume[86263]: DEBUG oslo_concurrency.lockutils [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] Acquiring lock "singleton_lock" {{(pid=86263) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 07:26:19 devstack cinder-volume[86263]: DEBUG oslo_concurrency.lockutils [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] Acquired lock "singleton_lock" {{(pid=86263) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 07:26:19 devstack cinder-volume[86263]: DEBUG oslo_concurrency.lockutils [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] Releasing lock "singleton_lock" {{(pid=86263) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 07:26:19 devstack cinder-volume[86263]: WARNING amqp [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 03 07:26:19 devstack cinder-volume[86263]: WARNING amqp [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 03 07:26:19 devstack cinder-volume[86004]: INFO oslo_service.backend._eventlet.service [None req-07d0801d-8bae-4b4d-8474-c82d5b8c26fb None None] Child 86263 exited with status 0 Nov 03 07:26:19 devstack cinder-volume[86582]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 03 07:26:19 devstack cinder-volume[86582]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 03 07:26:19 devstack cinder-volume[86582]: we strongly recommend against using it for new projects. Nov 03 07:26:19 devstack cinder-volume[86582]: If you are already using Eventlet, we recommend migrating to a different Nov 03 07:26:19 devstack cinder-volume[86582]: framework. For more detail see Nov 03 07:26:19 devstack cinder-volume[86582]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 03 07:26:19 devstack cinder-volume[86582]: import eventlet # noqa Nov 03 07:26:22 devstack cinder-volume[86582]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86582) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 07:26:22 devstack cinder-volume[86582]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86582) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 07:26:22 devstack cinder-volume[86582]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86582) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 07:26:23 devstack cinder-volume[86582]: INFO dbcounter [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] Registered counter for database cinder Nov 03 07:26:23 devstack cinder-volume[86582]: DEBUG oslo_db.sqlalchemy.engines [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86582) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 07:26:23 devstack cinder-volume[86582]: DEBUG dbcounter [-] [86582] Writer thread running {{(pid=86582) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 07:26:23 devstack cinder-volume[86582]: INFO cinder.rpc [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 03 07:26:23 devstack cinder-volume[86582]: INFO cinder.rpc [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 03 07:26:23 devstack cinder-volume[86582]: DEBUG oslo_db.sqlalchemy.engines [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86582) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 07:26:24 devstack cinder-volume[86582]: INFO cinder.volume.manager [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] Determined volume DB was empty at startup. Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG cinder.volume.manager [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86582) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 03 07:26:24 devstack cinder-volume[86582]: WARNING stevedore.named [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 03 07:26:24 devstack cinder-volume[86582]: WARNING castellan.key_manager [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 07:26:24 devstack cinder-volume[86582]: WARNING cinder.keymgr.conf_key_mgr [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 07:26:24 devstack cinder-volume[86582]: INFO cinder.volume.manager [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_db.sqlalchemy.engines [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86582) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 07:26:24 devstack cinder-volume[86582]: INFO oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] Starting 1 workers Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] Started child 86875 {{(pid=86582) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] Full set of CONF: {{(pid=86582) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] ******************************************************************************** {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] Configuration options gathered from: {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 03 07:26:24 devstack cinder-volume[86875]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] ================================================================================ {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] allow_availability_zone_fallback = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] allow_compression_on_image_upload = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] allowed_direct_url_schemes = [] {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] api_rate_limit = True {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] auth_strategy = keystone {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_availability_zone = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_host = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_name = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_stats_polling_interval = 60 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backup_api_class = cinder.backup.api.API {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backup_name_template = backup-%s {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backup_use_same_host = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backup_use_temp_snapshot = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] chap_password = **** {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] chap_username = {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] cinder_internal_tenant_project_id = 55d20126cd5b49fa82036b2c336399dc {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] cinder_internal_tenant_user_id = 5d7487e56ad44ff8922c8d768920698d {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] cluster = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] compression_format = gzip {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] compute_api_class = cinder.compute.nova.API {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] config_dir = [] {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] config_source = [] {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] control_exchange = openstack {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] debug = True {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] default_availability_zone = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] default_group_type = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] default_volume_type = QuobyteHD {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] disk_geometry = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] driver_client_cert = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] driver_client_cert_key = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] driver_data_namespace = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] driver_ssl_cert_path = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] driver_ssl_cert_verify = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] driver_use_ssl = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] enable_new_services = True {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] enable_unsupported_driver = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] enabled_backends = ['QuobyteHD'] {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] enforce_multipath_for_image_xfer = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] filter_function = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] glance_api_insecure = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] glance_api_servers = ['http://192.168.122.249/image'] {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] glance_api_ssl_compression = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] glance_ca_certificates_file = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] glance_catalog_info = image:glance:publicURL {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] glance_certfile = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] glance_keyfile = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] glance_num_retries = 3 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] glance_request_timeout = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] goodness_function = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] graceful_shutdown_timeout = 5 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] group_api_class = cinder.group.api.API {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] host = devstack {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] image_compress_on_upload = True {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] image_conversion_address_space_limit = 1 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] image_conversion_cpu_limit = 60 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] image_conversion_disable = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] image_introspection_address_space_limit = 1 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] image_introspection_cpu_limit = 60 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] image_upload_use_cinder_backend = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] image_upload_use_internal_tenant = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] image_volume_cache_enabled = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] image_volume_cache_max_count = 0 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] image_volume_cache_max_size_gb = 0 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] init_host_max_objects_retrieval = 0 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-617e876c-12e4-4b2c-95fb-59b65038eb3f None None] Starting volume driver QuobyteDriver (1.2.1) Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] instance_format = [instance: %(uuid)s] {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-617e876c-12e4-4b2c-95fb-59b65038eb3f None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86875) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] iscsi_target_flags = {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] iscsi_write_cache = on {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] iser_helper = tgtadm {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] iser_ip_address = 192.168.122.249 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] iser_port = 3260 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] log_color = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] log_config_append = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] log_dir = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] log_file = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] log_options = True {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] log_rotate_interval = 1 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] log_rotate_interval_type = days {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] log_rotation_type = none {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] max_age = 0 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] max_logfile_count = 30 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] max_logfile_size_mb = 200 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] max_over_subscription_ratio = 20.0 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] message_reap_interval = 86400 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] message_ttl = 2592000 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] migration_create_volume_timeout_secs = 300 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] monkey_patch = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] monkey_patch_modules = [] {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] my_ip = 192.168.122.249 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] no_snapshot_gb_quota = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] num_iser_scan_tries = 3 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] num_shell_tries = 3 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] num_volume_device_scan_tries = 3 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] nvmeof_conn_info_version = 1 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] nvmet_ns_id = 10 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] nvmet_port_id = 1 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] osapi_max_limit = 1000 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] osapi_volume_ext_list = [] {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] osapi_volume_listen_port = 8776 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] osapi_volume_use_ssl = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] osapi_volume_workers = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] per_volume_size_limit = -1 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] periodic_fuzzy_delay = 60 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] periodic_interval = 60 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] public_endpoint = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] publish_errors = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] quota_backup_gigabytes = 1000 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] quota_backups = 10 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] quota_gigabytes = 1000 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] quota_groups = 10 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] quota_snapshots = 10 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] quota_volumes = 10 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] rate_limit_burst = 0 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] rate_limit_except_level = CRITICAL {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] rate_limit_interval = 0 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] reinit_driver_count = 3 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] replication_device = **** {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] report_discard_supported = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] report_interval = 120 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] reservation_clean_interval = 86400 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] reservation_expire = 86400 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] reserved_image_namespaces = [] {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] reserved_percentage = 0 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] rpc_response_timeout = 120 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] run_external_periodic_tasks = True {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] scst_target_driver = iscsi {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] scst_target_iqn_name = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] service_down_time = 720 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] shell_completion = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] snapshot_name_template = snapshot-%s {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] split_loggers = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] state_path = /opt/stack/data/cinder {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] storage_availability_zone = nova {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] storage_protocol = iSCSI {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] syslog_log_facility = LOG_USER {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] target_helper = lioadm {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] target_ip_address = 192.168.122.249 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] target_port = 3260 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] target_protocol = iscsi {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] target_secondary_ip_addresses = [] {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] trace_flags = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] transport_url = **** {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] until_refresh = 0 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] use_chap_auth = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] use_default_quota_class = True {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] use_journal = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] use_json = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] use_multipath_for_image_xfer = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] use_stderr = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] use_syslog = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] verify_glance_signatures = enabled {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] volume_api_class = cinder.volume.api.API {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] volume_backend_name = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] volume_clear = zero {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] volume_clear_ionice = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] volume_clear_size = 0 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] volume_copy_bps_limit = 0 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] volume_dd_blocksize = 1M {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] volume_name_template = volume-%s {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] volume_service_inithost_offload = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] volume_usage_audit_period = month {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-617e876c-12e4-4b2c-95fb-59b65038eb3f None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86875) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.quobyte [None req-617e876c-12e4-4b2c-95fb-59b65038eb3f None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 03 07:26:24 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.quobyte [None req-617e876c-12e4-4b2c-95fb-59b65038eb3f None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] zoning_mode = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_concurrency.disable_process_locking = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-617e876c-12e4-4b2c-95fb-59b65038eb3f None None] Running cmd (subprocess): mount.quobyte {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] keystone_authtoken.auth_section = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] keystone_authtoken.auth_type = password {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] keystone_authtoken.auth_version = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] keystone_authtoken.cache = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] keystone_authtoken.certfile = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] keystone_authtoken.include_service_catalog = True {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] keystone_authtoken.insecure = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] keystone_authtoken.interface = public {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] keystone_authtoken.keyfile = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] keystone_authtoken.memcache_password = **** {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] keystone_authtoken.memcache_username = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] keystone_authtoken.region_name = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] keystone_authtoken.service_type = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.249/identity {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] cache.backend = dogpile.cache.null {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] cache.backend_argument = **** {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] cache.backend_expiration_time = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] cache.config_prefix = cache.oslo {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] cache.debug_cache_backend = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] cache.enable_retry_client = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] cache.enable_socket_keepalive = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] cache.enabled = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] cache.expiration_time = 600 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] cache.hashclient_retry_attempts = 2 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] cache.memcache_dead_retry = 300 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] cache.memcache_pool_maxsize = 10 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] cache.memcache_sasl_enabled = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] cache.password = **** {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] cache.proxies = [] {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] cache.redis_db = 0 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] cache.redis_server = localhost:6379 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] cache.retry_attempts = 2 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] cache.retry_delay = 0.0 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] cache.socket_keepalive_count = 1 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] cache.socket_keepalive_idle = 1 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] cache.socket_keepalive_interval = 1 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] cache.socket_timeout = 1.0 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] cache.tls_allowed_ciphers = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] cache.tls_cafile = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] cache.tls_certfile = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] cache.tls_enabled = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] cache.tls_keyfile = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] cache.username = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] coordination.backend_url = **** {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] database.asyncio_connection = **** {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] database.asyncio_slave_connection = **** {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] database.backend = sqlalchemy {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] database.connection = **** {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] database.connection_debug = 0 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] database.connection_parameters = {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] database.connection_recycle_time = 3600 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] database.connection_trace = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] database.db_inc_retry_interval = True {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] database.db_max_retries = 20 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] database.db_max_retry_interval = 10 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] database.db_retry_interval = 1 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] database.max_overflow = 50 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] database.max_pool_size = 5 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] database.max_retries = 10 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] database.mysql_wsrep_sync_wait = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] database.pool_timeout = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] database.retry_interval = 10 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] database.slave_connection = **** {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] database.sqlite_synchronous = True {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] database.synchronous_reader = True {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] database.use_db_reconnect = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_messaging_tracing.insecure = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] profiler.connection_string = messaging:// {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] profiler.enabled = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] profiler.es_doc_type = notification {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack quobyte-client[86884]: Reading configuration file: /etc/quobyte/client.cfg Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] profiler.es_scroll_size = 10000 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] profiler.es_scroll_time = 2m {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] profiler.filter_error_trace = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] profiler.hmac_keys = **** {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] profiler.sentinel_service_name = mymaster {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] profiler.socket_timeout = 0.1 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] profiler.trace_requests = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack quobyte-client[86884]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] profiler.trace_sqlalchemy = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] profiler_jaeger.process_tags = {} {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] profiler_jaeger.service_name_prefix = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] profiler_otlp.service_name_prefix = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_policy.enforce_new_defaults = True {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_policy.policy_default_rule = default {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-617e876c-12e4-4b2c-95fb-59b65038eb3f None None] CMD "mount.quobyte" returned: 1 in 0.062s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_policy.policy_file = policy.yaml {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-617e876c-12e4-4b2c-95fb-59b65038eb3f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-617e876c-12e4-4b2c-95fb-59b65038eb3f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-617e876c-12e4-4b2c-95fb-59b65038eb3f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] privsep_osbrick.group = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] privsep_osbrick.helper_command = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] privsep_osbrick.user = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] cinder_sys_admin.group = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] cinder_sys_admin.helper_command = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] cinder_sys_admin.user = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] service_user.auth_section = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] service_user.auth_type = password {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] service_user.cafile = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] service_user.certfile = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] service_user.collect_timing = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] service_user.insecure = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] service_user.keyfile = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] service_user.send_service_user_token = True {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] service_user.split_loggers = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-617e876c-12e4-4b2c-95fb-59b65038eb3f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] service_user.timeout = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-617e876c-12e4-4b2c-95fb-59b65038eb3f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] service_user.tls_ciphers = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] service_user.tls_min_version = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] glance.auth_section = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] glance.auth_type = password {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] glance.certfile = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] glance.collect_timing = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] glance.insecure = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] glance.keyfile = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] glance.region_name = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] glance.split_loggers = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-617e876c-12e4-4b2c-95fb-59b65038eb3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] glance.timeout = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] glance.tls_ciphers = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] glance.tls_min_version = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.backend_availability_zone = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.chap_password = **** {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.chap_username = {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.disk_geometry = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.driver_client_cert = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.driver_client_cert_key = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.driver_data_namespace = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.driver_use_ssl = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.extra_capabilities = {} {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.filter_function = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.goodness_function = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.iscsi_target_flags = {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.iscsi_write_cache = on {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.iser_helper = tgtadm {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.iser_ip_address = 192.168.122.249 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.iser_port = 3260 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.nas_host = {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.nas_login = admin {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.nas_mount_options = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.nas_password = **** {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.nas_private_key = {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.nas_share_path = {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.num_shell_tries = 3 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.quobyte_volume_url = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.replication_device = **** {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.report_discard_supported = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.reserved_percentage = 0 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.target_helper = tgtadm {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.target_ip_address = 192.168.122.249 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.target_port = 3260 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.target_protocol = iscsi {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.trace_flags = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.unique_fqdn_network = True {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.use_chap_auth = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.volume_backend_name = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.volume_clear = zero {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.volume_clear_ionice = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.volume_clear_size = 0 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack sudo[86885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack sudo[86885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_reports.file_event_handler = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_reports.log_dir = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.backend_availability_zone = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.backend_host = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.chap_password = **** {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.chap_username = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.chiscsi_conf = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.disk_geometry = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.driver_client_cert = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.driver_data_namespace = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.driver_use_ssl = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.extra_capabilities = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.filter_function = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.goodness_function = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.iser_helper = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.iser_ip_address = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.iser_port = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.iser_target_prefix = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.nas_host = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.nas_login = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.nas_mount_options = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.nas_password = **** {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.nas_private_key = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.nas_share_path = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.nas_ssh_port = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.num_shell_tries = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.nvmet_port_id = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.replication_device = **** {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.report_discard_supported = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.reserved_percentage = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.scst_target_driver = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.storage_protocol = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.target_helper = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.target_ip_address = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.target_port = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.target_prefix = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.target_protocol = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.trace_flags = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.use_chap_auth = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.volume_clear = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.volume_clear_size = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] QuobyteHD.volumes_dir = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_messaging_rabbit.ssl = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_messaging_notifications.driver = [] {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_messaging_notifications.retry = -1 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] key_manager.fixed_key = **** {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] barbican.barbican_api_version = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] barbican.barbican_endpoint = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] barbican.barbican_endpoint_type = public {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] barbican.barbican_region_name = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] barbican.cafile = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] barbican.certfile = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] barbican.collect_timing = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] barbican.insecure = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] barbican.keyfile = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] barbican.number_of_retries = 60 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] barbican.retry_delay = 1 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] barbican.send_service_user_token = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] barbican.split_loggers = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] barbican.timeout = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] barbican.tls_ciphers = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] barbican.tls_min_version = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] barbican.verify_ssl = True {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] barbican.verify_ssl_path = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] barbican_service_user.auth_section = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] barbican_service_user.auth_type = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] barbican_service_user.cafile = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] barbican_service_user.certfile = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] barbican_service_user.collect_timing = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] barbican_service_user.insecure = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] barbican_service_user.keyfile = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] barbican_service_user.split_loggers = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] barbican_service_user.timeout = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] barbican_service_user.tls_ciphers = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] barbican_service_user.tls_min_version = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] vault.approle_role_id = **** {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] vault.approle_secret_id = **** {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] vault.auth_method = approle {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] vault.auth_path = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] vault.kv_mountpoint = secret {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] vault.kv_path = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] vault.kv_version = 2 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] vault.namespace = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] vault.root_token_id = **** {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] vault.ssl_ca_crt_file = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] vault.timeout = 60.0 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] vault.token_file = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] vault.token_role = None {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] vault.use_ssl = False {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 07:26:24 devstack cinder-volume[86582]: DEBUG oslo_service.backend._eventlet.service [None req-e7e6270a-fcf3-4f34-a401-ef57ca21ea39 None None] ******************************************************************************** {{(pid=86582) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 03 07:26:24 devstack sudo[86885]: pam_unix(sudo:session): session closed for user root Nov 03 07:26:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-617e876c-12e4-4b2c-95fb-59b65038eb3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.291s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:26:24 devstack cinder-volume[86875]: INFO cinder.volume.driver [None req-617e876c-12e4-4b2c-95fb-59b65038eb3f None None] Driver hasn't implemented _init_vendor_properties() Nov 03 07:26:24 devstack cinder-volume[86875]: DEBUG cinder.volume.driver [None req-617e876c-12e4-4b2c-95fb-59b65038eb3f None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6651611328125, 'free_capacity_gb': 1773.6651611328125, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86875) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 03 07:26:24 devstack cinder-volume[86875]: DEBUG oslo_db.sqlalchemy.engines [None req-617e876c-12e4-4b2c-95fb-59b65038eb3f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86875) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 07:26:24 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writer thread running {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 07:26:24 devstack cinder-volume[86875]: DEBUG cinder.db.api [None req-617e876c-12e4-4b2c-95fb-59b65038eb3f None None] Building query based on filter {{(pid=86875) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}} Nov 03 07:26:24 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-617e876c-12e4-4b2c-95fb-59b65038eb3f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86875) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 03 07:26:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-617e876c-12e4-4b2c-95fb-59b65038eb3f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:26:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-617e876c-12e4-4b2c-95fb-59b65038eb3f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:26:24 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-617e876c-12e4-4b2c-95fb-59b65038eb3f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:26:24 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-617e876c-12e4-4b2c-95fb-59b65038eb3f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:26:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-617e876c-12e4-4b2c-95fb-59b65038eb3f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:26:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-617e876c-12e4-4b2c-95fb-59b65038eb3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:26:24 devstack cinder-volume[86875]: INFO cinder.keymgr.migration [None req-fdfa8888-084a-42b1-9064-903438b4375b None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 03 07:26:24 devstack sudo[86896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:26:24 devstack sudo[86896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:26:25 devstack sudo[86896]: pam_unix(sudo:session): session closed for user root Nov 03 07:26:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-617e876c-12e4-4b2c-95fb-59b65038eb3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.263s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:26:25 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-617e876c-12e4-4b2c-95fb-59b65038eb3f None None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:26:25 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-617e876c-12e4-4b2c-95fb-59b65038eb3f None None] Driver initialization completed successfully. Nov 03 07:26:25 devstack cinder-volume[86875]: INFO cinder.manager [None req-617e876c-12e4-4b2c-95fb-59b65038eb3f None None] Initiating service 3 cleanup Nov 03 07:26:25 devstack cinder-volume[86875]: INFO cinder.manager [None req-617e876c-12e4-4b2c-95fb-59b65038eb3f None None] Service 3 cleanup completed. Nov 03 07:26:25 devstack cinder-volume[86875]: DEBUG cinder.service [None req-617e876c-12e4-4b2c-95fb-59b65038eb3f None None] Creating RPC server for service cinder-volume {{(pid=86875) start /opt/stack/cinder/cinder/service.py:231}} Nov 03 07:26:25 devstack cinder-volume[86875]: DEBUG cinder.service [None req-617e876c-12e4-4b2c-95fb-59b65038eb3f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86875) start /opt/stack/cinder/cinder/service.py:237}} Nov 03 07:26:25 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-617e876c-12e4-4b2c-95fb-59b65038eb3f None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 03 07:26:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-617e876c-12e4-4b2c-95fb-59b65038eb3f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:26:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-617e876c-12e4-4b2c-95fb-59b65038eb3f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:26:25 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-617e876c-12e4-4b2c-95fb-59b65038eb3f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:26:25 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-617e876c-12e4-4b2c-95fb-59b65038eb3f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:26:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-617e876c-12e4-4b2c-95fb-59b65038eb3f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:26:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-617e876c-12e4-4b2c-95fb-59b65038eb3f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:26:25 devstack sudo[86907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:26:25 devstack sudo[86907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:26:25 devstack sudo[86907]: pam_unix(sudo:session): session closed for user root Nov 03 07:26:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-617e876c-12e4-4b2c-95fb-59b65038eb3f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.258s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:26:25 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-617e876c-12e4-4b2c-95fb-59b65038eb3f None None] Driver post RPC initialization completed successfully. Nov 03 07:26:34 devstack cinder-volume[86582]: DEBUG dbcounter [-] [86582] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86582) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:26:35 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:SELECT=2 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:26:35 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:27:03 devstack cinder-volume[86875]: DEBUG oslo_service.periodic_task [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running periodic task VolumeManager._thread_info {{(pid=86875) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:27:03 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] thread count: 6 {{(pid=86875) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:27:03 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] thread info: [<_MainThread(MainThread, started 125626325639296)>, , , , , ] {{(pid=86875) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:27:29 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-793bab16-1f5f-4d2f-8085-7db38eda61b1 tempest-TaggedAttachmentsTest-702494535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:27:29 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-793bab16-1f5f-4d2f-8085-7db38eda61b1 tempest-TaggedAttachmentsTest-702494535 None] Flow 'volume_create_manager' (2fc91005-47c3-41eb-ab77-ca80a2731688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:27:29 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-793bab16-1f5f-4d2f-8085-7db38eda61b1 tempest-TaggedAttachmentsTest-702494535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85e27082-cb46-4ad1-90e1-a2e26789f1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:27:30 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-793bab16-1f5f-4d2f-8085-7db38eda61b1 tempest-TaggedAttachmentsTest-702494535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85e27082-cb46-4ad1-90e1-a2e26789f1c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-268818650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5c171fc-2601-4fff-bfe5-dd82f67399b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0b70c1363bf4f68891a5ccba24cc330',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:27:30Z,use_quota=True,user_id='752a8524367e4d3d83df4dc58a394a16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:27:30 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-793bab16-1f5f-4d2f-8085-7db38eda61b1 tempest-TaggedAttachmentsTest-702494535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30d674a8-6f8d-4a76-a0fa-3a29f52ddcfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:27:30 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-793bab16-1f5f-4d2f-8085-7db38eda61b1 tempest-TaggedAttachmentsTest-702494535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30d674a8-6f8d-4a76-a0fa-3a29f52ddcfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:27:30 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-793bab16-1f5f-4d2f-8085-7db38eda61b1 tempest-TaggedAttachmentsTest-702494535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ad02932-d0ef-46d0-aa52-cac85a32f0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:27:30 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-793bab16-1f5f-4d2f-8085-7db38eda61b1 tempest-TaggedAttachmentsTest-702494535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ad02932-d0ef-46d0-aa52-cac85a32f0c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5c171fc-2601-4fff-bfe5-dd82f67399b7', 'volume_name': 'volume-c5c171fc-2601-4fff-bfe5-dd82f67399b7', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:27:30 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-793bab16-1f5f-4d2f-8085-7db38eda61b1 tempest-TaggedAttachmentsTest-702494535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7e75a8d-9a57-4f4e-9fa4-80518e05f4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:27:30 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-793bab16-1f5f-4d2f-8085-7db38eda61b1 tempest-TaggedAttachmentsTest-702494535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7e75a8d-9a57-4f4e-9fa4-80518e05f4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:27:30 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-793bab16-1f5f-4d2f-8085-7db38eda61b1 tempest-TaggedAttachmentsTest-702494535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fd5e174-455d-4e54-871e-73a108ccbcc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:27:30 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-793bab16-1f5f-4d2f-8085-7db38eda61b1 tempest-TaggedAttachmentsTest-702494535 None] Volume c5c171fc-2601-4fff-bfe5-dd82f67399b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5c171fc-2601-4fff-bfe5-dd82f67399b7', 'volume_size': 1} Nov 03 07:27:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-793bab16-1f5f-4d2f-8085-7db38eda61b1 tempest-TaggedAttachmentsTest-702494535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:27:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-793bab16-1f5f-4d2f-8085-7db38eda61b1 tempest-TaggedAttachmentsTest-702494535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:27:30 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-793bab16-1f5f-4d2f-8085-7db38eda61b1 tempest-TaggedAttachmentsTest-702494535 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-268818650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5c171fc-2601-4fff-bfe5-dd82f67399b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0b70c1363bf4f68891a5ccba24cc330',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:27:30Z,use_quota=True,user_id='752a8524367e4d3d83df4dc58a394a16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:27:30 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-793bab16-1f5f-4d2f-8085-7db38eda61b1 tempest-TaggedAttachmentsTest-702494535 None] Creating volume c5c171fc-2601-4fff-bfe5-dd82f67399b7 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:27:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-793bab16-1f5f-4d2f-8085-7db38eda61b1 tempest-TaggedAttachmentsTest-702494535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:27:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-793bab16-1f5f-4d2f-8085-7db38eda61b1 tempest-TaggedAttachmentsTest-702494535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:27:30 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-793bab16-1f5f-4d2f-8085-7db38eda61b1 tempest-TaggedAttachmentsTest-702494535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:27:30 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-793bab16-1f5f-4d2f-8085-7db38eda61b1 tempest-TaggedAttachmentsTest-702494535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:27:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-793bab16-1f5f-4d2f-8085-7db38eda61b1 tempest-TaggedAttachmentsTest-702494535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:27:30 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-793bab16-1f5f-4d2f-8085-7db38eda61b1 tempest-TaggedAttachmentsTest-702494535 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:27:30 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-793bab16-1f5f-4d2f-8085-7db38eda61b1 tempest-TaggedAttachmentsTest-702494535 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:27:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-793bab16-1f5f-4d2f-8085-7db38eda61b1 tempest-TaggedAttachmentsTest-702494535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c5c171fc-2601-4fff-bfe5-dd82f67399b7 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:27:30 devstack sudo[87228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c5c171fc-2601-4fff-bfe5-dd82f67399b7 1073741824 Nov 03 07:27:30 devstack sudo[87228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:27:30 devstack sudo[87228]: pam_unix(sudo:session): session closed for user root Nov 03 07:27:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-793bab16-1f5f-4d2f-8085-7db38eda61b1 tempest-TaggedAttachmentsTest-702494535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c5c171fc-2601-4fff-bfe5-dd82f67399b7 1073741824" returned: 0 in 0.772s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:27:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-793bab16-1f5f-4d2f-8085-7db38eda61b1 tempest-TaggedAttachmentsTest-702494535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c5c171fc-2601-4fff-bfe5-dd82f67399b7 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:27:31 devstack sudo[87555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c5c171fc-2601-4fff-bfe5-dd82f67399b7 Nov 03 07:27:31 devstack sudo[87555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:27:31 devstack sudo[87555]: pam_unix(sudo:session): session closed for user root Nov 03 07:27:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-793bab16-1f5f-4d2f-8085-7db38eda61b1 tempest-TaggedAttachmentsTest-702494535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c5c171fc-2601-4fff-bfe5-dd82f67399b7" returned: 0 in 0.322s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:27:31 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-793bab16-1f5f-4d2f-8085-7db38eda61b1 tempest-TaggedAttachmentsTest-702494535 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:27:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-793bab16-1f5f-4d2f-8085-7db38eda61b1 tempest-TaggedAttachmentsTest-702494535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:27:31 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-793bab16-1f5f-4d2f-8085-7db38eda61b1 tempest-TaggedAttachmentsTest-702494535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fd5e174-455d-4e54-871e-73a108ccbcc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5c171fc-2601-4fff-bfe5-dd82f67399b7', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:27:31 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-793bab16-1f5f-4d2f-8085-7db38eda61b1 tempest-TaggedAttachmentsTest-702494535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb402d07-3676-4cba-b9dd-ef06e05705b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:27:31 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-793bab16-1f5f-4d2f-8085-7db38eda61b1 tempest-TaggedAttachmentsTest-702494535 None] Volume volume-c5c171fc-2601-4fff-bfe5-dd82f67399b7 (c5c171fc-2601-4fff-bfe5-dd82f67399b7): created successfully Nov 03 07:27:31 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-793bab16-1f5f-4d2f-8085-7db38eda61b1 tempest-TaggedAttachmentsTest-702494535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb402d07-3676-4cba-b9dd-ef06e05705b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:27:31 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-793bab16-1f5f-4d2f-8085-7db38eda61b1 tempest-TaggedAttachmentsTest-702494535 None] Flow 'volume_create_manager' (2fc91005-47c3-41eb-ab77-ca80a2731688) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:27:31 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-793bab16-1f5f-4d2f-8085-7db38eda61b1 tempest-TaggedAttachmentsTest-702494535 None] Created volume successfully. Nov 03 07:27:41 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:27:41 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:27:55 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-61e83c50-e671-4339-9b94-31a2d7cb5412 tempest-DeleteServersTestJSON-1620434557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:27:55 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-61e83c50-e671-4339-9b94-31a2d7cb5412 tempest-DeleteServersTestJSON-1620434557 None] Flow 'volume_create_manager' (aa64a77a-b16d-4004-b081-5c210b6c649b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:27:55 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-61e83c50-e671-4339-9b94-31a2d7cb5412 tempest-DeleteServersTestJSON-1620434557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42e8b23d-71e3-4f30-b7aa-ea3aeb55f5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:27:55 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-61e83c50-e671-4339-9b94-31a2d7cb5412 tempest-DeleteServersTestJSON-1620434557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42e8b23d-71e3-4f30-b7aa-ea3aeb55f5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:27:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2068351964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b41a849b-7bd2-4480-a577-636eab6d158d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7be89b77f54d4bf79a75616c8da3b1b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:27:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:27:55Z,use_quota=True,user_id='6b34d17f6362487ea79e41af9ebb6a3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:27:55 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-61e83c50-e671-4339-9b94-31a2d7cb5412 tempest-DeleteServersTestJSON-1620434557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce274a4e-0dd9-4895-8854-69b1bd25589a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:27:55 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-61e83c50-e671-4339-9b94-31a2d7cb5412 tempest-DeleteServersTestJSON-1620434557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce274a4e-0dd9-4895-8854-69b1bd25589a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:27:55 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-61e83c50-e671-4339-9b94-31a2d7cb5412 tempest-DeleteServersTestJSON-1620434557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09f16d0d-e5b4-4686-9e27-0038475f9eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:27:55 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-61e83c50-e671-4339-9b94-31a2d7cb5412 tempest-DeleteServersTestJSON-1620434557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09f16d0d-e5b4-4686-9e27-0038475f9eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b41a849b-7bd2-4480-a577-636eab6d158d', 'volume_name': 'volume-b41a849b-7bd2-4480-a577-636eab6d158d', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:27:55 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-61e83c50-e671-4339-9b94-31a2d7cb5412 tempest-DeleteServersTestJSON-1620434557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddf8a9ee-231e-4d75-9f95-0e6fc4b2ac6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:27:55 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-61e83c50-e671-4339-9b94-31a2d7cb5412 tempest-DeleteServersTestJSON-1620434557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddf8a9ee-231e-4d75-9f95-0e6fc4b2ac6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:27:55 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-61e83c50-e671-4339-9b94-31a2d7cb5412 tempest-DeleteServersTestJSON-1620434557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07028874-0cde-4e02-9441-1f6eca30a1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:27:55 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-61e83c50-e671-4339-9b94-31a2d7cb5412 tempest-DeleteServersTestJSON-1620434557 None] Volume b41a849b-7bd2-4480-a577-636eab6d158d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b41a849b-7bd2-4480-a577-636eab6d158d', 'volume_size': 1} Nov 03 07:27:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-61e83c50-e671-4339-9b94-31a2d7cb5412 tempest-DeleteServersTestJSON-1620434557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:27:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-61e83c50-e671-4339-9b94-31a2d7cb5412 tempest-DeleteServersTestJSON-1620434557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:27:55 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-61e83c50-e671-4339-9b94-31a2d7cb5412 tempest-DeleteServersTestJSON-1620434557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:27:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2068351964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b41a849b-7bd2-4480-a577-636eab6d158d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7be89b77f54d4bf79a75616c8da3b1b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:27:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:27:55Z,use_quota=True,user_id='6b34d17f6362487ea79e41af9ebb6a3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:27:55 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-61e83c50-e671-4339-9b94-31a2d7cb5412 tempest-DeleteServersTestJSON-1620434557 None] Creating volume b41a849b-7bd2-4480-a577-636eab6d158d {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:27:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-61e83c50-e671-4339-9b94-31a2d7cb5412 tempest-DeleteServersTestJSON-1620434557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:27:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-61e83c50-e671-4339-9b94-31a2d7cb5412 tempest-DeleteServersTestJSON-1620434557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:27:55 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-61e83c50-e671-4339-9b94-31a2d7cb5412 tempest-DeleteServersTestJSON-1620434557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:27:55 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-61e83c50-e671-4339-9b94-31a2d7cb5412 tempest-DeleteServersTestJSON-1620434557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:27:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-61e83c50-e671-4339-9b94-31a2d7cb5412 tempest-DeleteServersTestJSON-1620434557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:27:55 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-61e83c50-e671-4339-9b94-31a2d7cb5412 tempest-DeleteServersTestJSON-1620434557 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:27:55 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-61e83c50-e671-4339-9b94-31a2d7cb5412 tempest-DeleteServersTestJSON-1620434557 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:27:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-61e83c50-e671-4339-9b94-31a2d7cb5412 tempest-DeleteServersTestJSON-1620434557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b41a849b-7bd2-4480-a577-636eab6d158d 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:27:55 devstack sudo[87808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b41a849b-7bd2-4480-a577-636eab6d158d 1073741824 Nov 03 07:27:55 devstack sudo[87808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:27:56 devstack sudo[87808]: pam_unix(sudo:session): session closed for user root Nov 03 07:27:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-61e83c50-e671-4339-9b94-31a2d7cb5412 tempest-DeleteServersTestJSON-1620434557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b41a849b-7bd2-4480-a577-636eab6d158d 1073741824" returned: 0 in 0.870s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:27:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-61e83c50-e671-4339-9b94-31a2d7cb5412 tempest-DeleteServersTestJSON-1620434557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b41a849b-7bd2-4480-a577-636eab6d158d {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:27:56 devstack sudo[87841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b41a849b-7bd2-4480-a577-636eab6d158d Nov 03 07:27:56 devstack sudo[87841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:27:56 devstack sudo[87841]: pam_unix(sudo:session): session closed for user root Nov 03 07:27:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-61e83c50-e671-4339-9b94-31a2d7cb5412 tempest-DeleteServersTestJSON-1620434557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b41a849b-7bd2-4480-a577-636eab6d158d" returned: 0 in 0.295s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:27:56 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-61e83c50-e671-4339-9b94-31a2d7cb5412 tempest-DeleteServersTestJSON-1620434557 None] <== create_volume: return (1402ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:27:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-61e83c50-e671-4339-9b94-31a2d7cb5412 tempest-DeleteServersTestJSON-1620434557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.406s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:27:57 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-61e83c50-e671-4339-9b94-31a2d7cb5412 tempest-DeleteServersTestJSON-1620434557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07028874-0cde-4e02-9441-1f6eca30a1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b41a849b-7bd2-4480-a577-636eab6d158d', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:27:57 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-61e83c50-e671-4339-9b94-31a2d7cb5412 tempest-DeleteServersTestJSON-1620434557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (798f0a30-4ff5-4766-a05c-5613907b95aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:27:58 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-61e83c50-e671-4339-9b94-31a2d7cb5412 tempest-DeleteServersTestJSON-1620434557 None] Volume volume-b41a849b-7bd2-4480-a577-636eab6d158d (b41a849b-7bd2-4480-a577-636eab6d158d): created successfully Nov 03 07:27:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-61e83c50-e671-4339-9b94-31a2d7cb5412 tempest-DeleteServersTestJSON-1620434557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (798f0a30-4ff5-4766-a05c-5613907b95aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:27:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-61e83c50-e671-4339-9b94-31a2d7cb5412 tempest-DeleteServersTestJSON-1620434557 None] Flow 'volume_create_manager' (aa64a77a-b16d-4004-b081-5c210b6c649b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:27:59 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-61e83c50-e671-4339-9b94-31a2d7cb5412 tempest-DeleteServersTestJSON-1620434557 None] Created volume successfully. Nov 03 07:28:03 devstack cinder-volume[86875]: DEBUG oslo_service.periodic_task [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86875) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:28:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:28:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:28:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:28:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:28:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:28:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:28:03 devstack sudo[87938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:28:03 devstack sudo[87938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:28:04 devstack sudo[87938]: pam_unix(sudo:session): session closed for user root Nov 03 07:28:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.971s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:28:04 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:28:04 devstack cinder-volume[86875]: DEBUG oslo_service.periodic_task [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running periodic task VolumeManager._thread_info {{(pid=86875) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:28:04 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] thread count: 6 {{(pid=86875) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:28:04 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] thread info: [<_MainThread(MainThread, started 125626325639296)>, , , , , ] {{(pid=86875) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:28:07 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:28:07 devstack cinder-volume[86875]: WARNING py.warnings [req-43573b6b-1bc2-4f7f-9af4-1f6306b9c53b req-3ed6b42d-c9e2-45cb-9093-52954048c2c6 tempest-DeleteServersTestJSON-1620434557 None] /opt/stack/cinder/cinder/db/api.py:2442: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Nov 03 07:28:07 devstack cinder-volume[86875]: .first() Nov 03 07:28:07 devstack cinder-volume[86875]: Nov 03 07:28:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-43573b6b-1bc2-4f7f-9af4-1f6306b9c53b req-3ed6b42d-c9e2-45cb-9093-52954048c2c6 tempest-DeleteServersTestJSON-1620434557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:28:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-43573b6b-1bc2-4f7f-9af4-1f6306b9c53b req-3ed6b42d-c9e2-45cb-9093-52954048c2c6 tempest-DeleteServersTestJSON-1620434557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:28:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-43573b6b-1bc2-4f7f-9af4-1f6306b9c53b req-3ed6b42d-c9e2-45cb-9093-52954048c2c6 tempest-DeleteServersTestJSON-1620434557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:28:08 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-43573b6b-1bc2-4f7f-9af4-1f6306b9c53b req-3ed6b42d-c9e2-45cb-9093-52954048c2c6 tempest-DeleteServersTestJSON-1620434557 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1', 'name': 'volume-b41a849b-7bd2-4480-a577-636eab6d158d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '44a3504a-2626-4e47-9c92-9a82bd1e6a2d', 'enforce_multipath': True} {{(pid=86875) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:28:08 devstack cinder-volume[86875]: INFO cinder.volume.manager [req-43573b6b-1bc2-4f7f-9af4-1f6306b9c53b req-3ed6b42d-c9e2-45cb-9093-52954048c2c6 tempest-DeleteServersTestJSON-1620434557 None] attachment_update completed successfully. Nov 03 07:28:10 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-a834a6f9-0b3e-453f-a6d8-069730988bbb tempest-VolumesAdminNegativeTest-396022998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:28:10 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a834a6f9-0b3e-453f-a6d8-069730988bbb tempest-VolumesAdminNegativeTest-396022998 None] Flow 'volume_create_manager' (476322d3-af63-45c5-aa6c-f0cdb6a600dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:28:10 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a834a6f9-0b3e-453f-a6d8-069730988bbb tempest-VolumesAdminNegativeTest-396022998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b95c10b5-c954-44a4-9eb8-d23b7a4adfa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:28:10 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a834a6f9-0b3e-453f-a6d8-069730988bbb tempest-VolumesAdminNegativeTest-396022998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b95c10b5-c954-44a4-9eb8-d23b7a4adfa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:28:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-340711477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9b6d61d-73a5-461e-9023-8f77edcea64b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba406c55e4314aab872703c12d17b033',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:28:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:28:10Z,use_quota=True,user_id='6a9acfdeb1664339a446516fe80acdc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:28:10 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a834a6f9-0b3e-453f-a6d8-069730988bbb tempest-VolumesAdminNegativeTest-396022998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5afd059-2791-40e8-b33e-d73c149e4e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:28:10 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a834a6f9-0b3e-453f-a6d8-069730988bbb tempest-VolumesAdminNegativeTest-396022998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5afd059-2791-40e8-b33e-d73c149e4e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:28:10 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a834a6f9-0b3e-453f-a6d8-069730988bbb tempest-VolumesAdminNegativeTest-396022998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0945193-0cdc-4dbe-80e7-4b319fe9908d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:28:10 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a834a6f9-0b3e-453f-a6d8-069730988bbb tempest-VolumesAdminNegativeTest-396022998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0945193-0cdc-4dbe-80e7-4b319fe9908d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9b6d61d-73a5-461e-9023-8f77edcea64b', 'volume_name': 'volume-d9b6d61d-73a5-461e-9023-8f77edcea64b', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:28:10 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a834a6f9-0b3e-453f-a6d8-069730988bbb tempest-VolumesAdminNegativeTest-396022998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (541c3eca-e10d-4b48-b06b-851998c77970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:28:10 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a834a6f9-0b3e-453f-a6d8-069730988bbb tempest-VolumesAdminNegativeTest-396022998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (541c3eca-e10d-4b48-b06b-851998c77970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:28:10 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a834a6f9-0b3e-453f-a6d8-069730988bbb tempest-VolumesAdminNegativeTest-396022998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0401ef24-45d2-41bb-b10a-802757cebbc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:28:10 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-a834a6f9-0b3e-453f-a6d8-069730988bbb tempest-VolumesAdminNegativeTest-396022998 None] Volume d9b6d61d-73a5-461e-9023-8f77edcea64b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9b6d61d-73a5-461e-9023-8f77edcea64b', 'volume_size': 1} Nov 03 07:28:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a834a6f9-0b3e-453f-a6d8-069730988bbb tempest-VolumesAdminNegativeTest-396022998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:28:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a834a6f9-0b3e-453f-a6d8-069730988bbb tempest-VolumesAdminNegativeTest-396022998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:28:10 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a834a6f9-0b3e-453f-a6d8-069730988bbb tempest-VolumesAdminNegativeTest-396022998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:28:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-340711477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9b6d61d-73a5-461e-9023-8f77edcea64b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba406c55e4314aab872703c12d17b033',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:28:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:28:10Z,use_quota=True,user_id='6a9acfdeb1664339a446516fe80acdc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:28:10 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-a834a6f9-0b3e-453f-a6d8-069730988bbb tempest-VolumesAdminNegativeTest-396022998 None] Creating volume d9b6d61d-73a5-461e-9023-8f77edcea64b {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:28:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a834a6f9-0b3e-453f-a6d8-069730988bbb tempest-VolumesAdminNegativeTest-396022998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:28:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a834a6f9-0b3e-453f-a6d8-069730988bbb tempest-VolumesAdminNegativeTest-396022998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:28:10 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a834a6f9-0b3e-453f-a6d8-069730988bbb tempest-VolumesAdminNegativeTest-396022998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:28:10 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a834a6f9-0b3e-453f-a6d8-069730988bbb tempest-VolumesAdminNegativeTest-396022998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:28:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a834a6f9-0b3e-453f-a6d8-069730988bbb tempest-VolumesAdminNegativeTest-396022998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:28:10 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a834a6f9-0b3e-453f-a6d8-069730988bbb tempest-VolumesAdminNegativeTest-396022998 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:28:10 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-a834a6f9-0b3e-453f-a6d8-069730988bbb tempest-VolumesAdminNegativeTest-396022998 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:28:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a834a6f9-0b3e-453f-a6d8-069730988bbb tempest-VolumesAdminNegativeTest-396022998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d9b6d61d-73a5-461e-9023-8f77edcea64b 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:28:10 devstack sudo[88498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d9b6d61d-73a5-461e-9023-8f77edcea64b 1073741824 Nov 03 07:28:10 devstack sudo[88498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:28:11 devstack sudo[88498]: pam_unix(sudo:session): session closed for user root Nov 03 07:28:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a834a6f9-0b3e-453f-a6d8-069730988bbb tempest-VolumesAdminNegativeTest-396022998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d9b6d61d-73a5-461e-9023-8f77edcea64b 1073741824" returned: 0 in 0.633s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:28:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a834a6f9-0b3e-453f-a6d8-069730988bbb tempest-VolumesAdminNegativeTest-396022998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d9b6d61d-73a5-461e-9023-8f77edcea64b {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:28:11 devstack sudo[88504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d9b6d61d-73a5-461e-9023-8f77edcea64b Nov 03 07:28:11 devstack sudo[88504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:28:12 devstack sudo[88504]: pam_unix(sudo:session): session closed for user root Nov 03 07:28:12 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a834a6f9-0b3e-453f-a6d8-069730988bbb tempest-VolumesAdminNegativeTest-396022998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d9b6d61d-73a5-461e-9023-8f77edcea64b" returned: 0 in 0.632s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:28:12 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a834a6f9-0b3e-453f-a6d8-069730988bbb tempest-VolumesAdminNegativeTest-396022998 None] <== create_volume: return (1458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:28:12 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a834a6f9-0b3e-453f-a6d8-069730988bbb tempest-VolumesAdminNegativeTest-396022998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.464s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:28:12 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a834a6f9-0b3e-453f-a6d8-069730988bbb tempest-VolumesAdminNegativeTest-396022998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0401ef24-45d2-41bb-b10a-802757cebbc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9b6d61d-73a5-461e-9023-8f77edcea64b', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:28:12 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a834a6f9-0b3e-453f-a6d8-069730988bbb tempest-VolumesAdminNegativeTest-396022998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cce18ef2-95f7-461e-a48d-53257027bfea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:28:12 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-a834a6f9-0b3e-453f-a6d8-069730988bbb tempest-VolumesAdminNegativeTest-396022998 None] Volume volume-d9b6d61d-73a5-461e-9023-8f77edcea64b (d9b6d61d-73a5-461e-9023-8f77edcea64b): created successfully Nov 03 07:28:12 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a834a6f9-0b3e-453f-a6d8-069730988bbb tempest-VolumesAdminNegativeTest-396022998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cce18ef2-95f7-461e-a48d-53257027bfea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:28:12 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a834a6f9-0b3e-453f-a6d8-069730988bbb tempest-VolumesAdminNegativeTest-396022998 None] Flow 'volume_create_manager' (476322d3-af63-45c5-aa6c-f0cdb6a600dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:28:12 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-a834a6f9-0b3e-453f-a6d8-069730988bbb tempest-VolumesAdminNegativeTest-396022998 None] Created volume successfully. Nov 03 07:28:13 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-e1c74afb-787c-465a-8496-0cd204c2e2f7 tempest-VolumesAdminNegativeTest-396022998 None] Acquiring lock "cinder-d9b6d61d-73a5-461e-9023-8f77edcea64b-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:28:14 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-e1c74afb-787c-465a-8496-0cd204c2e2f7 tempest-VolumesAdminNegativeTest-396022998 None] Lock "cinder-d9b6d61d-73a5-461e-9023-8f77edcea64b-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:28:14 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-e1c74afb-787c-465a-8496-0cd204c2e2f7 tempest-VolumesAdminNegativeTest-396022998 None] Acquiring lock "cinder-quobyte-d9b6d61d-73a5-461e-9023-8f77edcea64b" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:28:14 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-e1c74afb-787c-465a-8496-0cd204c2e2f7 tempest-VolumesAdminNegativeTest-396022998 None] Lock "cinder-quobyte-d9b6d61d-73a5-461e-9023-8f77edcea64b" acquired by "delete_volume" :: waited 0.039s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:28:14 devstack cinder-volume[86875]: INFO oslo.privsep.daemon [None req-e1c74afb-787c-465a-8496-0cd204c2e2f7 tempest-VolumesAdminNegativeTest-396022998 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp8nhpujzz/privsep.sock'] Nov 03 07:28:14 devstack sudo[88561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp8nhpujzz/privsep.sock Nov 03 07:28:14 devstack sudo[88561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:28:16 devstack cinder-volume[86875]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Nov 03 07:28:16 devstack cinder-volume[86875]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 03 07:28:16 devstack cinder-volume[86875]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Nov 03 07:28:16 devstack cinder-volume[86875]: WARNING oslo.privsep.daemon [-] privsep log: Nov 03 07:28:16 devstack cinder-volume[86875]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Nov 03 07:28:16 devstack cinder-volume[86875]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Nov 03 07:28:16 devstack cinder-volume[86875]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 03 07:28:16 devstack cinder-volume[86875]: WARNING oslo.privsep.daemon [-] privsep log: Nov 03 07:28:16 devstack cinder-volume[86875]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Nov 03 07:28:16 devstack sudo[88561]: pam_unix(sudo:session): session closed for user root Nov 03 07:28:16 devstack cinder-volume[86875]: INFO oslo.privsep.daemon [None req-e1c74afb-787c-465a-8496-0cd204c2e2f7 tempest-VolumesAdminNegativeTest-396022998 None] Spawned new privsep daemon via rootwrap Nov 03 07:28:16 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [None req-e1c74afb-787c-465a-8496-0cd204c2e2f7 tempest-VolumesAdminNegativeTest-396022998 None] Accepted privsep connection to /tmp/tmp8nhpujzz/privsep.sock {{(pid=86875) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Nov 03 07:28:16 devstack cinder-volume[86875]: INFO oslo.privsep.daemon [-] privsep daemon starting Nov 03 07:28:16 devstack cinder-volume[86875]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Nov 03 07:28:16 devstack cinder-volume[86875]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Nov 03 07:28:16 devstack cinder-volume[86875]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88573 Nov 03 07:28:16 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[99361729-2e65-46d5-a0d5-96c236f7c23b]: (2,) {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:28:16 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fcc5b3f-4495-4fe4-8495-1935e7506774]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:28:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e1c74afb-787c-465a-8496-0cd204c2e2f7 tempest-VolumesAdminNegativeTest-396022998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d9b6d61d-73a5-461e-9023-8f77edcea64b {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:28:16 devstack sudo[88578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d9b6d61d-73a5-461e-9023-8f77edcea64b Nov 03 07:28:16 devstack sudo[88578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:28:17 devstack sudo[88578]: pam_unix(sudo:session): session closed for user root Nov 03 07:28:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e1c74afb-787c-465a-8496-0cd204c2e2f7 tempest-VolumesAdminNegativeTest-396022998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d9b6d61d-73a5-461e-9023-8f77edcea64b" returned: 0 in 0.727s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:28:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e1c74afb-787c-465a-8496-0cd204c2e2f7 tempest-VolumesAdminNegativeTest-396022998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d9b6d61d-73a5-461e-9023-8f77edcea64b {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:28:17 devstack sudo[88584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d9b6d61d-73a5-461e-9023-8f77edcea64b Nov 03 07:28:17 devstack sudo[88584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:28:17 devstack sudo[88584]: pam_unix(sudo:session): session closed for user root Nov 03 07:28:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e1c74afb-787c-465a-8496-0cd204c2e2f7 tempest-VolumesAdminNegativeTest-396022998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d9b6d61d-73a5-461e-9023-8f77edcea64b" returned: 0 in 0.553s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:28:17 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-e1c74afb-787c-465a-8496-0cd204c2e2f7 tempest-VolumesAdminNegativeTest-396022998 None] Lock "cinder-quobyte-d9b6d61d-73a5-461e-9023-8f77edcea64b" released by "delete_volume" :: held 3.675s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:28:18 devstack cinder-volume[86875]: WARNING cinder.quota [None req-e1c74afb-787c-465a-8496-0cd204c2e2f7 tempest-VolumesAdminNegativeTest-396022998 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:28:18 devstack cinder-volume[86875]: WARNING cinder.quota [None req-e1c74afb-787c-465a-8496-0cd204c2e2f7 tempest-VolumesAdminNegativeTest-396022998 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:28:18 devstack cinder-volume[86875]: INFO cinder.volume.manager [req-e5f8aaed-5f67-4848-8379-326c22b13d77 req-86c04e31-bcdb-4061-bc41-65d679b0aca1 tempest-DeleteServersTestJSON-1620434557 None] Terminate volume connection completed successfully. Nov 03 07:28:18 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-e5f8aaed-5f67-4848-8379-326c22b13d77 req-86c04e31-bcdb-4061-bc41-65d679b0aca1 tempest-DeleteServersTestJSON-1620434557 None] Deleting attachment 44a3504a-2626-4e47-9c92-9a82bd1e6a2d. {{(pid=86875) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:28:18 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-e1c74afb-787c-465a-8496-0cd204c2e2f7 tempest-VolumesAdminNegativeTest-396022998 None] Created reservations ['2422d4c1-7f94-4146-8398-2a4f18693979', '7fe3e56f-7cd5-427f-a1b5-1ec110cd4d04', '3d019db0-8810-4a0c-a1bd-8606fb9fe559', '8f2f6ec8-d69e-444d-84b0-2402b483eca6'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:28:18 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e1c74afb-787c-465a-8496-0cd204c2e2f7 tempest-VolumesAdminNegativeTest-396022998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:28:18 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e1c74afb-787c-465a-8496-0cd204c2e2f7 tempest-VolumesAdminNegativeTest-396022998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:28:18 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-e1c74afb-787c-465a-8496-0cd204c2e2f7 tempest-VolumesAdminNegativeTest-396022998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:28:18 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-e1c74afb-787c-465a-8496-0cd204c2e2f7 tempest-VolumesAdminNegativeTest-396022998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:28:18 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e1c74afb-787c-465a-8496-0cd204c2e2f7 tempest-VolumesAdminNegativeTest-396022998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:28:18 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e1c74afb-787c-465a-8496-0cd204c2e2f7 tempest-VolumesAdminNegativeTest-396022998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:28:18 devstack sudo[88590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:28:18 devstack sudo[88590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:28:19 devstack sudo[88590]: pam_unix(sudo:session): session closed for user root Nov 03 07:28:19 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e1c74afb-787c-465a-8496-0cd204c2e2f7 tempest-VolumesAdminNegativeTest-396022998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.933s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:28:19 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-e1c74afb-787c-465a-8496-0cd204c2e2f7 tempest-VolumesAdminNegativeTest-396022998 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:28:19 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-e1c74afb-787c-465a-8496-0cd204c2e2f7 tempest-VolumesAdminNegativeTest-396022998 None] Deleted volume successfully. Nov 03 07:28:19 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-e1c74afb-787c-465a-8496-0cd204c2e2f7 tempest-VolumesAdminNegativeTest-396022998 None] Lock "cinder-d9b6d61d-73a5-461e-9023-8f77edcea64b-delete_volume" released by "delete_volume" :: held 5.369s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:28:21 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-aa402d2f-d2cb-4d32-b5d9-3be5d19fc924 tempest-DeleteServersTestJSON-1620434557 None] Acquiring lock "cinder-b41a849b-7bd2-4480-a577-636eab6d158d-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:28:21 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-aa402d2f-d2cb-4d32-b5d9-3be5d19fc924 tempest-DeleteServersTestJSON-1620434557 None] Lock "cinder-b41a849b-7bd2-4480-a577-636eab6d158d-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:28:21 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-aa402d2f-d2cb-4d32-b5d9-3be5d19fc924 tempest-DeleteServersTestJSON-1620434557 None] Acquiring lock "cinder-quobyte-b41a849b-7bd2-4480-a577-636eab6d158d" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:28:21 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-aa402d2f-d2cb-4d32-b5d9-3be5d19fc924 tempest-DeleteServersTestJSON-1620434557 None] Lock "cinder-quobyte-b41a849b-7bd2-4480-a577-636eab6d158d" acquired by "delete_volume" :: waited 0.060s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:28:21 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0f86f0-786f-4632-89ea-8f6cc634eb8c]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:28:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-aa402d2f-d2cb-4d32-b5d9-3be5d19fc924 tempest-DeleteServersTestJSON-1620434557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b41a849b-7bd2-4480-a577-636eab6d158d {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:28:21 devstack sudo[88620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b41a849b-7bd2-4480-a577-636eab6d158d Nov 03 07:28:21 devstack sudo[88620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:28:22 devstack sudo[88620]: pam_unix(sudo:session): session closed for user root Nov 03 07:28:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-aa402d2f-d2cb-4d32-b5d9-3be5d19fc924 tempest-DeleteServersTestJSON-1620434557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b41a849b-7bd2-4480-a577-636eab6d158d" returned: 0 in 0.757s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:28:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-aa402d2f-d2cb-4d32-b5d9-3be5d19fc924 tempest-DeleteServersTestJSON-1620434557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b41a849b-7bd2-4480-a577-636eab6d158d {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:28:22 devstack sudo[88634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b41a849b-7bd2-4480-a577-636eab6d158d Nov 03 07:28:22 devstack sudo[88634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:28:22 devstack sudo[88634]: pam_unix(sudo:session): session closed for user root Nov 03 07:28:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-aa402d2f-d2cb-4d32-b5d9-3be5d19fc924 tempest-DeleteServersTestJSON-1620434557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b41a849b-7bd2-4480-a577-636eab6d158d" returned: 0 in 0.576s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:28:22 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-aa402d2f-d2cb-4d32-b5d9-3be5d19fc924 tempest-DeleteServersTestJSON-1620434557 None] Lock "cinder-quobyte-b41a849b-7bd2-4480-a577-636eab6d158d" released by "delete_volume" :: held 1.434s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:28:23 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-aa402d2f-d2cb-4d32-b5d9-3be5d19fc924 tempest-DeleteServersTestJSON-1620434557 None] Created reservations ['1f292cee-0386-4552-97d7-549018f73b50', '2c681a52-6537-40c9-95e2-928c30a01674', '2f04f650-e690-4e5e-a3a1-8ac37e659c47', 'f228f087-aaa4-492a-ad5d-d4ed0f6015b4'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:28:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-aa402d2f-d2cb-4d32-b5d9-3be5d19fc924 tempest-DeleteServersTestJSON-1620434557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:28:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-aa402d2f-d2cb-4d32-b5d9-3be5d19fc924 tempest-DeleteServersTestJSON-1620434557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:28:23 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-aa402d2f-d2cb-4d32-b5d9-3be5d19fc924 tempest-DeleteServersTestJSON-1620434557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:28:23 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-aa402d2f-d2cb-4d32-b5d9-3be5d19fc924 tempest-DeleteServersTestJSON-1620434557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:28:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-aa402d2f-d2cb-4d32-b5d9-3be5d19fc924 tempest-DeleteServersTestJSON-1620434557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:28:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-aa402d2f-d2cb-4d32-b5d9-3be5d19fc924 tempest-DeleteServersTestJSON-1620434557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:28:23 devstack sudo[88638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:28:23 devstack sudo[88638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:28:23 devstack sudo[88638]: pam_unix(sudo:session): session closed for user root Nov 03 07:28:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-aa402d2f-d2cb-4d32-b5d9-3be5d19fc924 tempest-DeleteServersTestJSON-1620434557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.478s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:28:23 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-aa402d2f-d2cb-4d32-b5d9-3be5d19fc924 tempest-DeleteServersTestJSON-1620434557 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:28:23 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-aa402d2f-d2cb-4d32-b5d9-3be5d19fc924 tempest-DeleteServersTestJSON-1620434557 None] Deleted volume successfully. Nov 03 07:28:23 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-aa402d2f-d2cb-4d32-b5d9-3be5d19fc924 tempest-DeleteServersTestJSON-1620434557 None] Lock "cinder-b41a849b-7bd2-4480-a577-636eab6d158d-delete_volume" released by "delete_volume" :: held 2.504s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:28:33 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:SELECT=22,cinder:UPDATE=21,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:28:35 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:UPDATE=23,cinder:SELECT=20,cinder:DELETE=3,cinder:INSERT=3 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:28:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-2fa2021d-e85d-45b3-ba19-5ca8b516dfe2 req-da2763a2-1af5-4a93-9877-a2ec40c587e0 tempest-TaggedAttachmentsTest-702494535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:28:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-2fa2021d-e85d-45b3-ba19-5ca8b516dfe2 req-da2763a2-1af5-4a93-9877-a2ec40c587e0 tempest-TaggedAttachmentsTest-702494535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:28:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-2fa2021d-e85d-45b3-ba19-5ca8b516dfe2 req-da2763a2-1af5-4a93-9877-a2ec40c587e0 tempest-TaggedAttachmentsTest-702494535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:28:54 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-2fa2021d-e85d-45b3-ba19-5ca8b516dfe2 req-da2763a2-1af5-4a93-9877-a2ec40c587e0 tempest-TaggedAttachmentsTest-702494535 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1', 'name': 'volume-c5c171fc-2601-4fff-bfe5-dd82f67399b7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6aec3622-be9a-40cf-b81b-6f8bf9ac1f6b', 'enforce_multipath': True} {{(pid=86875) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:28:54 devstack cinder-volume[86875]: INFO cinder.volume.manager [req-2fa2021d-e85d-45b3-ba19-5ca8b516dfe2 req-da2763a2-1af5-4a93-9877-a2ec40c587e0 tempest-TaggedAttachmentsTest-702494535 None] attachment_update completed successfully. Nov 03 07:28:56 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-a83e2f1d-5f78-4bbd-8ae5-036a4b906810 tempest-SnapshotsActionsTest-605153189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:28:56 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a83e2f1d-5f78-4bbd-8ae5-036a4b906810 tempest-SnapshotsActionsTest-605153189 None] Flow 'volume_create_manager' (fb616246-0788-4591-9b10-039c9cb23052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:28:56 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a83e2f1d-5f78-4bbd-8ae5-036a4b906810 tempest-SnapshotsActionsTest-605153189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6481fe4b-5ab1-4193-813d-4cd626044f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:28:56 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a83e2f1d-5f78-4bbd-8ae5-036a4b906810 tempest-SnapshotsActionsTest-605153189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6481fe4b-5ab1-4193-813d-4cd626044f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:28:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-968090662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='363882363086477baea876ec85eadaf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:28:56Z,use_quota=True,user_id='9e023430b4a949e78d5770007645dc3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:28:56 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a83e2f1d-5f78-4bbd-8ae5-036a4b906810 tempest-SnapshotsActionsTest-605153189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8192c30b-7258-498f-8f90-0bc77f7bbf80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:28:56 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a83e2f1d-5f78-4bbd-8ae5-036a4b906810 tempest-SnapshotsActionsTest-605153189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8192c30b-7258-498f-8f90-0bc77f7bbf80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:28:56 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a83e2f1d-5f78-4bbd-8ae5-036a4b906810 tempest-SnapshotsActionsTest-605153189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (390d6ac6-23c0-45e6-b79a-1f935a4da4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:28:56 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a83e2f1d-5f78-4bbd-8ae5-036a4b906810 tempest-SnapshotsActionsTest-605153189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (390d6ac6-23c0-45e6-b79a-1f935a4da4f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe', 'volume_name': 'volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:28:56 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a83e2f1d-5f78-4bbd-8ae5-036a4b906810 tempest-SnapshotsActionsTest-605153189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d23d74b8-8d5b-49e8-b5b3-95d08b6aa2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:28:56 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a83e2f1d-5f78-4bbd-8ae5-036a4b906810 tempest-SnapshotsActionsTest-605153189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d23d74b8-8d5b-49e8-b5b3-95d08b6aa2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:28:56 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a83e2f1d-5f78-4bbd-8ae5-036a4b906810 tempest-SnapshotsActionsTest-605153189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f5b6eb5-ce77-43e9-8fce-31ce2a9a2064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:28:56 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-a83e2f1d-5f78-4bbd-8ae5-036a4b906810 tempest-SnapshotsActionsTest-605153189 None] Volume 35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe', 'volume_size': 1} Nov 03 07:28:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a83e2f1d-5f78-4bbd-8ae5-036a4b906810 tempest-SnapshotsActionsTest-605153189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:28:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a83e2f1d-5f78-4bbd-8ae5-036a4b906810 tempest-SnapshotsActionsTest-605153189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:28:56 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a83e2f1d-5f78-4bbd-8ae5-036a4b906810 tempest-SnapshotsActionsTest-605153189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:28:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-968090662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='363882363086477baea876ec85eadaf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:28:56Z,use_quota=True,user_id='9e023430b4a949e78d5770007645dc3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:28:56 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-a83e2f1d-5f78-4bbd-8ae5-036a4b906810 tempest-SnapshotsActionsTest-605153189 None] Creating volume 35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:28:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a83e2f1d-5f78-4bbd-8ae5-036a4b906810 tempest-SnapshotsActionsTest-605153189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:28:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a83e2f1d-5f78-4bbd-8ae5-036a4b906810 tempest-SnapshotsActionsTest-605153189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:28:56 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a83e2f1d-5f78-4bbd-8ae5-036a4b906810 tempest-SnapshotsActionsTest-605153189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:28:56 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a83e2f1d-5f78-4bbd-8ae5-036a4b906810 tempest-SnapshotsActionsTest-605153189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:28:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a83e2f1d-5f78-4bbd-8ae5-036a4b906810 tempest-SnapshotsActionsTest-605153189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:28:56 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a83e2f1d-5f78-4bbd-8ae5-036a4b906810 tempest-SnapshotsActionsTest-605153189 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:28:56 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-a83e2f1d-5f78-4bbd-8ae5-036a4b906810 tempest-SnapshotsActionsTest-605153189 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:28:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a83e2f1d-5f78-4bbd-8ae5-036a4b906810 tempest-SnapshotsActionsTest-605153189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:28:56 devstack sudo[89180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe 1073741824 Nov 03 07:28:56 devstack sudo[89180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:28:57 devstack sudo[89180]: pam_unix(sudo:session): session closed for user root Nov 03 07:28:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a83e2f1d-5f78-4bbd-8ae5-036a4b906810 tempest-SnapshotsActionsTest-605153189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe 1073741824" returned: 0 in 0.747s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:28:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a83e2f1d-5f78-4bbd-8ae5-036a4b906810 tempest-SnapshotsActionsTest-605153189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:28:57 devstack sudo[89206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe Nov 03 07:28:57 devstack sudo[89206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:28:57 devstack sudo[89206]: pam_unix(sudo:session): session closed for user root Nov 03 07:28:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a83e2f1d-5f78-4bbd-8ae5-036a4b906810 tempest-SnapshotsActionsTest-605153189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe" returned: 0 in 0.284s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:28:57 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a83e2f1d-5f78-4bbd-8ae5-036a4b906810 tempest-SnapshotsActionsTest-605153189 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:28:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a83e2f1d-5f78-4bbd-8ae5-036a4b906810 tempest-SnapshotsActionsTest-605153189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:28:57 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a83e2f1d-5f78-4bbd-8ae5-036a4b906810 tempest-SnapshotsActionsTest-605153189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f5b6eb5-ce77-43e9-8fce-31ce2a9a2064) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:28:57 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a83e2f1d-5f78-4bbd-8ae5-036a4b906810 tempest-SnapshotsActionsTest-605153189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52696c65-5225-4471-bcd7-5b0ca472d447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:28:57 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-a83e2f1d-5f78-4bbd-8ae5-036a4b906810 tempest-SnapshotsActionsTest-605153189 None] Volume volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe (35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe): created successfully Nov 03 07:28:57 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a83e2f1d-5f78-4bbd-8ae5-036a4b906810 tempest-SnapshotsActionsTest-605153189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52696c65-5225-4471-bcd7-5b0ca472d447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:28:57 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a83e2f1d-5f78-4bbd-8ae5-036a4b906810 tempest-SnapshotsActionsTest-605153189 None] Flow 'volume_create_manager' (fb616246-0788-4591-9b10-039c9cb23052) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:28:57 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-a83e2f1d-5f78-4bbd-8ae5-036a4b906810 tempest-SnapshotsActionsTest-605153189 None] Created volume successfully. Nov 03 07:28:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a5652456-d772-4449-adbe-1b5a907c6d23 tempest-SnapshotsActionsTest-605153189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:28:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a5652456-d772-4449-adbe-1b5a907c6d23 tempest-SnapshotsActionsTest-605153189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:28:58 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-a5652456-d772-4449-adbe-1b5a907c6d23 tempest-SnapshotsActionsTest-605153189 None] Creating offline snapshot fe94783c-60b2-4c8a-b1f5-0594fca2737b of volume 35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe {{(pid=86875) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:28:58 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f1f5d9-3f4d-4b1e-9f05-77d1ee3da911]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:28:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a5652456-d772-4449-adbe-1b5a907c6d23 tempest-SnapshotsActionsTest-605153189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:28:59 devstack cinder-volume[86875]: INFO cinder.volume.manager [req-bfc20c6d-8b4c-4b54-b648-9a3ec3311388 req-803ceaef-666c-49e5-876d-2b8c1cc8e678 tempest-TaggedAttachmentsTest-702494535 None] Terminate volume connection completed successfully. Nov 03 07:28:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-bfc20c6d-8b4c-4b54-b648-9a3ec3311388 req-803ceaef-666c-49e5-876d-2b8c1cc8e678 tempest-TaggedAttachmentsTest-702494535 None] Deleting attachment 6aec3622-be9a-40cf-b81b-6f8bf9ac1f6b. {{(pid=86875) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:28:59 devstack sudo[89213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe Nov 03 07:28:59 devstack sudo[89213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:28:59 devstack sudo[89213]: pam_unix(sudo:session): session closed for user root Nov 03 07:28:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a5652456-d772-4449-adbe-1b5a907c6d23 tempest-SnapshotsActionsTest-605153189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe" returned: 0 in 0.573s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:28:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a5652456-d772-4449-adbe-1b5a907c6d23 tempest-SnapshotsActionsTest-605153189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b 1G {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:28:59 devstack sudo[89244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b 1G Nov 03 07:28:59 devstack sudo[89244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:00 devstack sudo[89244]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a5652456-d772-4449-adbe-1b5a907c6d23 tempest-SnapshotsActionsTest-605153189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b 1G" returned: 0 in 0.768s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a5652456-d772-4449-adbe-1b5a907c6d23 tempest-SnapshotsActionsTest-605153189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:00 devstack sudo[89252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b Nov 03 07:29:00 devstack sudo[89252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:00 devstack sudo[89252]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a5652456-d772-4449-adbe-1b5a907c6d23 tempest-SnapshotsActionsTest-605153189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b" returned: 0 in 0.692s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:00 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-a5652456-d772-4449-adbe-1b5a907c6d23 tempest-SnapshotsActionsTest-605153189 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b is being set with open permissions: ugo+rw Nov 03 07:29:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a5652456-d772-4449-adbe-1b5a907c6d23 tempest-SnapshotsActionsTest-605153189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:00 devstack sudo[89285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b Nov 03 07:29:00 devstack sudo[89285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:01 devstack sudo[89285]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a5652456-d772-4449-adbe-1b5a907c6d23 tempest-SnapshotsActionsTest-605153189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b" returned: 0 in 0.604s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a5652456-d772-4449-adbe-1b5a907c6d23 tempest-SnapshotsActionsTest-605153189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:01 devstack sudo[89330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.info Nov 03 07:29:01 devstack sudo[89330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:02 devstack sudo[89330]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a5652456-d772-4449-adbe-1b5a907c6d23 tempest-SnapshotsActionsTest-605153189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.info" returned: 0 in 0.520s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:02 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-a5652456-d772-4449-adbe-1b5a907c6d23 tempest-SnapshotsActionsTest-605153189 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.info is being set with open permissions: ugo+rw Nov 03 07:29:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a5652456-d772-4449-adbe-1b5a907c6d23 tempest-SnapshotsActionsTest-605153189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:02 devstack sudo[89343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.info Nov 03 07:29:02 devstack sudo[89343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:02 devstack sudo[89343]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a5652456-d772-4449-adbe-1b5a907c6d23 tempest-SnapshotsActionsTest-605153189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.info" returned: 0 in 0.311s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a5652456-d772-4449-adbe-1b5a907c6d23 tempest-SnapshotsActionsTest-605153189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.648s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:29:02 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-a5652456-d772-4449-adbe-1b5a907c6d23 tempest-SnapshotsActionsTest-605153189 None] Create snapshot completed successfully Nov 03 07:29:03 devstack cinder-volume[86875]: DEBUG oslo_service.periodic_task [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86875) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:29:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:29:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:29:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:29:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:29:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:29:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:03 devstack sudo[89352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:29:03 devstack sudo[89352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:04 devstack sudo[89352]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.778s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:04 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:29:04 devstack cinder-volume[86875]: DEBUG oslo_service.periodic_task [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running periodic task VolumeManager._thread_info {{(pid=86875) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:29:04 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] thread count: 8 {{(pid=86875) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:29:04 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] thread info: [<_MainThread(MainThread, started 125626325639296)>, , , , , , , ] {{(pid=86875) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:29:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a2d4a00f-1db3-44fa-b583-99f8704bd1d4 tempest-SnapshotsActionsTest-605153189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:29:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a2d4a00f-1db3-44fa-b583-99f8704bd1d4 tempest-SnapshotsActionsTest-605153189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:29:04 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-a2d4a00f-1db3-44fa-b583-99f8704bd1d4 tempest-SnapshotsActionsTest-605153189 None] Creating offline snapshot 60156446-fbee-42a9-a240-9579d169f657 of volume 35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe {{(pid=86875) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:29:04 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[65338a9c-1aad-41dd-93f8-908b5d763706]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:29:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a2d4a00f-1db3-44fa-b583-99f8704bd1d4 tempest-SnapshotsActionsTest-605153189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:04 devstack sudo[89357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b Nov 03 07:29:04 devstack sudo[89357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:05 devstack sudo[89357]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a2d4a00f-1db3-44fa-b583-99f8704bd1d4 tempest-SnapshotsActionsTest-605153189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b" returned: 0 in 0.754s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:05 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-a2d4a00f-1db3-44fa-b583-99f8704bd1d4 tempest-SnapshotsActionsTest-605153189 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:29:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a2d4a00f-1db3-44fa-b583-99f8704bd1d4 tempest-SnapshotsActionsTest-605153189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.60156446-fbee-42a9-a240-9579d169f657 1G {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:05 devstack sudo[89364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.60156446-fbee-42a9-a240-9579d169f657 1G Nov 03 07:29:05 devstack sudo[89364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:06 devstack sudo[89364]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a2d4a00f-1db3-44fa-b583-99f8704bd1d4 tempest-SnapshotsActionsTest-605153189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.60156446-fbee-42a9-a240-9579d169f657 1G" returned: 0 in 0.891s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a2d4a00f-1db3-44fa-b583-99f8704bd1d4 tempest-SnapshotsActionsTest-605153189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.60156446-fbee-42a9-a240-9579d169f657 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:06 devstack sudo[89371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.60156446-fbee-42a9-a240-9579d169f657 Nov 03 07:29:06 devstack sudo[89371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:07 devstack sudo[89371]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a2d4a00f-1db3-44fa-b583-99f8704bd1d4 tempest-SnapshotsActionsTest-605153189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.60156446-fbee-42a9-a240-9579d169f657" returned: 0 in 0.674s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:07 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-a2d4a00f-1db3-44fa-b583-99f8704bd1d4 tempest-SnapshotsActionsTest-605153189 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.60156446-fbee-42a9-a240-9579d169f657 is being set with open permissions: ugo+rw Nov 03 07:29:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a2d4a00f-1db3-44fa-b583-99f8704bd1d4 tempest-SnapshotsActionsTest-605153189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.60156446-fbee-42a9-a240-9579d169f657 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:07 devstack sudo[89377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.60156446-fbee-42a9-a240-9579d169f657 Nov 03 07:29:07 devstack sudo[89377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:07 devstack sudo[89377]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a2d4a00f-1db3-44fa-b583-99f8704bd1d4 tempest-SnapshotsActionsTest-605153189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.60156446-fbee-42a9-a240-9579d169f657" returned: 0 in 0.665s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a2d4a00f-1db3-44fa-b583-99f8704bd1d4 tempest-SnapshotsActionsTest-605153189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.173s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:29:07 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-a2d4a00f-1db3-44fa-b583-99f8704bd1d4 tempest-SnapshotsActionsTest-605153189 None] Create snapshot completed successfully Nov 03 07:29:09 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-716ede78-510a-474e-b94b-7099d2b7da27 tempest-SnapshotsActionsTest-1936808486 None] Acquiring lock "cinder-60156446-fbee-42a9-a240-9579d169f657-delete_snapshot" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:29:09 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-716ede78-510a-474e-b94b-7099d2b7da27 tempest-SnapshotsActionsTest-1936808486 None] Lock "cinder-60156446-fbee-42a9-a240-9579d169f657-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:29:09 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-716ede78-510a-474e-b94b-7099d2b7da27 tempest-SnapshotsActionsTest-1936808486 None] Acquiring lock "cinder-quobyte-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:29:09 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-716ede78-510a-474e-b94b-7099d2b7da27 tempest-SnapshotsActionsTest-1936808486 None] Lock "cinder-quobyte-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:29:09 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-716ede78-510a-474e-b94b-7099d2b7da27 tempest-SnapshotsActionsTest-1936808486 None] Acquiring lock "cinder-quobyte-60156446-fbee-42a9-a240-9579d169f657" by "_delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:29:09 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-716ede78-510a-474e-b94b-7099d2b7da27 tempest-SnapshotsActionsTest-1936808486 None] Lock "cinder-quobyte-60156446-fbee-42a9-a240-9579d169f657" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:29:09 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-716ede78-510a-474e-b94b-7099d2b7da27 tempest-SnapshotsActionsTest-1936808486 None] Deleting offline snapshot 60156446-fbee-42a9-a240-9579d169f657 of volume 35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:29:09 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-716ede78-510a-474e-b94b-7099d2b7da27 tempest-SnapshotsActionsTest-1936808486 None] snapshot_file for this snap is: volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.60156446-fbee-42a9-a240-9579d169f657 {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:29:09 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf242869-0508-4ac4-8603-f0139557d456]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:29:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-716ede78-510a-474e-b94b-7099d2b7da27 tempest-SnapshotsActionsTest-1936808486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.60156446-fbee-42a9-a240-9579d169f657 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:09 devstack sudo[89441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.60156446-fbee-42a9-a240-9579d169f657 Nov 03 07:29:09 devstack sudo[89441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:10 devstack sudo[89441]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-716ede78-510a-474e-b94b-7099d2b7da27 tempest-SnapshotsActionsTest-1936808486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.60156446-fbee-42a9-a240-9579d169f657" returned: 0 in 0.811s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:10 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-716ede78-510a-474e-b94b-7099d2b7da27 tempest-SnapshotsActionsTest-1936808486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:29:10 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d674ac7-2320-4a57-9dcc-64abce43301c]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:29:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-716ede78-510a-474e-b94b-7099d2b7da27 tempest-SnapshotsActionsTest-1936808486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:10 devstack sudo[89448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b Nov 03 07:29:10 devstack sudo[89448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:10 devstack sudo[89448]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-716ede78-510a-474e-b94b-7099d2b7da27 tempest-SnapshotsActionsTest-1936808486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b" returned: 0 in 0.455s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:10 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-716ede78-510a-474e-b94b-7099d2b7da27 tempest-SnapshotsActionsTest-1936808486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:29:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-716ede78-510a-474e-b94b-7099d2b7da27 tempest-SnapshotsActionsTest-1936808486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.60156446-fbee-42a9-a240-9579d169f657 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:10 devstack sudo[89455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.60156446-fbee-42a9-a240-9579d169f657 Nov 03 07:29:10 devstack sudo[89455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:11 devstack sudo[89455]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-716ede78-510a-474e-b94b-7099d2b7da27 tempest-SnapshotsActionsTest-1936808486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.60156446-fbee-42a9-a240-9579d169f657" returned: 0 in 0.591s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-716ede78-510a-474e-b94b-7099d2b7da27 tempest-SnapshotsActionsTest-1936808486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.60156446-fbee-42a9-a240-9579d169f657 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:11 devstack sudo[89465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.60156446-fbee-42a9-a240-9579d169f657 Nov 03 07:29:11 devstack sudo[89465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:11 devstack sudo[89465]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-716ede78-510a-474e-b94b-7099d2b7da27 tempest-SnapshotsActionsTest-1936808486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.60156446-fbee-42a9-a240-9579d169f657" returned: 0 in 0.519s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:11 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-716ede78-510a-474e-b94b-7099d2b7da27 tempest-SnapshotsActionsTest-1936808486 None] Lock "cinder-quobyte-60156446-fbee-42a9-a240-9579d169f657" released by "_delete_snapshot" :: held 2.571s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:29:11 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-716ede78-510a-474e-b94b-7099d2b7da27 tempest-SnapshotsActionsTest-1936808486 None] Lock "cinder-quobyte-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe" released by "delete_snapshot" :: held 2.640s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:29:12 devstack cinder-volume[86875]: WARNING cinder.quota [None req-716ede78-510a-474e-b94b-7099d2b7da27 tempest-SnapshotsActionsTest-1936808486 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:29:12 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-716ede78-510a-474e-b94b-7099d2b7da27 tempest-SnapshotsActionsTest-1936808486 None] Created reservations ['cd45d306-3a2c-4a9d-bd5d-eeb22fb7ab87', '03747378-b7c9-410f-841d-dc8ecbc1428c', '779d0b11-2197-4ef5-ad25-f0a82542f6eb', '645328b9-dea8-41c2-821f-f6207610a258'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:29:12 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-716ede78-510a-474e-b94b-7099d2b7da27 tempest-SnapshotsActionsTest-1936808486 None] Delete snapshot completed successfully. Nov 03 07:29:12 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-716ede78-510a-474e-b94b-7099d2b7da27 tempest-SnapshotsActionsTest-1936808486 None] Lock "cinder-60156446-fbee-42a9-a240-9579d169f657-delete_snapshot" released by "delete_snapshot" :: held 3.088s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:29:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-ca48ae0f-9144-4bcd-9d69-5b64c7fb7475 tempest-SnapshotsActionsTest-605153189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:29:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-ca48ae0f-9144-4bcd-9d69-5b64c7fb7475 tempest-SnapshotsActionsTest-605153189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:29:13 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-ca48ae0f-9144-4bcd-9d69-5b64c7fb7475 tempest-SnapshotsActionsTest-605153189 None] Creating offline snapshot 4cecad99-d2de-4d86-b7fe-f29085ea27c5 of volume 35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe {{(pid=86875) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:29:13 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb973dc5-86ff-4d79-b29d-8020f66933b2]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:29:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ca48ae0f-9144-4bcd-9d69-5b64c7fb7475 tempest-SnapshotsActionsTest-605153189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:13 devstack sudo[89471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b Nov 03 07:29:13 devstack sudo[89471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:14 devstack sudo[89471]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:14 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ca48ae0f-9144-4bcd-9d69-5b64c7fb7475 tempest-SnapshotsActionsTest-605153189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b" returned: 0 in 0.605s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:14 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-ca48ae0f-9144-4bcd-9d69-5b64c7fb7475 tempest-SnapshotsActionsTest-605153189 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:29:14 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ca48ae0f-9144-4bcd-9d69-5b64c7fb7475 tempest-SnapshotsActionsTest-605153189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.4cecad99-d2de-4d86-b7fe-f29085ea27c5 1G {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:14 devstack sudo[89476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.4cecad99-d2de-4d86-b7fe-f29085ea27c5 1G Nov 03 07:29:14 devstack sudo[89476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:15 devstack sudo[89476]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ca48ae0f-9144-4bcd-9d69-5b64c7fb7475 tempest-SnapshotsActionsTest-605153189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.4cecad99-d2de-4d86-b7fe-f29085ea27c5 1G" returned: 0 in 1.078s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ca48ae0f-9144-4bcd-9d69-5b64c7fb7475 tempest-SnapshotsActionsTest-605153189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.4cecad99-d2de-4d86-b7fe-f29085ea27c5 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:15 devstack sudo[89492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.4cecad99-d2de-4d86-b7fe-f29085ea27c5 Nov 03 07:29:15 devstack sudo[89492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:16 devstack sudo[89492]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ca48ae0f-9144-4bcd-9d69-5b64c7fb7475 tempest-SnapshotsActionsTest-605153189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.4cecad99-d2de-4d86-b7fe-f29085ea27c5" returned: 0 in 0.575s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:16 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-ca48ae0f-9144-4bcd-9d69-5b64c7fb7475 tempest-SnapshotsActionsTest-605153189 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.4cecad99-d2de-4d86-b7fe-f29085ea27c5 is being set with open permissions: ugo+rw Nov 03 07:29:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ca48ae0f-9144-4bcd-9d69-5b64c7fb7475 tempest-SnapshotsActionsTest-605153189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.4cecad99-d2de-4d86-b7fe-f29085ea27c5 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:16 devstack sudo[89514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.4cecad99-d2de-4d86-b7fe-f29085ea27c5 Nov 03 07:29:16 devstack sudo[89514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:16 devstack sudo[89514]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ca48ae0f-9144-4bcd-9d69-5b64c7fb7475 tempest-SnapshotsActionsTest-605153189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.4cecad99-d2de-4d86-b7fe-f29085ea27c5" returned: 0 in 0.431s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-ca48ae0f-9144-4bcd-9d69-5b64c7fb7475 tempest-SnapshotsActionsTest-605153189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.857s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:29:16 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-ca48ae0f-9144-4bcd-9d69-5b64c7fb7475 tempest-SnapshotsActionsTest-605153189 None] Create snapshot completed successfully Nov 03 07:29:17 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-0b7b8b59-9afe-4249-bca8-3e6f032deda8 tempest-SnapshotsActionsTest-1936808486 None] Acquiring lock "cinder-4cecad99-d2de-4d86-b7fe-f29085ea27c5-delete_snapshot" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:29:17 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-0b7b8b59-9afe-4249-bca8-3e6f032deda8 tempest-SnapshotsActionsTest-1936808486 None] Lock "cinder-4cecad99-d2de-4d86-b7fe-f29085ea27c5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:29:17 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-0b7b8b59-9afe-4249-bca8-3e6f032deda8 tempest-SnapshotsActionsTest-1936808486 None] Acquiring lock "cinder-quobyte-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:29:17 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-0b7b8b59-9afe-4249-bca8-3e6f032deda8 tempest-SnapshotsActionsTest-1936808486 None] Lock "cinder-quobyte-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:29:17 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-0b7b8b59-9afe-4249-bca8-3e6f032deda8 tempest-SnapshotsActionsTest-1936808486 None] Acquiring lock "cinder-quobyte-4cecad99-d2de-4d86-b7fe-f29085ea27c5" by "_delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:29:17 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-0b7b8b59-9afe-4249-bca8-3e6f032deda8 tempest-SnapshotsActionsTest-1936808486 None] Lock "cinder-quobyte-4cecad99-d2de-4d86-b7fe-f29085ea27c5" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:29:17 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-0b7b8b59-9afe-4249-bca8-3e6f032deda8 tempest-SnapshotsActionsTest-1936808486 None] Deleting offline snapshot 4cecad99-d2de-4d86-b7fe-f29085ea27c5 of volume 35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:29:17 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-0b7b8b59-9afe-4249-bca8-3e6f032deda8 tempest-SnapshotsActionsTest-1936808486 None] snapshot_file for this snap is: volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.4cecad99-d2de-4d86-b7fe-f29085ea27c5 {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:29:17 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61cdc8e-38bf-42ed-bcf1-2b0c9cb66511]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:29:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0b7b8b59-9afe-4249-bca8-3e6f032deda8 tempest-SnapshotsActionsTest-1936808486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.4cecad99-d2de-4d86-b7fe-f29085ea27c5 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:17 devstack sudo[89518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.4cecad99-d2de-4d86-b7fe-f29085ea27c5 Nov 03 07:29:17 devstack sudo[89518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:17 devstack sudo[89518]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0b7b8b59-9afe-4249-bca8-3e6f032deda8 tempest-SnapshotsActionsTest-1936808486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.4cecad99-d2de-4d86-b7fe-f29085ea27c5" returned: 0 in 0.511s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:17 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-0b7b8b59-9afe-4249-bca8-3e6f032deda8 tempest-SnapshotsActionsTest-1936808486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:29:17 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[006c1dfa-3043-407f-82f7-e7d09a86acb1]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:29:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0b7b8b59-9afe-4249-bca8-3e6f032deda8 tempest-SnapshotsActionsTest-1936808486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:17 devstack sudo[89523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b Nov 03 07:29:17 devstack sudo[89523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:18 devstack sudo[89523]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:18 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0b7b8b59-9afe-4249-bca8-3e6f032deda8 tempest-SnapshotsActionsTest-1936808486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b" returned: 0 in 0.487s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:18 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-0b7b8b59-9afe-4249-bca8-3e6f032deda8 tempest-SnapshotsActionsTest-1936808486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:29:18 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0b7b8b59-9afe-4249-bca8-3e6f032deda8 tempest-SnapshotsActionsTest-1936808486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.4cecad99-d2de-4d86-b7fe-f29085ea27c5 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:18 devstack sudo[89528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.4cecad99-d2de-4d86-b7fe-f29085ea27c5 Nov 03 07:29:18 devstack sudo[89528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:18 devstack sudo[89528]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:18 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0b7b8b59-9afe-4249-bca8-3e6f032deda8 tempest-SnapshotsActionsTest-1936808486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.4cecad99-d2de-4d86-b7fe-f29085ea27c5" returned: 0 in 0.570s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:18 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0b7b8b59-9afe-4249-bca8-3e6f032deda8 tempest-SnapshotsActionsTest-1936808486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.4cecad99-d2de-4d86-b7fe-f29085ea27c5 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:18 devstack sudo[89534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.4cecad99-d2de-4d86-b7fe-f29085ea27c5 Nov 03 07:29:18 devstack sudo[89534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:19 devstack sudo[89534]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:19 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0b7b8b59-9afe-4249-bca8-3e6f032deda8 tempest-SnapshotsActionsTest-1936808486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.4cecad99-d2de-4d86-b7fe-f29085ea27c5" returned: 0 in 0.338s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:19 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-0b7b8b59-9afe-4249-bca8-3e6f032deda8 tempest-SnapshotsActionsTest-1936808486 None] Lock "cinder-quobyte-4cecad99-d2de-4d86-b7fe-f29085ea27c5" released by "_delete_snapshot" :: held 2.076s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:29:19 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-0b7b8b59-9afe-4249-bca8-3e6f032deda8 tempest-SnapshotsActionsTest-1936808486 None] Lock "cinder-quobyte-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe" released by "delete_snapshot" :: held 2.106s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:29:19 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-0b7b8b59-9afe-4249-bca8-3e6f032deda8 tempest-SnapshotsActionsTest-1936808486 None] Created reservations ['b01fe743-9ff8-44e4-97ca-99df01f240f1', 'd69023c5-23cd-4d4e-8261-7661320644fe', '84167226-4f1e-4820-ae36-d24948d658b9', '5d6edb6a-31cc-421f-a212-cb07b3a4941e'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:29:19 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-0b7b8b59-9afe-4249-bca8-3e6f032deda8 tempest-SnapshotsActionsTest-1936808486 None] Delete snapshot completed successfully. Nov 03 07:29:19 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-0b7b8b59-9afe-4249-bca8-3e6f032deda8 tempest-SnapshotsActionsTest-1936808486 None] Lock "cinder-4cecad99-d2de-4d86-b7fe-f29085ea27c5-delete_snapshot" released by "delete_snapshot" :: held 2.324s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:29:19 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-809ed263-472d-4718-b811-e5158c1548c1 tempest-TaggedAttachmentsTest-702494535 None] Acquiring lock "cinder-c5c171fc-2601-4fff-bfe5-dd82f67399b7-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:29:19 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-809ed263-472d-4718-b811-e5158c1548c1 tempest-TaggedAttachmentsTest-702494535 None] Lock "cinder-c5c171fc-2601-4fff-bfe5-dd82f67399b7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:29:19 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-809ed263-472d-4718-b811-e5158c1548c1 tempest-TaggedAttachmentsTest-702494535 None] Acquiring lock "cinder-quobyte-c5c171fc-2601-4fff-bfe5-dd82f67399b7" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:29:19 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-809ed263-472d-4718-b811-e5158c1548c1 tempest-TaggedAttachmentsTest-702494535 None] Lock "cinder-quobyte-c5c171fc-2601-4fff-bfe5-dd82f67399b7" acquired by "delete_volume" :: waited 0.022s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:29:19 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd79f3f-e421-4049-84ef-617d9326749b]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:29:19 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-809ed263-472d-4718-b811-e5158c1548c1 tempest-TaggedAttachmentsTest-702494535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c5c171fc-2601-4fff-bfe5-dd82f67399b7 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:19 devstack sudo[89538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c5c171fc-2601-4fff-bfe5-dd82f67399b7 Nov 03 07:29:19 devstack sudo[89538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:20 devstack sudo[89538]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-809ed263-472d-4718-b811-e5158c1548c1 tempest-TaggedAttachmentsTest-702494535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c5c171fc-2601-4fff-bfe5-dd82f67399b7" returned: 0 in 0.470s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-809ed263-472d-4718-b811-e5158c1548c1 tempest-TaggedAttachmentsTest-702494535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c5c171fc-2601-4fff-bfe5-dd82f67399b7 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:20 devstack sudo[89544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c5c171fc-2601-4fff-bfe5-dd82f67399b7 Nov 03 07:29:20 devstack sudo[89544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:20 devstack sudo[89544]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-809ed263-472d-4718-b811-e5158c1548c1 tempest-TaggedAttachmentsTest-702494535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c5c171fc-2601-4fff-bfe5-dd82f67399b7" returned: 0 in 0.339s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:20 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-809ed263-472d-4718-b811-e5158c1548c1 tempest-TaggedAttachmentsTest-702494535 None] Lock "cinder-quobyte-c5c171fc-2601-4fff-bfe5-dd82f67399b7" released by "delete_volume" :: held 0.859s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:29:20 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-809ed263-472d-4718-b811-e5158c1548c1 tempest-TaggedAttachmentsTest-702494535 None] Created reservations ['de8c902f-0926-4fc0-8d9c-d38ac8965f3a', '5116f9a9-14e2-442a-b99b-987a54bec6f9', '0686b168-daac-4917-8f09-29eb2d67627a', 'fe5110ad-8420-439f-9c04-56351e872394'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:29:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-809ed263-472d-4718-b811-e5158c1548c1 tempest-TaggedAttachmentsTest-702494535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:29:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-809ed263-472d-4718-b811-e5158c1548c1 tempest-TaggedAttachmentsTest-702494535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:29:20 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-809ed263-472d-4718-b811-e5158c1548c1 tempest-TaggedAttachmentsTest-702494535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:29:20 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-809ed263-472d-4718-b811-e5158c1548c1 tempest-TaggedAttachmentsTest-702494535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:29:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-809ed263-472d-4718-b811-e5158c1548c1 tempest-TaggedAttachmentsTest-702494535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:29:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-809ed263-472d-4718-b811-e5158c1548c1 tempest-TaggedAttachmentsTest-702494535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:20 devstack sudo[89547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:29:20 devstack sudo[89547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-9791392d-6345-4872-9109-aa052edaab3b tempest-SnapshotsActionsTest-605153189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:29:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-9791392d-6345-4872-9109-aa052edaab3b tempest-SnapshotsActionsTest-605153189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:29:20 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-9791392d-6345-4872-9109-aa052edaab3b tempest-SnapshotsActionsTest-605153189 None] Creating offline snapshot f4dec03e-54dc-4de0-aa09-f6a03ba025b3 of volume 35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe {{(pid=86875) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:29:20 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b4e21e-0d41-4677-a64b-c325d30bee29]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:29:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9791392d-6345-4872-9109-aa052edaab3b tempest-SnapshotsActionsTest-605153189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:20 devstack sudo[89547]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-809ed263-472d-4718-b811-e5158c1548c1 tempest-TaggedAttachmentsTest-702494535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.327s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:20 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-809ed263-472d-4718-b811-e5158c1548c1 tempest-TaggedAttachmentsTest-702494535 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:29:20 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-809ed263-472d-4718-b811-e5158c1548c1 tempest-TaggedAttachmentsTest-702494535 None] Deleted volume successfully. Nov 03 07:29:21 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-809ed263-472d-4718-b811-e5158c1548c1 tempest-TaggedAttachmentsTest-702494535 None] Lock "cinder-c5c171fc-2601-4fff-bfe5-dd82f67399b7-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:29:21 devstack sudo[89550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b Nov 03 07:29:21 devstack sudo[89550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:21 devstack sudo[89550]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9791392d-6345-4872-9109-aa052edaab3b tempest-SnapshotsActionsTest-605153189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b" returned: 0 in 0.465s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:21 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-9791392d-6345-4872-9109-aa052edaab3b tempest-SnapshotsActionsTest-605153189 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:29:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9791392d-6345-4872-9109-aa052edaab3b tempest-SnapshotsActionsTest-605153189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.f4dec03e-54dc-4de0-aa09-f6a03ba025b3 1G {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:21 devstack sudo[89562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.f4dec03e-54dc-4de0-aa09-f6a03ba025b3 1G Nov 03 07:29:21 devstack sudo[89562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:22 devstack sudo[89562]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9791392d-6345-4872-9109-aa052edaab3b tempest-SnapshotsActionsTest-605153189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.f4dec03e-54dc-4de0-aa09-f6a03ba025b3 1G" returned: 0 in 0.682s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9791392d-6345-4872-9109-aa052edaab3b tempest-SnapshotsActionsTest-605153189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.f4dec03e-54dc-4de0-aa09-f6a03ba025b3 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:22 devstack sudo[89572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.f4dec03e-54dc-4de0-aa09-f6a03ba025b3 Nov 03 07:29:22 devstack sudo[89572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:22 devstack sudo[89572]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9791392d-6345-4872-9109-aa052edaab3b tempest-SnapshotsActionsTest-605153189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.f4dec03e-54dc-4de0-aa09-f6a03ba025b3" returned: 0 in 0.367s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:22 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-9791392d-6345-4872-9109-aa052edaab3b tempest-SnapshotsActionsTest-605153189 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.f4dec03e-54dc-4de0-aa09-f6a03ba025b3 is being set with open permissions: ugo+rw Nov 03 07:29:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9791392d-6345-4872-9109-aa052edaab3b tempest-SnapshotsActionsTest-605153189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.f4dec03e-54dc-4de0-aa09-f6a03ba025b3 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:22 devstack sudo[89578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.f4dec03e-54dc-4de0-aa09-f6a03ba025b3 Nov 03 07:29:22 devstack sudo[89578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:22 devstack sudo[89578]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9791392d-6345-4872-9109-aa052edaab3b tempest-SnapshotsActionsTest-605153189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.f4dec03e-54dc-4de0-aa09-f6a03ba025b3" returned: 0 in 0.266s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-9791392d-6345-4872-9109-aa052edaab3b tempest-SnapshotsActionsTest-605153189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.926s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:29:22 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-9791392d-6345-4872-9109-aa052edaab3b tempest-SnapshotsActionsTest-605153189 None] Create snapshot completed successfully Nov 03 07:29:23 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-068abc30-6c23-40ad-bdc8-75355ea77918 tempest-SnapshotsActionsTest-1936808486 None] Acquiring lock "cinder-f4dec03e-54dc-4de0-aa09-f6a03ba025b3-delete_snapshot" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:29:23 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-068abc30-6c23-40ad-bdc8-75355ea77918 tempest-SnapshotsActionsTest-1936808486 None] Lock "cinder-f4dec03e-54dc-4de0-aa09-f6a03ba025b3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:29:23 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-068abc30-6c23-40ad-bdc8-75355ea77918 tempest-SnapshotsActionsTest-1936808486 None] Acquiring lock "cinder-quobyte-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:29:23 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-068abc30-6c23-40ad-bdc8-75355ea77918 tempest-SnapshotsActionsTest-1936808486 None] Lock "cinder-quobyte-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:29:23 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-068abc30-6c23-40ad-bdc8-75355ea77918 tempest-SnapshotsActionsTest-1936808486 None] Acquiring lock "cinder-quobyte-f4dec03e-54dc-4de0-aa09-f6a03ba025b3" by "_delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:29:23 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-068abc30-6c23-40ad-bdc8-75355ea77918 tempest-SnapshotsActionsTest-1936808486 None] Lock "cinder-quobyte-f4dec03e-54dc-4de0-aa09-f6a03ba025b3" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:29:23 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-068abc30-6c23-40ad-bdc8-75355ea77918 tempest-SnapshotsActionsTest-1936808486 None] Deleting offline snapshot f4dec03e-54dc-4de0-aa09-f6a03ba025b3 of volume 35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:29:23 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-068abc30-6c23-40ad-bdc8-75355ea77918 tempest-SnapshotsActionsTest-1936808486 None] snapshot_file for this snap is: volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.f4dec03e-54dc-4de0-aa09-f6a03ba025b3 {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:29:23 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[6032ba22-dc57-42b8-a7e7-63b3b2788e22]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:29:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-068abc30-6c23-40ad-bdc8-75355ea77918 tempest-SnapshotsActionsTest-1936808486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.f4dec03e-54dc-4de0-aa09-f6a03ba025b3 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:23 devstack sudo[89586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.f4dec03e-54dc-4de0-aa09-f6a03ba025b3 Nov 03 07:29:23 devstack sudo[89586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:23 devstack sudo[89586]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-068abc30-6c23-40ad-bdc8-75355ea77918 tempest-SnapshotsActionsTest-1936808486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.f4dec03e-54dc-4de0-aa09-f6a03ba025b3" returned: 0 in 0.461s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:23 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-068abc30-6c23-40ad-bdc8-75355ea77918 tempest-SnapshotsActionsTest-1936808486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:29:23 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5d7429-22ee-4a54-bb59-a620aac56c4f]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:29:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-068abc30-6c23-40ad-bdc8-75355ea77918 tempest-SnapshotsActionsTest-1936808486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:24 devstack sudo[89591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b Nov 03 07:29:24 devstack sudo[89591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:24 devstack sudo[89591]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-068abc30-6c23-40ad-bdc8-75355ea77918 tempest-SnapshotsActionsTest-1936808486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b" returned: 0 in 0.569s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:24 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-068abc30-6c23-40ad-bdc8-75355ea77918 tempest-SnapshotsActionsTest-1936808486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:29:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-068abc30-6c23-40ad-bdc8-75355ea77918 tempest-SnapshotsActionsTest-1936808486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.f4dec03e-54dc-4de0-aa09-f6a03ba025b3 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:24 devstack sudo[89599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.f4dec03e-54dc-4de0-aa09-f6a03ba025b3 Nov 03 07:29:24 devstack sudo[89599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:24 devstack sudo[89599]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-068abc30-6c23-40ad-bdc8-75355ea77918 tempest-SnapshotsActionsTest-1936808486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.f4dec03e-54dc-4de0-aa09-f6a03ba025b3" returned: 0 in 0.547s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-068abc30-6c23-40ad-bdc8-75355ea77918 tempest-SnapshotsActionsTest-1936808486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.f4dec03e-54dc-4de0-aa09-f6a03ba025b3 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:25 devstack sudo[89608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.f4dec03e-54dc-4de0-aa09-f6a03ba025b3 Nov 03 07:29:25 devstack sudo[89608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:25 devstack sudo[89608]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-068abc30-6c23-40ad-bdc8-75355ea77918 tempest-SnapshotsActionsTest-1936808486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.f4dec03e-54dc-4de0-aa09-f6a03ba025b3" returned: 0 in 0.302s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:25 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-068abc30-6c23-40ad-bdc8-75355ea77918 tempest-SnapshotsActionsTest-1936808486 None] Lock "cinder-quobyte-f4dec03e-54dc-4de0-aa09-f6a03ba025b3" released by "_delete_snapshot" :: held 2.064s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:29:25 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-068abc30-6c23-40ad-bdc8-75355ea77918 tempest-SnapshotsActionsTest-1936808486 None] Lock "cinder-quobyte-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe" released by "delete_snapshot" :: held 2.102s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:29:25 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-068abc30-6c23-40ad-bdc8-75355ea77918 tempest-SnapshotsActionsTest-1936808486 None] Created reservations ['80e8c08c-a112-4657-9d71-c4ff253933d9', 'af9a83b1-90b9-4116-bb24-e2625aafcba5', 'fa061e91-23d5-4946-a472-7540cba93f69', '4018e9be-eacf-46f3-a49f-7a1941337bb0'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:29:25 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-068abc30-6c23-40ad-bdc8-75355ea77918 tempest-SnapshotsActionsTest-1936808486 None] Delete snapshot completed successfully. Nov 03 07:29:25 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-068abc30-6c23-40ad-bdc8-75355ea77918 tempest-SnapshotsActionsTest-1936808486 None] Lock "cinder-f4dec03e-54dc-4de0-aa09-f6a03ba025b3-delete_snapshot" released by "delete_snapshot" :: held 2.327s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:29:26 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-ab595c7f-6881-4954-83dd-39b3d1f65a12 tempest-SnapshotsActionsTest-605153189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:29:26 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-ab595c7f-6881-4954-83dd-39b3d1f65a12 tempest-SnapshotsActionsTest-605153189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:29:26 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-ab595c7f-6881-4954-83dd-39b3d1f65a12 tempest-SnapshotsActionsTest-605153189 None] Creating offline snapshot de5bba43-bc37-470b-b99e-5173a7d11fb1 of volume 35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe {{(pid=86875) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:29:27 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[201805e8-5f1c-455b-98be-d607745ccfdb]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:29:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ab595c7f-6881-4954-83dd-39b3d1f65a12 tempest-SnapshotsActionsTest-605153189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:27 devstack sudo[89629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b Nov 03 07:29:27 devstack sudo[89629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:27 devstack sudo[89629]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ab595c7f-6881-4954-83dd-39b3d1f65a12 tempest-SnapshotsActionsTest-605153189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b" returned: 0 in 0.555s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:27 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-ab595c7f-6881-4954-83dd-39b3d1f65a12 tempest-SnapshotsActionsTest-605153189 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:29:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ab595c7f-6881-4954-83dd-39b3d1f65a12 tempest-SnapshotsActionsTest-605153189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.de5bba43-bc37-470b-b99e-5173a7d11fb1 1G {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:27 devstack sudo[89636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.de5bba43-bc37-470b-b99e-5173a7d11fb1 1G Nov 03 07:29:27 devstack sudo[89636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:28 devstack sudo[89636]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ab595c7f-6881-4954-83dd-39b3d1f65a12 tempest-SnapshotsActionsTest-605153189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.de5bba43-bc37-470b-b99e-5173a7d11fb1 1G" returned: 0 in 0.688s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ab595c7f-6881-4954-83dd-39b3d1f65a12 tempest-SnapshotsActionsTest-605153189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.de5bba43-bc37-470b-b99e-5173a7d11fb1 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:28 devstack sudo[89643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.de5bba43-bc37-470b-b99e-5173a7d11fb1 Nov 03 07:29:28 devstack sudo[89643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:28 devstack sudo[89643]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ab595c7f-6881-4954-83dd-39b3d1f65a12 tempest-SnapshotsActionsTest-605153189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.de5bba43-bc37-470b-b99e-5173a7d11fb1" returned: 0 in 0.367s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:28 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-ab595c7f-6881-4954-83dd-39b3d1f65a12 tempest-SnapshotsActionsTest-605153189 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.de5bba43-bc37-470b-b99e-5173a7d11fb1 is being set with open permissions: ugo+rw Nov 03 07:29:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ab595c7f-6881-4954-83dd-39b3d1f65a12 tempest-SnapshotsActionsTest-605153189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.de5bba43-bc37-470b-b99e-5173a7d11fb1 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:28 devstack sudo[89648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.de5bba43-bc37-470b-b99e-5173a7d11fb1 Nov 03 07:29:28 devstack sudo[89648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:29 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-d397d9f8-b999-4740-9a27-d49e34157c22 tempest-ServerActionsTestOtherA-1944466382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:29:29 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d397d9f8-b999-4740-9a27-d49e34157c22 tempest-ServerActionsTestOtherA-1944466382 None] Flow 'volume_create_manager' (5acf488e-2136-4db1-8085-4de3309f8ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:29:29 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d397d9f8-b999-4740-9a27-d49e34157c22 tempest-ServerActionsTestOtherA-1944466382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1a1bcbe-d83f-4f83-bc59-7dde99538d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:29:29 devstack sudo[89648]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:29 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d397d9f8-b999-4740-9a27-d49e34157c22 tempest-ServerActionsTestOtherA-1944466382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1a1bcbe-d83f-4f83-bc59-7dde99538d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:29:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-299068799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cedef2e-36c7-41b1-b810-af924a9eb4ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c173927b332e4eb49c8016ba08236532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:29:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:29:29Z,use_quota=True,user_id='16ad853cf9a64a4fb504caee736c1fb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:29:29 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d397d9f8-b999-4740-9a27-d49e34157c22 tempest-ServerActionsTestOtherA-1944466382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13bd93b2-36f3-4afd-a6b7-a334cc77aca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:29:29 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d397d9f8-b999-4740-9a27-d49e34157c22 tempest-ServerActionsTestOtherA-1944466382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13bd93b2-36f3-4afd-a6b7-a334cc77aca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:29:29 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d397d9f8-b999-4740-9a27-d49e34157c22 tempest-ServerActionsTestOtherA-1944466382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d770363-1a00-4f8b-82b3-d4514cf6676e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:29:29 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d397d9f8-b999-4740-9a27-d49e34157c22 tempest-ServerActionsTestOtherA-1944466382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d770363-1a00-4f8b-82b3-d4514cf6676e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cedef2e-36c7-41b1-b810-af924a9eb4ec', 'volume_name': 'volume-2cedef2e-36c7-41b1-b810-af924a9eb4ec', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:29:29 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d397d9f8-b999-4740-9a27-d49e34157c22 tempest-ServerActionsTestOtherA-1944466382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10381a4c-ff8c-4de3-ab30-b474f68b0f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:29:29 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d397d9f8-b999-4740-9a27-d49e34157c22 tempest-ServerActionsTestOtherA-1944466382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10381a4c-ff8c-4de3-ab30-b474f68b0f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:29:29 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d397d9f8-b999-4740-9a27-d49e34157c22 tempest-ServerActionsTestOtherA-1944466382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (435403b1-d497-436b-a60c-d5d9305593ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:29:29 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-d397d9f8-b999-4740-9a27-d49e34157c22 tempest-ServerActionsTestOtherA-1944466382 None] Volume 2cedef2e-36c7-41b1-b810-af924a9eb4ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cedef2e-36c7-41b1-b810-af924a9eb4ec', 'volume_size': 1} Nov 03 07:29:29 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-d397d9f8-b999-4740-9a27-d49e34157c22 tempest-ServerActionsTestOtherA-1944466382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:29:29 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ab595c7f-6881-4954-83dd-39b3d1f65a12 tempest-SnapshotsActionsTest-605153189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.de5bba43-bc37-470b-b99e-5173a7d11fb1" returned: 0 in 0.815s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:29 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-ab595c7f-6881-4954-83dd-39b3d1f65a12 tempest-SnapshotsActionsTest-605153189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.613s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:29:29 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-d397d9f8-b999-4740-9a27-d49e34157c22 tempest-ServerActionsTestOtherA-1944466382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.101s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:29:29 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-d397d9f8-b999-4740-9a27-d49e34157c22 tempest-ServerActionsTestOtherA-1944466382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:29:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-299068799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cedef2e-36c7-41b1-b810-af924a9eb4ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c173927b332e4eb49c8016ba08236532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:29:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:29:29Z,use_quota=True,user_id='16ad853cf9a64a4fb504caee736c1fb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:29:29 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-d397d9f8-b999-4740-9a27-d49e34157c22 tempest-ServerActionsTestOtherA-1944466382 None] Creating volume 2cedef2e-36c7-41b1-b810-af924a9eb4ec {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:29:29 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-d397d9f8-b999-4740-9a27-d49e34157c22 tempest-ServerActionsTestOtherA-1944466382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:29:29 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-d397d9f8-b999-4740-9a27-d49e34157c22 tempest-ServerActionsTestOtherA-1944466382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:29:29 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-d397d9f8-b999-4740-9a27-d49e34157c22 tempest-ServerActionsTestOtherA-1944466382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:29:29 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-d397d9f8-b999-4740-9a27-d49e34157c22 tempest-ServerActionsTestOtherA-1944466382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:29:29 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-d397d9f8-b999-4740-9a27-d49e34157c22 tempest-ServerActionsTestOtherA-1944466382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:29:29 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-d397d9f8-b999-4740-9a27-d49e34157c22 tempest-ServerActionsTestOtherA-1944466382 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:29:29 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-d397d9f8-b999-4740-9a27-d49e34157c22 tempest-ServerActionsTestOtherA-1944466382 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:29:29 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d397d9f8-b999-4740-9a27-d49e34157c22 tempest-ServerActionsTestOtherA-1944466382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2cedef2e-36c7-41b1-b810-af924a9eb4ec 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:29 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-ab595c7f-6881-4954-83dd-39b3d1f65a12 tempest-SnapshotsActionsTest-605153189 None] Create snapshot completed successfully Nov 03 07:29:29 devstack sudo[89692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2cedef2e-36c7-41b1-b810-af924a9eb4ec 1073741824 Nov 03 07:29:29 devstack sudo[89692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:30 devstack sudo[89692]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d397d9f8-b999-4740-9a27-d49e34157c22 tempest-ServerActionsTestOtherA-1944466382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2cedef2e-36c7-41b1-b810-af924a9eb4ec 1073741824" returned: 0 in 0.879s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:30 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-41acef1b-3b98-4e36-bb7f-1b4c608d0a46 tempest-SnapshotsActionsTest-1936808486 None] Acquiring lock "cinder-de5bba43-bc37-470b-b99e-5173a7d11fb1-delete_snapshot" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:29:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d397d9f8-b999-4740-9a27-d49e34157c22 tempest-ServerActionsTestOtherA-1944466382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2cedef2e-36c7-41b1-b810-af924a9eb4ec {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:30 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-41acef1b-3b98-4e36-bb7f-1b4c608d0a46 tempest-SnapshotsActionsTest-1936808486 None] Lock "cinder-de5bba43-bc37-470b-b99e-5173a7d11fb1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.070s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:29:30 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-41acef1b-3b98-4e36-bb7f-1b4c608d0a46 tempest-SnapshotsActionsTest-1936808486 None] Acquiring lock "cinder-quobyte-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:29:30 devstack sudo[89727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2cedef2e-36c7-41b1-b810-af924a9eb4ec Nov 03 07:29:30 devstack sudo[89727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:30 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-41acef1b-3b98-4e36-bb7f-1b4c608d0a46 tempest-SnapshotsActionsTest-1936808486 None] Lock "cinder-quobyte-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:29:30 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-41acef1b-3b98-4e36-bb7f-1b4c608d0a46 tempest-SnapshotsActionsTest-1936808486 None] Acquiring lock "cinder-quobyte-de5bba43-bc37-470b-b99e-5173a7d11fb1" by "_delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:29:30 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-41acef1b-3b98-4e36-bb7f-1b4c608d0a46 tempest-SnapshotsActionsTest-1936808486 None] Lock "cinder-quobyte-de5bba43-bc37-470b-b99e-5173a7d11fb1" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:29:30 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-41acef1b-3b98-4e36-bb7f-1b4c608d0a46 tempest-SnapshotsActionsTest-1936808486 None] Deleting offline snapshot de5bba43-bc37-470b-b99e-5173a7d11fb1 of volume 35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:29:30 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-41acef1b-3b98-4e36-bb7f-1b4c608d0a46 tempest-SnapshotsActionsTest-1936808486 None] snapshot_file for this snap is: volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.de5bba43-bc37-470b-b99e-5173a7d11fb1 {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:29:30 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e074a96-554b-4c34-a04e-ee58251b17cb]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:29:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-41acef1b-3b98-4e36-bb7f-1b4c608d0a46 tempest-SnapshotsActionsTest-1936808486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.de5bba43-bc37-470b-b99e-5173a7d11fb1 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:30 devstack sudo[89727]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d397d9f8-b999-4740-9a27-d49e34157c22 tempest-ServerActionsTestOtherA-1944466382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2cedef2e-36c7-41b1-b810-af924a9eb4ec" returned: 0 in 0.379s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:30 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-d397d9f8-b999-4740-9a27-d49e34157c22 tempest-ServerActionsTestOtherA-1944466382 None] <== create_volume: return (1380ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:29:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-d397d9f8-b999-4740-9a27-d49e34157c22 tempest-ServerActionsTestOtherA-1944466382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.384s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:29:30 devstack sudo[89729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.de5bba43-bc37-470b-b99e-5173a7d11fb1 Nov 03 07:29:30 devstack sudo[89729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:31 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d397d9f8-b999-4740-9a27-d49e34157c22 tempest-ServerActionsTestOtherA-1944466382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (435403b1-d497-436b-a60c-d5d9305593ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cedef2e-36c7-41b1-b810-af924a9eb4ec', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:29:31 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d397d9f8-b999-4740-9a27-d49e34157c22 tempest-ServerActionsTestOtherA-1944466382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (680f8a65-8300-447c-b34e-e3602ef3a09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:29:31 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-d397d9f8-b999-4740-9a27-d49e34157c22 tempest-ServerActionsTestOtherA-1944466382 None] Volume volume-2cedef2e-36c7-41b1-b810-af924a9eb4ec (2cedef2e-36c7-41b1-b810-af924a9eb4ec): created successfully Nov 03 07:29:31 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d397d9f8-b999-4740-9a27-d49e34157c22 tempest-ServerActionsTestOtherA-1944466382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (680f8a65-8300-447c-b34e-e3602ef3a09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:29:31 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d397d9f8-b999-4740-9a27-d49e34157c22 tempest-ServerActionsTestOtherA-1944466382 None] Flow 'volume_create_manager' (5acf488e-2136-4db1-8085-4de3309f8ec6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:29:31 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-d397d9f8-b999-4740-9a27-d49e34157c22 tempest-ServerActionsTestOtherA-1944466382 None] Created volume successfully. Nov 03 07:29:31 devstack sudo[89729]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-41acef1b-3b98-4e36-bb7f-1b4c608d0a46 tempest-SnapshotsActionsTest-1936808486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.de5bba43-bc37-470b-b99e-5173a7d11fb1" returned: 0 in 0.631s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:31 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-41acef1b-3b98-4e36-bb7f-1b4c608d0a46 tempest-SnapshotsActionsTest-1936808486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:29:31 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b161209-022b-4122-94df-b9c74dc64e2b]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:29:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-41acef1b-3b98-4e36-bb7f-1b4c608d0a46 tempest-SnapshotsActionsTest-1936808486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:31 devstack sudo[89739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b Nov 03 07:29:31 devstack sudo[89739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:32 devstack sudo[89739]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:32 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-41acef1b-3b98-4e36-bb7f-1b4c608d0a46 tempest-SnapshotsActionsTest-1936808486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b" returned: 0 in 0.614s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:32 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-41acef1b-3b98-4e36-bb7f-1b4c608d0a46 tempest-SnapshotsActionsTest-1936808486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:29:32 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-41acef1b-3b98-4e36-bb7f-1b4c608d0a46 tempest-SnapshotsActionsTest-1936808486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.de5bba43-bc37-470b-b99e-5173a7d11fb1 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:32 devstack sudo[89745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.de5bba43-bc37-470b-b99e-5173a7d11fb1 Nov 03 07:29:32 devstack sudo[89745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:32 devstack sudo[89745]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:32 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-41acef1b-3b98-4e36-bb7f-1b4c608d0a46 tempest-SnapshotsActionsTest-1936808486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.de5bba43-bc37-470b-b99e-5173a7d11fb1" returned: 0 in 0.630s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:32 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-41acef1b-3b98-4e36-bb7f-1b4c608d0a46 tempest-SnapshotsActionsTest-1936808486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.de5bba43-bc37-470b-b99e-5173a7d11fb1 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:32 devstack sudo[89751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.de5bba43-bc37-470b-b99e-5173a7d11fb1 Nov 03 07:29:32 devstack sudo[89751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:33 devstack sudo[89751]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-41acef1b-3b98-4e36-bb7f-1b4c608d0a46 tempest-SnapshotsActionsTest-1936808486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.de5bba43-bc37-470b-b99e-5173a7d11fb1" returned: 0 in 0.564s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:33 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-41acef1b-3b98-4e36-bb7f-1b4c608d0a46 tempest-SnapshotsActionsTest-1936808486 None] Lock "cinder-quobyte-de5bba43-bc37-470b-b99e-5173a7d11fb1" released by "_delete_snapshot" :: held 2.631s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:29:33 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-41acef1b-3b98-4e36-bb7f-1b4c608d0a46 tempest-SnapshotsActionsTest-1936808486 None] Lock "cinder-quobyte-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe" released by "delete_snapshot" :: held 2.684s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:29:33 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-41acef1b-3b98-4e36-bb7f-1b4c608d0a46 tempest-SnapshotsActionsTest-1936808486 None] Created reservations ['b097991e-bf78-4458-8ef9-7f9334b89cb0', 'aca992be-cee1-4092-b448-2269e4785226', 'f2873c9f-b7be-4f03-a930-689fff26aa52', '0019d4d4-756b-41e9-b042-93df655842e2'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:29:33 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-41acef1b-3b98-4e36-bb7f-1b4c608d0a46 tempest-SnapshotsActionsTest-1936808486 None] Delete snapshot completed successfully. Nov 03 07:29:33 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-41acef1b-3b98-4e36-bb7f-1b4c608d0a46 tempest-SnapshotsActionsTest-1936808486 None] Lock "cinder-de5bba43-bc37-470b-b99e-5173a7d11fb1-delete_snapshot" released by "delete_snapshot" :: held 2.923s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:29:34 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-e5074f5a-9809-4464-910c-a0678fe985bb tempest-SnapshotsActionsTest-605153189 None] Acquiring lock "cinder-fe94783c-60b2-4c8a-b1f5-0594fca2737b-delete_snapshot" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:29:35 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-e5074f5a-9809-4464-910c-a0678fe985bb tempest-SnapshotsActionsTest-605153189 None] Lock "cinder-fe94783c-60b2-4c8a-b1f5-0594fca2737b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:29:35 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-e5074f5a-9809-4464-910c-a0678fe985bb tempest-SnapshotsActionsTest-605153189 None] Acquiring lock "cinder-quobyte-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:29:35 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-e5074f5a-9809-4464-910c-a0678fe985bb tempest-SnapshotsActionsTest-605153189 None] Lock "cinder-quobyte-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:29:35 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-e5074f5a-9809-4464-910c-a0678fe985bb tempest-SnapshotsActionsTest-605153189 None] Acquiring lock "cinder-quobyte-fe94783c-60b2-4c8a-b1f5-0594fca2737b" by "_delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:29:35 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-e5074f5a-9809-4464-910c-a0678fe985bb tempest-SnapshotsActionsTest-605153189 None] Lock "cinder-quobyte-fe94783c-60b2-4c8a-b1f5-0594fca2737b" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:29:35 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-e5074f5a-9809-4464-910c-a0678fe985bb tempest-SnapshotsActionsTest-605153189 None] Deleting offline snapshot fe94783c-60b2-4c8a-b1f5-0594fca2737b of volume 35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:29:35 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-e5074f5a-9809-4464-910c-a0678fe985bb tempest-SnapshotsActionsTest-605153189 None] snapshot_file for this snap is: volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:29:35 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7b4ba4-260d-4cdf-b3ab-8dba82f26e16]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:29:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e5074f5a-9809-4464-910c-a0678fe985bb tempest-SnapshotsActionsTest-605153189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:35 devstack sudo[89755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b Nov 03 07:29:35 devstack sudo[89755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:35 devstack sudo[89755]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e5074f5a-9809-4464-910c-a0678fe985bb tempest-SnapshotsActionsTest-605153189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b" returned: 0 in 0.488s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:35 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-e5074f5a-9809-4464-910c-a0678fe985bb tempest-SnapshotsActionsTest-605153189 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:29:35 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d261206-95ad-4605-92a0-4d51671db217]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:29:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e5074f5a-9809-4464-910c-a0678fe985bb tempest-SnapshotsActionsTest-605153189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:35 devstack sudo[89761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe Nov 03 07:29:35 devstack sudo[89761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:36 devstack sudo[89761]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:36 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e5074f5a-9809-4464-910c-a0678fe985bb tempest-SnapshotsActionsTest-605153189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe" returned: 0 in 0.585s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:36 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e5074f5a-9809-4464-910c-a0678fe985bb tempest-SnapshotsActionsTest-605153189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:36 devstack sudo[89768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b Nov 03 07:29:36 devstack sudo[89768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:36 devstack sudo[89768]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:36 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e5074f5a-9809-4464-910c-a0678fe985bb tempest-SnapshotsActionsTest-605153189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b" returned: 0 in 0.681s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:36 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e5074f5a-9809-4464-910c-a0678fe985bb tempest-SnapshotsActionsTest-605153189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:37 devstack sudo[89782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b Nov 03 07:29:37 devstack sudo[89782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:37 devstack sudo[89782]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e5074f5a-9809-4464-910c-a0678fe985bb tempest-SnapshotsActionsTest-605153189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe.fe94783c-60b2-4c8a-b1f5-0594fca2737b" returned: 0 in 0.374s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:37 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-e5074f5a-9809-4464-910c-a0678fe985bb tempest-SnapshotsActionsTest-605153189 None] Lock "cinder-quobyte-fe94783c-60b2-4c8a-b1f5-0594fca2737b" released by "_delete_snapshot" :: held 2.337s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:29:37 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-e5074f5a-9809-4464-910c-a0678fe985bb tempest-SnapshotsActionsTest-605153189 None] Lock "cinder-quobyte-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe" released by "delete_snapshot" :: held 2.398s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:29:37 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-e5074f5a-9809-4464-910c-a0678fe985bb tempest-SnapshotsActionsTest-605153189 None] Created reservations ['e62d3f5a-1c80-482b-a562-a32ed6148a41', '37d9f423-f3cc-44ef-9807-89ba171602b1', 'fd2269e5-27b6-49f4-87bc-3f51e1a451a3', 'd6334ac0-1d54-4a88-b823-97b5b9ef3bc6'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:29:37 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-e5074f5a-9809-4464-910c-a0678fe985bb tempest-SnapshotsActionsTest-605153189 None] Delete snapshot completed successfully. Nov 03 07:29:37 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-e5074f5a-9809-4464-910c-a0678fe985bb tempest-SnapshotsActionsTest-605153189 None] Lock "cinder-fe94783c-60b2-4c8a-b1f5-0594fca2737b-delete_snapshot" released by "delete_snapshot" :: held 2.758s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:29:38 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-8f0f7572-fd17-4d13-9af5-79fc49fe7790 tempest-SnapshotsActionsTest-605153189 None] Acquiring lock "cinder-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:29:38 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-8f0f7572-fd17-4d13-9af5-79fc49fe7790 tempest-SnapshotsActionsTest-605153189 None] Lock "cinder-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:29:38 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-8f0f7572-fd17-4d13-9af5-79fc49fe7790 tempest-SnapshotsActionsTest-605153189 None] Acquiring lock "cinder-quobyte-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:29:38 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-8f0f7572-fd17-4d13-9af5-79fc49fe7790 tempest-SnapshotsActionsTest-605153189 None] Lock "cinder-quobyte-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe" acquired by "delete_volume" :: waited 0.027s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:29:38 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[47cb1d57-42f2-49b0-b99a-370c5cd97e6b]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:29:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8f0f7572-fd17-4d13-9af5-79fc49fe7790 tempest-SnapshotsActionsTest-605153189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:38 devstack sudo[89788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe Nov 03 07:29:38 devstack sudo[89788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:39 devstack sudo[89788]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8f0f7572-fd17-4d13-9af5-79fc49fe7790 tempest-SnapshotsActionsTest-605153189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe" returned: 0 in 0.784s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8f0f7572-fd17-4d13-9af5-79fc49fe7790 tempest-SnapshotsActionsTest-605153189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:39 devstack sudo[89795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe Nov 03 07:29:39 devstack sudo[89795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:39 devstack sudo[89795]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8f0f7572-fd17-4d13-9af5-79fc49fe7790 tempest-SnapshotsActionsTest-605153189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe" returned: 0 in 0.483s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:39 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-8f0f7572-fd17-4d13-9af5-79fc49fe7790 tempest-SnapshotsActionsTest-605153189 None] Lock "cinder-quobyte-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe" released by "delete_volume" :: held 1.398s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:29:39 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-8f0f7572-fd17-4d13-9af5-79fc49fe7790 tempest-SnapshotsActionsTest-605153189 None] Created reservations ['ca44da7a-1505-4852-abac-8f93e228fd6c', '72440ad8-5ea6-4355-843e-567417e808b9', '1850596e-da23-4c33-9996-f45121e44c59', '85aa8e84-9c12-4403-941b-9e6511f423be'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:29:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-8f0f7572-fd17-4d13-9af5-79fc49fe7790 tempest-SnapshotsActionsTest-605153189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:29:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-8f0f7572-fd17-4d13-9af5-79fc49fe7790 tempest-SnapshotsActionsTest-605153189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:29:40 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-8f0f7572-fd17-4d13-9af5-79fc49fe7790 tempest-SnapshotsActionsTest-605153189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:29:40 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-8f0f7572-fd17-4d13-9af5-79fc49fe7790 tempest-SnapshotsActionsTest-605153189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:29:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-8f0f7572-fd17-4d13-9af5-79fc49fe7790 tempest-SnapshotsActionsTest-605153189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:29:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8f0f7572-fd17-4d13-9af5-79fc49fe7790 tempest-SnapshotsActionsTest-605153189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:40 devstack sudo[89811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:29:40 devstack sudo[89811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:40 devstack sudo[89811]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8f0f7572-fd17-4d13-9af5-79fc49fe7790 tempest-SnapshotsActionsTest-605153189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.374s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:40 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-8f0f7572-fd17-4d13-9af5-79fc49fe7790 tempest-SnapshotsActionsTest-605153189 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:29:40 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-8f0f7572-fd17-4d13-9af5-79fc49fe7790 tempest-SnapshotsActionsTest-605153189 None] Deleted volume successfully. Nov 03 07:29:40 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-8f0f7572-fd17-4d13-9af5-79fc49fe7790 tempest-SnapshotsActionsTest-605153189 None] Lock "cinder-35751c04-e2fd-48f8-8e81-e0cb5cdbdcbe-delete_volume" released by "delete_volume" :: held 2.255s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:29:43 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [req-6c41d05c-709c-400e-9bb2-6840e16d7fcd req-e9ac3dee-28ca-4861-a0f0-5b314d8eb929 tempest-VolumesGetTestJSON-1225808883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:29:44 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-6c41d05c-709c-400e-9bb2-6840e16d7fcd req-e9ac3dee-28ca-4861-a0f0-5b314d8eb929 tempest-VolumesGetTestJSON-1225808883 None] Flow 'volume_create_manager' (3ce2167b-4e9d-4e1a-93d0-1157e4c4ed37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:29:44 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-6c41d05c-709c-400e-9bb2-6840e16d7fcd req-e9ac3dee-28ca-4861-a0f0-5b314d8eb929 tempest-VolumesGetTestJSON-1225808883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72b042b8-4b93-4212-846c-56c0fa302333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:29:44 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-6c41d05c-709c-400e-9bb2-6840e16d7fcd req-e9ac3dee-28ca-4861-a0f0-5b314d8eb929 tempest-VolumesGetTestJSON-1225808883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72b042b8-4b93-4212-846c-56c0fa302333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:29:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1750550957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c77cdbe4-db26-4ba7-84f5-f883c0806099,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ccd6b87e62174bcfa6250ef4b99e9ffd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:29:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:29:44Z,use_quota=True,user_id='a36b458e905e4624bbacefff4bcb0a86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:29:44 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-6c41d05c-709c-400e-9bb2-6840e16d7fcd req-e9ac3dee-28ca-4861-a0f0-5b314d8eb929 tempest-VolumesGetTestJSON-1225808883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (351f7227-49e6-43c1-8aea-639f2d22e128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:29:44 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-6c41d05c-709c-400e-9bb2-6840e16d7fcd req-e9ac3dee-28ca-4861-a0f0-5b314d8eb929 tempest-VolumesGetTestJSON-1225808883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (351f7227-49e6-43c1-8aea-639f2d22e128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:29:44 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-6c41d05c-709c-400e-9bb2-6840e16d7fcd req-e9ac3dee-28ca-4861-a0f0-5b314d8eb929 tempest-VolumesGetTestJSON-1225808883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fef3a2dd-0369-43dd-8919-e8a47de0141a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:29:44 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-6c41d05c-709c-400e-9bb2-6840e16d7fcd req-e9ac3dee-28ca-4861-a0f0-5b314d8eb929 tempest-VolumesGetTestJSON-1225808883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fef3a2dd-0369-43dd-8919-e8a47de0141a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c77cdbe4-db26-4ba7-84f5-f883c0806099', 'volume_name': 'volume-c77cdbe4-db26-4ba7-84f5-f883c0806099', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:29:44 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-6c41d05c-709c-400e-9bb2-6840e16d7fcd req-e9ac3dee-28ca-4861-a0f0-5b314d8eb929 tempest-VolumesGetTestJSON-1225808883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f145ecb6-8dcf-415c-8c2f-75ad2fed7495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:29:44 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-6c41d05c-709c-400e-9bb2-6840e16d7fcd req-e9ac3dee-28ca-4861-a0f0-5b314d8eb929 tempest-VolumesGetTestJSON-1225808883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f145ecb6-8dcf-415c-8c2f-75ad2fed7495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:29:44 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-6c41d05c-709c-400e-9bb2-6840e16d7fcd req-e9ac3dee-28ca-4861-a0f0-5b314d8eb929 tempest-VolumesGetTestJSON-1225808883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (235fed2a-3d75-40ed-9044-1b068cff74d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:29:44 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [req-6c41d05c-709c-400e-9bb2-6840e16d7fcd req-e9ac3dee-28ca-4861-a0f0-5b314d8eb929 tempest-VolumesGetTestJSON-1225808883 None] Volume c77cdbe4-db26-4ba7-84f5-f883c0806099: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c77cdbe4-db26-4ba7-84f5-f883c0806099', 'volume_size': 1} Nov 03 07:29:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-6c41d05c-709c-400e-9bb2-6840e16d7fcd req-e9ac3dee-28ca-4861-a0f0-5b314d8eb929 tempest-VolumesGetTestJSON-1225808883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:29:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-6c41d05c-709c-400e-9bb2-6840e16d7fcd req-e9ac3dee-28ca-4861-a0f0-5b314d8eb929 tempest-VolumesGetTestJSON-1225808883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:29:44 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [req-6c41d05c-709c-400e-9bb2-6840e16d7fcd req-e9ac3dee-28ca-4861-a0f0-5b314d8eb929 tempest-VolumesGetTestJSON-1225808883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:29:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1750550957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c77cdbe4-db26-4ba7-84f5-f883c0806099,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ccd6b87e62174bcfa6250ef4b99e9ffd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:29:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:29:44Z,use_quota=True,user_id='a36b458e905e4624bbacefff4bcb0a86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:29:44 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [req-6c41d05c-709c-400e-9bb2-6840e16d7fcd req-e9ac3dee-28ca-4861-a0f0-5b314d8eb929 tempest-VolumesGetTestJSON-1225808883 None] Creating volume c77cdbe4-db26-4ba7-84f5-f883c0806099 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:29:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-6c41d05c-709c-400e-9bb2-6840e16d7fcd req-e9ac3dee-28ca-4861-a0f0-5b314d8eb929 tempest-VolumesGetTestJSON-1225808883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:29:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-6c41d05c-709c-400e-9bb2-6840e16d7fcd req-e9ac3dee-28ca-4861-a0f0-5b314d8eb929 tempest-VolumesGetTestJSON-1225808883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:29:44 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [req-6c41d05c-709c-400e-9bb2-6840e16d7fcd req-e9ac3dee-28ca-4861-a0f0-5b314d8eb929 tempest-VolumesGetTestJSON-1225808883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:29:44 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [req-6c41d05c-709c-400e-9bb2-6840e16d7fcd req-e9ac3dee-28ca-4861-a0f0-5b314d8eb929 tempest-VolumesGetTestJSON-1225808883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:29:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-6c41d05c-709c-400e-9bb2-6840e16d7fcd req-e9ac3dee-28ca-4861-a0f0-5b314d8eb929 tempest-VolumesGetTestJSON-1225808883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:29:44 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [req-6c41d05c-709c-400e-9bb2-6840e16d7fcd req-e9ac3dee-28ca-4861-a0f0-5b314d8eb929 tempest-VolumesGetTestJSON-1225808883 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:29:44 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [req-6c41d05c-709c-400e-9bb2-6840e16d7fcd req-e9ac3dee-28ca-4861-a0f0-5b314d8eb929 tempest-VolumesGetTestJSON-1225808883 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:29:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [req-6c41d05c-709c-400e-9bb2-6840e16d7fcd req-e9ac3dee-28ca-4861-a0f0-5b314d8eb929 tempest-VolumesGetTestJSON-1225808883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c77cdbe4-db26-4ba7-84f5-f883c0806099 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:44 devstack sudo[89892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c77cdbe4-db26-4ba7-84f5-f883c0806099 1073741824 Nov 03 07:29:44 devstack sudo[89892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:45 devstack sudo[89892]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [req-6c41d05c-709c-400e-9bb2-6840e16d7fcd req-e9ac3dee-28ca-4861-a0f0-5b314d8eb929 tempest-VolumesGetTestJSON-1225808883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c77cdbe4-db26-4ba7-84f5-f883c0806099 1073741824" returned: 0 in 0.819s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [req-6c41d05c-709c-400e-9bb2-6840e16d7fcd req-e9ac3dee-28ca-4861-a0f0-5b314d8eb929 tempest-VolumesGetTestJSON-1225808883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c77cdbe4-db26-4ba7-84f5-f883c0806099 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:45 devstack sudo[89907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c77cdbe4-db26-4ba7-84f5-f883c0806099 Nov 03 07:29:45 devstack sudo[89907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:45 devstack sudo[89907]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [req-6c41d05c-709c-400e-9bb2-6840e16d7fcd req-e9ac3dee-28ca-4861-a0f0-5b314d8eb929 tempest-VolumesGetTestJSON-1225808883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c77cdbe4-db26-4ba7-84f5-f883c0806099" returned: 0 in 0.318s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:45 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [req-6c41d05c-709c-400e-9bb2-6840e16d7fcd req-e9ac3dee-28ca-4861-a0f0-5b314d8eb929 tempest-VolumesGetTestJSON-1225808883 None] <== create_volume: return (1222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:29:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-6c41d05c-709c-400e-9bb2-6840e16d7fcd req-e9ac3dee-28ca-4861-a0f0-5b314d8eb929 tempest-VolumesGetTestJSON-1225808883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.225s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:29:45 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-6c41d05c-709c-400e-9bb2-6840e16d7fcd req-e9ac3dee-28ca-4861-a0f0-5b314d8eb929 tempest-VolumesGetTestJSON-1225808883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (235fed2a-3d75-40ed-9044-1b068cff74d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c77cdbe4-db26-4ba7-84f5-f883c0806099', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:29:45 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-6c41d05c-709c-400e-9bb2-6840e16d7fcd req-e9ac3dee-28ca-4861-a0f0-5b314d8eb929 tempest-VolumesGetTestJSON-1225808883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8326f36c-82cf-45a2-847b-e65385f00cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:29:45 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [req-6c41d05c-709c-400e-9bb2-6840e16d7fcd req-e9ac3dee-28ca-4861-a0f0-5b314d8eb929 tempest-VolumesGetTestJSON-1225808883 None] Volume volume-c77cdbe4-db26-4ba7-84f5-f883c0806099 (c77cdbe4-db26-4ba7-84f5-f883c0806099): created successfully Nov 03 07:29:45 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-6c41d05c-709c-400e-9bb2-6840e16d7fcd req-e9ac3dee-28ca-4861-a0f0-5b314d8eb929 tempest-VolumesGetTestJSON-1225808883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8326f36c-82cf-45a2-847b-e65385f00cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:29:45 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-6c41d05c-709c-400e-9bb2-6840e16d7fcd req-e9ac3dee-28ca-4861-a0f0-5b314d8eb929 tempest-VolumesGetTestJSON-1225808883 None] Flow 'volume_create_manager' (3ce2167b-4e9d-4e1a-93d0-1157e4c4ed37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:29:45 devstack cinder-volume[86875]: INFO cinder.volume.manager [req-6c41d05c-709c-400e-9bb2-6840e16d7fcd req-e9ac3dee-28ca-4861-a0f0-5b314d8eb929 tempest-VolumesGetTestJSON-1225808883 None] Created volume successfully. Nov 03 07:29:46 devstack cinder-volume[86875]: DEBUG cinder.coordination [req-1b095113-f85d-4d70-a370-9fbe6d8a9936 req-f48e1bb4-b131-4f19-a112-cc9e0cd3dfa3 tempest-VolumesGetTestJSON-1225808883 None] Acquiring lock "cinder-c77cdbe4-db26-4ba7-84f5-f883c0806099-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:29:46 devstack cinder-volume[86875]: DEBUG cinder.coordination [req-1b095113-f85d-4d70-a370-9fbe6d8a9936 req-f48e1bb4-b131-4f19-a112-cc9e0cd3dfa3 tempest-VolumesGetTestJSON-1225808883 None] Lock "cinder-c77cdbe4-db26-4ba7-84f5-f883c0806099-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:29:46 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:SELECT=65,cinder:INSERT=15,cinder:UPDATE=57,cinder:DELETE=5 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:29:46 devstack cinder-volume[86875]: DEBUG cinder.coordination [req-1b095113-f85d-4d70-a370-9fbe6d8a9936 req-f48e1bb4-b131-4f19-a112-cc9e0cd3dfa3 tempest-VolumesGetTestJSON-1225808883 None] Acquiring lock "cinder-quobyte-c77cdbe4-db26-4ba7-84f5-f883c0806099" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:29:46 devstack cinder-volume[86875]: DEBUG cinder.coordination [req-1b095113-f85d-4d70-a370-9fbe6d8a9936 req-f48e1bb4-b131-4f19-a112-cc9e0cd3dfa3 tempest-VolumesGetTestJSON-1225808883 None] Lock "cinder-quobyte-c77cdbe4-db26-4ba7-84f5-f883c0806099" acquired by "delete_volume" :: waited 0.030s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:29:46 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[658a9845-9846-4f9c-96d9-0b91bd5020b6]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:29:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [req-1b095113-f85d-4d70-a370-9fbe6d8a9936 req-f48e1bb4-b131-4f19-a112-cc9e0cd3dfa3 tempest-VolumesGetTestJSON-1225808883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c77cdbe4-db26-4ba7-84f5-f883c0806099 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:47 devstack sudo[89914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c77cdbe4-db26-4ba7-84f5-f883c0806099 Nov 03 07:29:47 devstack sudo[89914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:47 devstack sudo[89914]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:47 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [req-1b095113-f85d-4d70-a370-9fbe6d8a9936 req-f48e1bb4-b131-4f19-a112-cc9e0cd3dfa3 tempest-VolumesGetTestJSON-1225808883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c77cdbe4-db26-4ba7-84f5-f883c0806099" returned: 0 in 0.549s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:47 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [req-1b095113-f85d-4d70-a370-9fbe6d8a9936 req-f48e1bb4-b131-4f19-a112-cc9e0cd3dfa3 tempest-VolumesGetTestJSON-1225808883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c77cdbe4-db26-4ba7-84f5-f883c0806099 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:47 devstack sudo[89919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c77cdbe4-db26-4ba7-84f5-f883c0806099 Nov 03 07:29:47 devstack sudo[89919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:47 devstack sudo[89919]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:47 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [req-1b095113-f85d-4d70-a370-9fbe6d8a9936 req-f48e1bb4-b131-4f19-a112-cc9e0cd3dfa3 tempest-VolumesGetTestJSON-1225808883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c77cdbe4-db26-4ba7-84f5-f883c0806099" returned: 0 in 0.324s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:47 devstack cinder-volume[86875]: DEBUG cinder.coordination [req-1b095113-f85d-4d70-a370-9fbe6d8a9936 req-f48e1bb4-b131-4f19-a112-cc9e0cd3dfa3 tempest-VolumesGetTestJSON-1225808883 None] Lock "cinder-quobyte-c77cdbe4-db26-4ba7-84f5-f883c0806099" released by "delete_volume" :: held 0.941s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:29:47 devstack cinder-volume[86875]: DEBUG cinder.quota [req-1b095113-f85d-4d70-a370-9fbe6d8a9936 req-f48e1bb4-b131-4f19-a112-cc9e0cd3dfa3 tempest-VolumesGetTestJSON-1225808883 None] Created reservations ['d926b650-22f7-4ca6-b109-e11d29662fd6', '28b964b8-0ee6-43c0-af5b-34c94b9a1368', 'a1939be0-435e-495f-902b-7fde99a930ff', '31540a1c-1fdb-442b-9231-bc28b9e1e2be'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:29:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-1b095113-f85d-4d70-a370-9fbe6d8a9936 req-f48e1bb4-b131-4f19-a112-cc9e0cd3dfa3 tempest-VolumesGetTestJSON-1225808883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:29:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-1b095113-f85d-4d70-a370-9fbe6d8a9936 req-f48e1bb4-b131-4f19-a112-cc9e0cd3dfa3 tempest-VolumesGetTestJSON-1225808883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:29:48 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [req-1b095113-f85d-4d70-a370-9fbe6d8a9936 req-f48e1bb4-b131-4f19-a112-cc9e0cd3dfa3 tempest-VolumesGetTestJSON-1225808883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:29:48 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [req-1b095113-f85d-4d70-a370-9fbe6d8a9936 req-f48e1bb4-b131-4f19-a112-cc9e0cd3dfa3 tempest-VolumesGetTestJSON-1225808883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:29:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-1b095113-f85d-4d70-a370-9fbe6d8a9936 req-f48e1bb4-b131-4f19-a112-cc9e0cd3dfa3 tempest-VolumesGetTestJSON-1225808883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:29:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [req-1b095113-f85d-4d70-a370-9fbe6d8a9936 req-f48e1bb4-b131-4f19-a112-cc9e0cd3dfa3 tempest-VolumesGetTestJSON-1225808883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:48 devstack sudo[89922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:29:48 devstack sudo[89922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:48 devstack sudo[89922]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [req-1b095113-f85d-4d70-a370-9fbe6d8a9936 req-f48e1bb4-b131-4f19-a112-cc9e0cd3dfa3 tempest-VolumesGetTestJSON-1225808883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.412s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:48 devstack cinder-volume[86875]: DEBUG cinder.manager [req-1b095113-f85d-4d70-a370-9fbe6d8a9936 req-f48e1bb4-b131-4f19-a112-cc9e0cd3dfa3 tempest-VolumesGetTestJSON-1225808883 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:29:48 devstack cinder-volume[86875]: INFO cinder.volume.manager [req-1b095113-f85d-4d70-a370-9fbe6d8a9936 req-f48e1bb4-b131-4f19-a112-cc9e0cd3dfa3 tempest-VolumesGetTestJSON-1225808883 None] Deleted volume successfully. Nov 03 07:29:48 devstack cinder-volume[86875]: DEBUG cinder.coordination [req-1b095113-f85d-4d70-a370-9fbe6d8a9936 req-f48e1bb4-b131-4f19-a112-cc9e0cd3dfa3 tempest-VolumesGetTestJSON-1225808883 None] Lock "cinder-c77cdbe4-db26-4ba7-84f5-f883c0806099-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:29:57 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-9296e98e-1c8d-4c03-91d7-aa3836dbbe42 tempest-AttachVolumeTestJSON-1835319745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:29:57 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-9296e98e-1c8d-4c03-91d7-aa3836dbbe42 tempest-AttachVolumeTestJSON-1835319745 None] Flow 'volume_create_manager' (059ffa2c-b226-4c11-8e9b-f705e7a4a336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:29:57 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-9296e98e-1c8d-4c03-91d7-aa3836dbbe42 tempest-AttachVolumeTestJSON-1835319745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (591a6671-46d1-436d-9bb3-188726bec84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:29:57 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:SELECT=63,cinder:UPDATE=72,cinder:DELETE=5,cinder:INSERT=19 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:29:57 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-9296e98e-1c8d-4c03-91d7-aa3836dbbe42 tempest-AttachVolumeTestJSON-1835319745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (591a6671-46d1-436d-9bb3-188726bec84e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:29:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1314931757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=597d424e-ee46-4837-90ac-6c2a00a6e84d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='015dfecb699d4b85825cce29cc4c1659',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:29:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:29:57Z,use_quota=True,user_id='14206b5c8c474d928fd7142bd4266779',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:29:57 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-9296e98e-1c8d-4c03-91d7-aa3836dbbe42 tempest-AttachVolumeTestJSON-1835319745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f06f7e7-8a88-48f1-9d93-ff14632fef96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:29:57 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-9296e98e-1c8d-4c03-91d7-aa3836dbbe42 tempest-AttachVolumeTestJSON-1835319745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f06f7e7-8a88-48f1-9d93-ff14632fef96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:29:57 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-9296e98e-1c8d-4c03-91d7-aa3836dbbe42 tempest-AttachVolumeTestJSON-1835319745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d61e487-05bf-4d50-a7bb-2cf969078061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:29:57 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-9296e98e-1c8d-4c03-91d7-aa3836dbbe42 tempest-AttachVolumeTestJSON-1835319745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d61e487-05bf-4d50-a7bb-2cf969078061) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '597d424e-ee46-4837-90ac-6c2a00a6e84d', 'volume_name': 'volume-597d424e-ee46-4837-90ac-6c2a00a6e84d', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:29:57 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-9296e98e-1c8d-4c03-91d7-aa3836dbbe42 tempest-AttachVolumeTestJSON-1835319745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (686e02d4-3d76-4d89-9a95-9fe23a1da25f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:29:57 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-9296e98e-1c8d-4c03-91d7-aa3836dbbe42 tempest-AttachVolumeTestJSON-1835319745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (686e02d4-3d76-4d89-9a95-9fe23a1da25f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:29:57 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-9296e98e-1c8d-4c03-91d7-aa3836dbbe42 tempest-AttachVolumeTestJSON-1835319745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2df1b4f-c28d-49a1-b652-fc5716f419d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:29:57 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-9296e98e-1c8d-4c03-91d7-aa3836dbbe42 tempest-AttachVolumeTestJSON-1835319745 None] Volume 597d424e-ee46-4837-90ac-6c2a00a6e84d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-597d424e-ee46-4837-90ac-6c2a00a6e84d', 'volume_size': 1} Nov 03 07:29:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-9296e98e-1c8d-4c03-91d7-aa3836dbbe42 tempest-AttachVolumeTestJSON-1835319745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:29:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-9296e98e-1c8d-4c03-91d7-aa3836dbbe42 tempest-AttachVolumeTestJSON-1835319745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:29:57 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-9296e98e-1c8d-4c03-91d7-aa3836dbbe42 tempest-AttachVolumeTestJSON-1835319745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:29:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1314931757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=597d424e-ee46-4837-90ac-6c2a00a6e84d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='015dfecb699d4b85825cce29cc4c1659',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:29:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:29:57Z,use_quota=True,user_id='14206b5c8c474d928fd7142bd4266779',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:29:57 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-9296e98e-1c8d-4c03-91d7-aa3836dbbe42 tempest-AttachVolumeTestJSON-1835319745 None] Creating volume 597d424e-ee46-4837-90ac-6c2a00a6e84d {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:29:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-9296e98e-1c8d-4c03-91d7-aa3836dbbe42 tempest-AttachVolumeTestJSON-1835319745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:29:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-9296e98e-1c8d-4c03-91d7-aa3836dbbe42 tempest-AttachVolumeTestJSON-1835319745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:29:57 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-9296e98e-1c8d-4c03-91d7-aa3836dbbe42 tempest-AttachVolumeTestJSON-1835319745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:29:57 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-9296e98e-1c8d-4c03-91d7-aa3836dbbe42 tempest-AttachVolumeTestJSON-1835319745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:29:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-9296e98e-1c8d-4c03-91d7-aa3836dbbe42 tempest-AttachVolumeTestJSON-1835319745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:29:57 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-9296e98e-1c8d-4c03-91d7-aa3836dbbe42 tempest-AttachVolumeTestJSON-1835319745 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:29:57 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-9296e98e-1c8d-4c03-91d7-aa3836dbbe42 tempest-AttachVolumeTestJSON-1835319745 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:29:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9296e98e-1c8d-4c03-91d7-aa3836dbbe42 tempest-AttachVolumeTestJSON-1835319745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-597d424e-ee46-4837-90ac-6c2a00a6e84d 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:57 devstack sudo[89936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-597d424e-ee46-4837-90ac-6c2a00a6e84d 1073741824 Nov 03 07:29:57 devstack sudo[89936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:58 devstack sudo[89936]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9296e98e-1c8d-4c03-91d7-aa3836dbbe42 tempest-AttachVolumeTestJSON-1835319745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-597d424e-ee46-4837-90ac-6c2a00a6e84d 1073741824" returned: 0 in 0.705s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9296e98e-1c8d-4c03-91d7-aa3836dbbe42 tempest-AttachVolumeTestJSON-1835319745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-597d424e-ee46-4837-90ac-6c2a00a6e84d {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:29:58 devstack sudo[89943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-597d424e-ee46-4837-90ac-6c2a00a6e84d Nov 03 07:29:58 devstack sudo[89943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:29:58 devstack sudo[89943]: pam_unix(sudo:session): session closed for user root Nov 03 07:29:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9296e98e-1c8d-4c03-91d7-aa3836dbbe42 tempest-AttachVolumeTestJSON-1835319745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-597d424e-ee46-4837-90ac-6c2a00a6e84d" returned: 0 in 0.372s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:29:58 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-9296e98e-1c8d-4c03-91d7-aa3836dbbe42 tempest-AttachVolumeTestJSON-1835319745 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:29:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-9296e98e-1c8d-4c03-91d7-aa3836dbbe42 tempest-AttachVolumeTestJSON-1835319745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:29:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-9296e98e-1c8d-4c03-91d7-aa3836dbbe42 tempest-AttachVolumeTestJSON-1835319745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2df1b4f-c28d-49a1-b652-fc5716f419d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-597d424e-ee46-4837-90ac-6c2a00a6e84d', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:29:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-9296e98e-1c8d-4c03-91d7-aa3836dbbe42 tempest-AttachVolumeTestJSON-1835319745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72601864-4de5-4f9f-a02b-d967fa3d2a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:29:58 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-9296e98e-1c8d-4c03-91d7-aa3836dbbe42 tempest-AttachVolumeTestJSON-1835319745 None] Volume volume-597d424e-ee46-4837-90ac-6c2a00a6e84d (597d424e-ee46-4837-90ac-6c2a00a6e84d): created successfully Nov 03 07:29:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-9296e98e-1c8d-4c03-91d7-aa3836dbbe42 tempest-AttachVolumeTestJSON-1835319745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72601864-4de5-4f9f-a02b-d967fa3d2a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:29:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-9296e98e-1c8d-4c03-91d7-aa3836dbbe42 tempest-AttachVolumeTestJSON-1835319745 None] Flow 'volume_create_manager' (059ffa2c-b226-4c11-8e9b-f705e7a4a336) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:29:58 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-9296e98e-1c8d-4c03-91d7-aa3836dbbe42 tempest-AttachVolumeTestJSON-1835319745 None] Created volume successfully. Nov 03 07:30:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-7532ef86-0c90-45c6-8d20-f4e50b6c4669 req-587de8b7-6d4e-4814-8266-9ff441dbd6b5 tempest-AttachVolumeTestJSON-1835319745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:30:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-7532ef86-0c90-45c6-8d20-f4e50b6c4669 req-587de8b7-6d4e-4814-8266-9ff441dbd6b5 tempest-AttachVolumeTestJSON-1835319745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:30:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-7532ef86-0c90-45c6-8d20-f4e50b6c4669 req-587de8b7-6d4e-4814-8266-9ff441dbd6b5 tempest-AttachVolumeTestJSON-1835319745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:30:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-7532ef86-0c90-45c6-8d20-f4e50b6c4669 req-587de8b7-6d4e-4814-8266-9ff441dbd6b5 tempest-AttachVolumeTestJSON-1835319745 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1', 'name': 'volume-597d424e-ee46-4837-90ac-6c2a00a6e84d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4ad037e8-eb47-417a-866a-b4c6e6867daf', 'enforce_multipath': True} {{(pid=86875) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:30:00 devstack cinder-volume[86875]: INFO cinder.volume.manager [req-7532ef86-0c90-45c6-8d20-f4e50b6c4669 req-587de8b7-6d4e-4814-8266-9ff441dbd6b5 tempest-AttachVolumeTestJSON-1835319745 None] attachment_update completed successfully. Nov 03 07:30:02 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-53ea06c1-d691-4f9b-bf50-5d2a0364accd tempest-VolumeQuotasAdminTestJSON-1942687141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:30:02 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-53ea06c1-d691-4f9b-bf50-5d2a0364accd tempest-VolumeQuotasAdminTestJSON-1942687141 None] Flow 'volume_create_manager' (c12f6869-9102-4ba0-a1e8-06aaf6e649fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:30:02 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-53ea06c1-d691-4f9b-bf50-5d2a0364accd tempest-VolumeQuotasAdminTestJSON-1942687141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (559fd2a3-7800-4ccb-8d8b-7fd20aedd800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:02 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-53ea06c1-d691-4f9b-bf50-5d2a0364accd tempest-VolumeQuotasAdminTestJSON-1942687141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (559fd2a3-7800-4ccb-8d8b-7fd20aedd800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:30:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1440121876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21698bd8-5382-4996-a2eb-1406d1119212,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14cd56a48a5847409305583f4a23b549',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:30:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:30:03Z,use_quota=True,user_id='46b0aa887ddd4bfaab1c9aab5272935d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:02 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-53ea06c1-d691-4f9b-bf50-5d2a0364accd tempest-VolumeQuotasAdminTestJSON-1942687141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66f59ecb-c7e2-4d06-9d16-287c2f84a1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:02 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-53ea06c1-d691-4f9b-bf50-5d2a0364accd tempest-VolumeQuotasAdminTestJSON-1942687141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66f59ecb-c7e2-4d06-9d16-287c2f84a1b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:02 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-53ea06c1-d691-4f9b-bf50-5d2a0364accd tempest-VolumeQuotasAdminTestJSON-1942687141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0f2dd84-f031-4c42-b26a-491c982ba47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:02 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-53ea06c1-d691-4f9b-bf50-5d2a0364accd tempest-VolumeQuotasAdminTestJSON-1942687141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0f2dd84-f031-4c42-b26a-491c982ba47b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21698bd8-5382-4996-a2eb-1406d1119212', 'volume_name': 'volume-21698bd8-5382-4996-a2eb-1406d1119212', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:02 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-53ea06c1-d691-4f9b-bf50-5d2a0364accd tempest-VolumeQuotasAdminTestJSON-1942687141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01641f4a-d187-44e5-9b5e-3b01cd70eaac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:02 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-53ea06c1-d691-4f9b-bf50-5d2a0364accd tempest-VolumeQuotasAdminTestJSON-1942687141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01641f4a-d187-44e5-9b5e-3b01cd70eaac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:02 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-53ea06c1-d691-4f9b-bf50-5d2a0364accd tempest-VolumeQuotasAdminTestJSON-1942687141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (373663fc-9a4c-4147-9118-ac4c3656fe73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:02 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-53ea06c1-d691-4f9b-bf50-5d2a0364accd tempest-VolumeQuotasAdminTestJSON-1942687141 None] Volume 21698bd8-5382-4996-a2eb-1406d1119212: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21698bd8-5382-4996-a2eb-1406d1119212', 'volume_size': 1} Nov 03 07:30:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-53ea06c1-d691-4f9b-bf50-5d2a0364accd tempest-VolumeQuotasAdminTestJSON-1942687141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:30:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-53ea06c1-d691-4f9b-bf50-5d2a0364accd tempest-VolumeQuotasAdminTestJSON-1942687141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:30:02 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-53ea06c1-d691-4f9b-bf50-5d2a0364accd tempest-VolumeQuotasAdminTestJSON-1942687141 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:30:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1440121876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21698bd8-5382-4996-a2eb-1406d1119212,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14cd56a48a5847409305583f4a23b549',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:30:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:30:03Z,use_quota=True,user_id='46b0aa887ddd4bfaab1c9aab5272935d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:30:02 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-53ea06c1-d691-4f9b-bf50-5d2a0364accd tempest-VolumeQuotasAdminTestJSON-1942687141 None] Creating volume 21698bd8-5382-4996-a2eb-1406d1119212 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:30:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-53ea06c1-d691-4f9b-bf50-5d2a0364accd tempest-VolumeQuotasAdminTestJSON-1942687141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:30:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-53ea06c1-d691-4f9b-bf50-5d2a0364accd tempest-VolumeQuotasAdminTestJSON-1942687141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:30:02 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-53ea06c1-d691-4f9b-bf50-5d2a0364accd tempest-VolumeQuotasAdminTestJSON-1942687141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:30:02 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-53ea06c1-d691-4f9b-bf50-5d2a0364accd tempest-VolumeQuotasAdminTestJSON-1942687141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:30:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-53ea06c1-d691-4f9b-bf50-5d2a0364accd tempest-VolumeQuotasAdminTestJSON-1942687141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:30:02 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-53ea06c1-d691-4f9b-bf50-5d2a0364accd tempest-VolumeQuotasAdminTestJSON-1942687141 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:30:02 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-53ea06c1-d691-4f9b-bf50-5d2a0364accd tempest-VolumeQuotasAdminTestJSON-1942687141 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:30:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-53ea06c1-d691-4f9b-bf50-5d2a0364accd tempest-VolumeQuotasAdminTestJSON-1942687141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-21698bd8-5382-4996-a2eb-1406d1119212 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:02 devstack sudo[90405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-21698bd8-5382-4996-a2eb-1406d1119212 1073741824 Nov 03 07:30:02 devstack sudo[90405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:03 devstack cinder-volume[86875]: DEBUG oslo_service.periodic_task [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86875) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:30:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:30:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:30:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:30:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:30:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:30:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:03 devstack sudo[90405]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-53ea06c1-d691-4f9b-bf50-5d2a0364accd tempest-VolumeQuotasAdminTestJSON-1942687141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-21698bd8-5382-4996-a2eb-1406d1119212 1073741824" returned: 0 in 0.636s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:03 devstack sudo[90416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:30:03 devstack sudo[90416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-53ea06c1-d691-4f9b-bf50-5d2a0364accd tempest-VolumeQuotasAdminTestJSON-1942687141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-21698bd8-5382-4996-a2eb-1406d1119212 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:03 devstack sudo[90418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-21698bd8-5382-4996-a2eb-1406d1119212 Nov 03 07:30:03 devstack sudo[90418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:03 devstack sudo[90416]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.277s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:03 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:30:03 devstack cinder-volume[86875]: DEBUG oslo_service.periodic_task [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running periodic task VolumeManager._thread_info {{(pid=86875) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:30:03 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] thread count: 8 {{(pid=86875) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:30:03 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] thread info: [<_MainThread(MainThread, started 125626325639296)>, , , , , , , ] {{(pid=86875) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:30:03 devstack sudo[90418]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-53ea06c1-d691-4f9b-bf50-5d2a0364accd tempest-VolumeQuotasAdminTestJSON-1942687141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-21698bd8-5382-4996-a2eb-1406d1119212" returned: 0 in 0.294s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-53ea06c1-d691-4f9b-bf50-5d2a0364accd tempest-VolumeQuotasAdminTestJSON-1942687141 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:30:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-53ea06c1-d691-4f9b-bf50-5d2a0364accd tempest-VolumeQuotasAdminTestJSON-1942687141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:30:03 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-53ea06c1-d691-4f9b-bf50-5d2a0364accd tempest-VolumeQuotasAdminTestJSON-1942687141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (373663fc-9a4c-4147-9118-ac4c3656fe73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21698bd8-5382-4996-a2eb-1406d1119212', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:03 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-53ea06c1-d691-4f9b-bf50-5d2a0364accd tempest-VolumeQuotasAdminTestJSON-1942687141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaa5b6ee-11c6-4b53-b4d3-26fb79b654aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:03 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-53ea06c1-d691-4f9b-bf50-5d2a0364accd tempest-VolumeQuotasAdminTestJSON-1942687141 None] Volume volume-21698bd8-5382-4996-a2eb-1406d1119212 (21698bd8-5382-4996-a2eb-1406d1119212): created successfully Nov 03 07:30:03 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-53ea06c1-d691-4f9b-bf50-5d2a0364accd tempest-VolumeQuotasAdminTestJSON-1942687141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaa5b6ee-11c6-4b53-b4d3-26fb79b654aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:03 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-53ea06c1-d691-4f9b-bf50-5d2a0364accd tempest-VolumeQuotasAdminTestJSON-1942687141 None] Flow 'volume_create_manager' (c12f6869-9102-4ba0-a1e8-06aaf6e649fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:30:03 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-53ea06c1-d691-4f9b-bf50-5d2a0364accd tempest-VolumeQuotasAdminTestJSON-1942687141 None] Created volume successfully. Nov 03 07:30:04 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d3181c20-4c89-42fc-831c-fffc5dd9e8e5 tempest-VolumeQuotasAdminTestJSON-1942687141 None] Acquiring lock "cinder-21698bd8-5382-4996-a2eb-1406d1119212-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:30:05 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d3181c20-4c89-42fc-831c-fffc5dd9e8e5 tempest-VolumeQuotasAdminTestJSON-1942687141 None] Lock "cinder-21698bd8-5382-4996-a2eb-1406d1119212-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:30:05 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d3181c20-4c89-42fc-831c-fffc5dd9e8e5 tempest-VolumeQuotasAdminTestJSON-1942687141 None] Acquiring lock "cinder-quobyte-21698bd8-5382-4996-a2eb-1406d1119212" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:30:05 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d3181c20-4c89-42fc-831c-fffc5dd9e8e5 tempest-VolumeQuotasAdminTestJSON-1942687141 None] Lock "cinder-quobyte-21698bd8-5382-4996-a2eb-1406d1119212" acquired by "delete_volume" :: waited 0.025s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:30:05 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e54313-71f2-4501-a56b-ab6b9077f77e]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:30:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d3181c20-4c89-42fc-831c-fffc5dd9e8e5 tempest-VolumeQuotasAdminTestJSON-1942687141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-21698bd8-5382-4996-a2eb-1406d1119212 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:05 devstack sudo[90423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-21698bd8-5382-4996-a2eb-1406d1119212 Nov 03 07:30:05 devstack sudo[90423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:05 devstack sudo[90423]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d3181c20-4c89-42fc-831c-fffc5dd9e8e5 tempest-VolumeQuotasAdminTestJSON-1942687141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-21698bd8-5382-4996-a2eb-1406d1119212" returned: 0 in 0.434s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d3181c20-4c89-42fc-831c-fffc5dd9e8e5 tempest-VolumeQuotasAdminTestJSON-1942687141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-21698bd8-5382-4996-a2eb-1406d1119212 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:05 devstack sudo[90429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-21698bd8-5382-4996-a2eb-1406d1119212 Nov 03 07:30:05 devstack sudo[90429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:06 devstack sudo[90429]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d3181c20-4c89-42fc-831c-fffc5dd9e8e5 tempest-VolumeQuotasAdminTestJSON-1942687141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-21698bd8-5382-4996-a2eb-1406d1119212" returned: 0 in 0.603s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:06 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d3181c20-4c89-42fc-831c-fffc5dd9e8e5 tempest-VolumeQuotasAdminTestJSON-1942687141 None] Lock "cinder-quobyte-21698bd8-5382-4996-a2eb-1406d1119212" released by "delete_volume" :: held 1.122s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:30:06 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-d3181c20-4c89-42fc-831c-fffc5dd9e8e5 tempest-VolumeQuotasAdminTestJSON-1942687141 None] Created reservations ['12fc0ef1-29b2-4ad0-8411-5792a2a080ac', '83d71342-5c8f-40e8-b310-d1bf2840d96d', '681a7bad-fd8f-4d1f-9981-1425e5e1101f', '34efcae2-444a-46c2-a05b-9992797b5577'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:30:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-d3181c20-4c89-42fc-831c-fffc5dd9e8e5 tempest-VolumeQuotasAdminTestJSON-1942687141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:30:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-d3181c20-4c89-42fc-831c-fffc5dd9e8e5 tempest-VolumeQuotasAdminTestJSON-1942687141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:30:06 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-d3181c20-4c89-42fc-831c-fffc5dd9e8e5 tempest-VolumeQuotasAdminTestJSON-1942687141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:30:06 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-d3181c20-4c89-42fc-831c-fffc5dd9e8e5 tempest-VolumeQuotasAdminTestJSON-1942687141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:30:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-d3181c20-4c89-42fc-831c-fffc5dd9e8e5 tempest-VolumeQuotasAdminTestJSON-1942687141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:30:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d3181c20-4c89-42fc-831c-fffc5dd9e8e5 tempest-VolumeQuotasAdminTestJSON-1942687141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:06 devstack sudo[90574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:30:06 devstack sudo[90574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:06 devstack sudo[90574]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d3181c20-4c89-42fc-831c-fffc5dd9e8e5 tempest-VolumeQuotasAdminTestJSON-1942687141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.294s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:06 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-d3181c20-4c89-42fc-831c-fffc5dd9e8e5 tempest-VolumeQuotasAdminTestJSON-1942687141 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:30:06 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-d3181c20-4c89-42fc-831c-fffc5dd9e8e5 tempest-VolumeQuotasAdminTestJSON-1942687141 None] Deleted volume successfully. Nov 03 07:30:06 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d3181c20-4c89-42fc-831c-fffc5dd9e8e5 tempest-VolumeQuotasAdminTestJSON-1942687141 None] Lock "cinder-21698bd8-5382-4996-a2eb-1406d1119212-delete_volume" released by "delete_volume" :: held 1.741s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:30:08 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd921ad4-1cbf-4d77-be2c-2e6837d1cf2c tempest-VolumeQuotasAdminTestJSON-1942687141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:30:08 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-bd921ad4-1cbf-4d77-be2c-2e6837d1cf2c tempest-VolumeQuotasAdminTestJSON-1942687141 None] Flow 'volume_create_manager' (36b974cf-198a-4897-8c32-81d08ccfec5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:30:08 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-bd921ad4-1cbf-4d77-be2c-2e6837d1cf2c tempest-VolumeQuotasAdminTestJSON-1942687141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (073b771e-c0cb-45d7-bbbd-e125c2f0f3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:08 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-bd921ad4-1cbf-4d77-be2c-2e6837d1cf2c tempest-VolumeQuotasAdminTestJSON-1942687141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (073b771e-c0cb-45d7-bbbd-e125c2f0f3dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:30:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-621769054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d70b19b-7bd9-4a93-b104-3c779df0445a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14cd56a48a5847409305583f4a23b549',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:30:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:30:08Z,use_quota=True,user_id='46b0aa887ddd4bfaab1c9aab5272935d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:08 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-bd921ad4-1cbf-4d77-be2c-2e6837d1cf2c tempest-VolumeQuotasAdminTestJSON-1942687141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4c20667-3620-4174-af97-b16d02cf0fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:08 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-bd921ad4-1cbf-4d77-be2c-2e6837d1cf2c tempest-VolumeQuotasAdminTestJSON-1942687141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4c20667-3620-4174-af97-b16d02cf0fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:08 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-bd921ad4-1cbf-4d77-be2c-2e6837d1cf2c tempest-VolumeQuotasAdminTestJSON-1942687141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5102856a-0fa7-456a-ab72-6c867f5884f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:08 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-bd921ad4-1cbf-4d77-be2c-2e6837d1cf2c tempest-VolumeQuotasAdminTestJSON-1942687141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5102856a-0fa7-456a-ab72-6c867f5884f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d70b19b-7bd9-4a93-b104-3c779df0445a', 'volume_name': 'volume-8d70b19b-7bd9-4a93-b104-3c779df0445a', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:08 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-bd921ad4-1cbf-4d77-be2c-2e6837d1cf2c tempest-VolumeQuotasAdminTestJSON-1942687141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f55096f4-7b8f-4e27-8ff9-2528e512d427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:08 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-bd921ad4-1cbf-4d77-be2c-2e6837d1cf2c tempest-VolumeQuotasAdminTestJSON-1942687141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f55096f4-7b8f-4e27-8ff9-2528e512d427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:08 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-bd921ad4-1cbf-4d77-be2c-2e6837d1cf2c tempest-VolumeQuotasAdminTestJSON-1942687141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc4b5ef8-1bf5-49e1-ad8a-0ab58140f8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:08 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-bd921ad4-1cbf-4d77-be2c-2e6837d1cf2c tempest-VolumeQuotasAdminTestJSON-1942687141 None] Volume 8d70b19b-7bd9-4a93-b104-3c779df0445a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d70b19b-7bd9-4a93-b104-3c779df0445a', 'volume_size': 1} Nov 03 07:30:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-bd921ad4-1cbf-4d77-be2c-2e6837d1cf2c tempest-VolumeQuotasAdminTestJSON-1942687141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:30:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-bd921ad4-1cbf-4d77-be2c-2e6837d1cf2c tempest-VolumeQuotasAdminTestJSON-1942687141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:30:08 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-bd921ad4-1cbf-4d77-be2c-2e6837d1cf2c tempest-VolumeQuotasAdminTestJSON-1942687141 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:30:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-621769054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d70b19b-7bd9-4a93-b104-3c779df0445a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14cd56a48a5847409305583f4a23b549',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:30:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:30:08Z,use_quota=True,user_id='46b0aa887ddd4bfaab1c9aab5272935d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:30:08 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-bd921ad4-1cbf-4d77-be2c-2e6837d1cf2c tempest-VolumeQuotasAdminTestJSON-1942687141 None] Creating volume 8d70b19b-7bd9-4a93-b104-3c779df0445a {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:30:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-bd921ad4-1cbf-4d77-be2c-2e6837d1cf2c tempest-VolumeQuotasAdminTestJSON-1942687141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:30:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-bd921ad4-1cbf-4d77-be2c-2e6837d1cf2c tempest-VolumeQuotasAdminTestJSON-1942687141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:30:08 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-bd921ad4-1cbf-4d77-be2c-2e6837d1cf2c tempest-VolumeQuotasAdminTestJSON-1942687141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:30:08 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-bd921ad4-1cbf-4d77-be2c-2e6837d1cf2c tempest-VolumeQuotasAdminTestJSON-1942687141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:30:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-bd921ad4-1cbf-4d77-be2c-2e6837d1cf2c tempest-VolumeQuotasAdminTestJSON-1942687141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:30:08 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-bd921ad4-1cbf-4d77-be2c-2e6837d1cf2c tempest-VolumeQuotasAdminTestJSON-1942687141 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:30:08 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-bd921ad4-1cbf-4d77-be2c-2e6837d1cf2c tempest-VolumeQuotasAdminTestJSON-1942687141 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:30:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-bd921ad4-1cbf-4d77-be2c-2e6837d1cf2c tempest-VolumeQuotasAdminTestJSON-1942687141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d70b19b-7bd9-4a93-b104-3c779df0445a 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:08 devstack sudo[90969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d70b19b-7bd9-4a93-b104-3c779df0445a 1073741824 Nov 03 07:30:08 devstack sudo[90969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:08 devstack sudo[90969]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-bd921ad4-1cbf-4d77-be2c-2e6837d1cf2c tempest-VolumeQuotasAdminTestJSON-1942687141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d70b19b-7bd9-4a93-b104-3c779df0445a 1073741824" returned: 0 in 0.544s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-bd921ad4-1cbf-4d77-be2c-2e6837d1cf2c tempest-VolumeQuotasAdminTestJSON-1942687141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d70b19b-7bd9-4a93-b104-3c779df0445a {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:09 devstack sudo[90976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d70b19b-7bd9-4a93-b104-3c779df0445a Nov 03 07:30:09 devstack sudo[90976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:09 devstack sudo[90976]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-bd921ad4-1cbf-4d77-be2c-2e6837d1cf2c tempest-VolumeQuotasAdminTestJSON-1942687141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d70b19b-7bd9-4a93-b104-3c779df0445a" returned: 0 in 0.594s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:09 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-bd921ad4-1cbf-4d77-be2c-2e6837d1cf2c tempest-VolumeQuotasAdminTestJSON-1942687141 None] <== create_volume: return (1220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:30:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-bd921ad4-1cbf-4d77-be2c-2e6837d1cf2c tempest-VolumeQuotasAdminTestJSON-1942687141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:30:09 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-bd921ad4-1cbf-4d77-be2c-2e6837d1cf2c tempest-VolumeQuotasAdminTestJSON-1942687141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc4b5ef8-1bf5-49e1-ad8a-0ab58140f8d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d70b19b-7bd9-4a93-b104-3c779df0445a', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:09 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-bd921ad4-1cbf-4d77-be2c-2e6837d1cf2c tempest-VolumeQuotasAdminTestJSON-1942687141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18566912-aa7e-437d-bd39-be0330a5cf46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:09 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-bd921ad4-1cbf-4d77-be2c-2e6837d1cf2c tempest-VolumeQuotasAdminTestJSON-1942687141 None] Volume volume-8d70b19b-7bd9-4a93-b104-3c779df0445a (8d70b19b-7bd9-4a93-b104-3c779df0445a): created successfully Nov 03 07:30:09 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-bd921ad4-1cbf-4d77-be2c-2e6837d1cf2c tempest-VolumeQuotasAdminTestJSON-1942687141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18566912-aa7e-437d-bd39-be0330a5cf46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:09 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-bd921ad4-1cbf-4d77-be2c-2e6837d1cf2c tempest-VolumeQuotasAdminTestJSON-1942687141 None] Flow 'volume_create_manager' (36b974cf-198a-4897-8c32-81d08ccfec5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:30:09 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-bd921ad4-1cbf-4d77-be2c-2e6837d1cf2c tempest-VolumeQuotasAdminTestJSON-1942687141 None] Created volume successfully. Nov 03 07:30:12 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-c62c33b4-28e4-4fd4-a2bb-08e7d2d18061 tempest-VolumeQuotasAdminTestJSON-1900185566 None] Transfer volume completed successfully. Nov 03 07:30:12 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a050bb9f-2b8e-44c1-a46c-b97c72a2a77c tempest-VolumeQuotasAdminTestJSON-767845500 None] Acquiring lock "cinder-8d70b19b-7bd9-4a93-b104-3c779df0445a-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:30:12 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a050bb9f-2b8e-44c1-a46c-b97c72a2a77c tempest-VolumeQuotasAdminTestJSON-767845500 None] Lock "cinder-8d70b19b-7bd9-4a93-b104-3c779df0445a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:30:12 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a050bb9f-2b8e-44c1-a46c-b97c72a2a77c tempest-VolumeQuotasAdminTestJSON-767845500 None] Acquiring lock "cinder-quobyte-8d70b19b-7bd9-4a93-b104-3c779df0445a" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:30:12 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a050bb9f-2b8e-44c1-a46c-b97c72a2a77c tempest-VolumeQuotasAdminTestJSON-767845500 None] Lock "cinder-quobyte-8d70b19b-7bd9-4a93-b104-3c779df0445a" acquired by "delete_volume" :: waited 0.019s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:30:12 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4683c7f-a6dc-4d03-a4b7-2b7b0fc6cb2a]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:30:12 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a050bb9f-2b8e-44c1-a46c-b97c72a2a77c tempest-VolumeQuotasAdminTestJSON-767845500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d70b19b-7bd9-4a93-b104-3c779df0445a {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:13 devstack sudo[91019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d70b19b-7bd9-4a93-b104-3c779df0445a Nov 03 07:30:13 devstack sudo[91019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:13 devstack sudo[91019]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a050bb9f-2b8e-44c1-a46c-b97c72a2a77c tempest-VolumeQuotasAdminTestJSON-767845500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d70b19b-7bd9-4a93-b104-3c779df0445a" returned: 0 in 0.456s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a050bb9f-2b8e-44c1-a46c-b97c72a2a77c tempest-VolumeQuotasAdminTestJSON-767845500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d70b19b-7bd9-4a93-b104-3c779df0445a {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:13 devstack sudo[91024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d70b19b-7bd9-4a93-b104-3c779df0445a Nov 03 07:30:13 devstack sudo[91024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:13 devstack sudo[91024]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a050bb9f-2b8e-44c1-a46c-b97c72a2a77c tempest-VolumeQuotasAdminTestJSON-767845500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d70b19b-7bd9-4a93-b104-3c779df0445a" returned: 0 in 0.290s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:13 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a050bb9f-2b8e-44c1-a46c-b97c72a2a77c tempest-VolumeQuotasAdminTestJSON-767845500 None] Lock "cinder-quobyte-8d70b19b-7bd9-4a93-b104-3c779df0445a" released by "delete_volume" :: held 0.808s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:30:13 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-a050bb9f-2b8e-44c1-a46c-b97c72a2a77c tempest-VolumeQuotasAdminTestJSON-767845500 None] Created reservations ['5c50ce54-a2b5-4c9d-bd15-ae6a3c6d1a3a', 'bb50d8e4-6e97-425d-94f8-720537f2a214', '97f8b599-1314-416f-a108-de77cd920dcd', 'a4b70f12-dccc-42a1-8c16-0d39d0d1ed4d'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:30:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a050bb9f-2b8e-44c1-a46c-b97c72a2a77c tempest-VolumeQuotasAdminTestJSON-767845500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:30:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a050bb9f-2b8e-44c1-a46c-b97c72a2a77c tempest-VolumeQuotasAdminTestJSON-767845500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:30:13 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a050bb9f-2b8e-44c1-a46c-b97c72a2a77c tempest-VolumeQuotasAdminTestJSON-767845500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:30:13 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a050bb9f-2b8e-44c1-a46c-b97c72a2a77c tempest-VolumeQuotasAdminTestJSON-767845500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:30:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a050bb9f-2b8e-44c1-a46c-b97c72a2a77c tempest-VolumeQuotasAdminTestJSON-767845500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:30:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a050bb9f-2b8e-44c1-a46c-b97c72a2a77c tempest-VolumeQuotasAdminTestJSON-767845500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:13 devstack sudo[91027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:30:13 devstack sudo[91027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:14 devstack sudo[91027]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:14 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a050bb9f-2b8e-44c1-a46c-b97c72a2a77c tempest-VolumeQuotasAdminTestJSON-767845500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.306s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:14 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-a050bb9f-2b8e-44c1-a46c-b97c72a2a77c tempest-VolumeQuotasAdminTestJSON-767845500 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:30:14 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-a050bb9f-2b8e-44c1-a46c-b97c72a2a77c tempest-VolumeQuotasAdminTestJSON-767845500 None] Deleted volume successfully. Nov 03 07:30:14 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a050bb9f-2b8e-44c1-a46c-b97c72a2a77c tempest-VolumeQuotasAdminTestJSON-767845500 None] Lock "cinder-8d70b19b-7bd9-4a93-b104-3c779df0445a-delete_volume" released by "delete_volume" :: held 1.385s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:30:16 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-7015065b-b0a1-4cca-8e35-2422edcfae74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:30:16 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7015065b-b0a1-4cca-8e35-2422edcfae74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Flow 'volume_create_manager' (6e4057f2-e3e6-4f55-b7ed-0e47de840e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:30:16 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7015065b-b0a1-4cca-8e35-2422edcfae74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bfc48b6-ea59-4eee-b317-81146872037a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:16 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7015065b-b0a1-4cca-8e35-2422edcfae74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bfc48b6-ea59-4eee-b317-81146872037a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:30:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2123146110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef661201-4276-45e1-bfa8-10fb2a3125ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44575f15a2d44dd5b6e8caddbce2003a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:30:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:30:16Z,use_quota=True,user_id='28e2c35fe30e47aa93ee708b4b29dc60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:16 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7015065b-b0a1-4cca-8e35-2422edcfae74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e749579-4ea0-46fd-96aa-11873b9dd422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:16 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7015065b-b0a1-4cca-8e35-2422edcfae74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e749579-4ea0-46fd-96aa-11873b9dd422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:16 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7015065b-b0a1-4cca-8e35-2422edcfae74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6b168d9-d329-499f-8360-95f2d15ae155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:16 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7015065b-b0a1-4cca-8e35-2422edcfae74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6b168d9-d329-499f-8360-95f2d15ae155) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef661201-4276-45e1-bfa8-10fb2a3125ff', 'volume_name': 'volume-ef661201-4276-45e1-bfa8-10fb2a3125ff', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:16 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7015065b-b0a1-4cca-8e35-2422edcfae74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74148f0e-629f-4ed5-be80-938642644d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:16 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7015065b-b0a1-4cca-8e35-2422edcfae74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74148f0e-629f-4ed5-be80-938642644d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:16 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7015065b-b0a1-4cca-8e35-2422edcfae74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7d77e41-a23c-40c1-b72e-e8cace85b50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:16 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-7015065b-b0a1-4cca-8e35-2422edcfae74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Volume ef661201-4276-45e1-bfa8-10fb2a3125ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef661201-4276-45e1-bfa8-10fb2a3125ff', 'volume_size': 1} Nov 03 07:30:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7015065b-b0a1-4cca-8e35-2422edcfae74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:30:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7015065b-b0a1-4cca-8e35-2422edcfae74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:30:16 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-7015065b-b0a1-4cca-8e35-2422edcfae74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:30:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2123146110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef661201-4276-45e1-bfa8-10fb2a3125ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44575f15a2d44dd5b6e8caddbce2003a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:30:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:30:16Z,use_quota=True,user_id='28e2c35fe30e47aa93ee708b4b29dc60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:30:16 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-7015065b-b0a1-4cca-8e35-2422edcfae74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Creating volume ef661201-4276-45e1-bfa8-10fb2a3125ff {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:30:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7015065b-b0a1-4cca-8e35-2422edcfae74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:30:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7015065b-b0a1-4cca-8e35-2422edcfae74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:30:16 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-7015065b-b0a1-4cca-8e35-2422edcfae74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:30:16 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-7015065b-b0a1-4cca-8e35-2422edcfae74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:30:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7015065b-b0a1-4cca-8e35-2422edcfae74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:30:16 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-7015065b-b0a1-4cca-8e35-2422edcfae74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:30:16 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-7015065b-b0a1-4cca-8e35-2422edcfae74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:30:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7015065b-b0a1-4cca-8e35-2422edcfae74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ef661201-4276-45e1-bfa8-10fb2a3125ff 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:16 devstack sudo[91036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ef661201-4276-45e1-bfa8-10fb2a3125ff 1073741824 Nov 03 07:30:16 devstack sudo[91036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:16 devstack sudo[91036]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7015065b-b0a1-4cca-8e35-2422edcfae74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ef661201-4276-45e1-bfa8-10fb2a3125ff 1073741824" returned: 0 in 0.533s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7015065b-b0a1-4cca-8e35-2422edcfae74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ef661201-4276-45e1-bfa8-10fb2a3125ff {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:17 devstack sudo[91043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ef661201-4276-45e1-bfa8-10fb2a3125ff Nov 03 07:30:17 devstack sudo[91043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:17 devstack sudo[91043]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7015065b-b0a1-4cca-8e35-2422edcfae74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ef661201-4276-45e1-bfa8-10fb2a3125ff" returned: 0 in 0.384s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:17 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-7015065b-b0a1-4cca-8e35-2422edcfae74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:30:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7015065b-b0a1-4cca-8e35-2422edcfae74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:30:17 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7015065b-b0a1-4cca-8e35-2422edcfae74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7d77e41-a23c-40c1-b72e-e8cace85b50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef661201-4276-45e1-bfa8-10fb2a3125ff', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:17 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7015065b-b0a1-4cca-8e35-2422edcfae74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24ebd217-2acb-4393-8392-20ed10424bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:17 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-7015065b-b0a1-4cca-8e35-2422edcfae74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Volume volume-ef661201-4276-45e1-bfa8-10fb2a3125ff (ef661201-4276-45e1-bfa8-10fb2a3125ff): created successfully Nov 03 07:30:17 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7015065b-b0a1-4cca-8e35-2422edcfae74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24ebd217-2acb-4393-8392-20ed10424bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:17 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7015065b-b0a1-4cca-8e35-2422edcfae74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Flow 'volume_create_manager' (6e4057f2-e3e6-4f55-b7ed-0e47de840e9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:30:17 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-7015065b-b0a1-4cca-8e35-2422edcfae74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Created volume successfully. Nov 03 07:30:18 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-2e4841b7-efaa-40c5-b0a4-f29b0a25a401 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:30:18 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-2e4841b7-efaa-40c5-b0a4-f29b0a25a401 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:30:18 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-2e4841b7-efaa-40c5-b0a4-f29b0a25a401 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Creating offline snapshot c311682b-8e28-4ec0-9581-87b9ecf21502 of volume ef661201-4276-45e1-bfa8-10fb2a3125ff {{(pid=86875) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:30:18 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6a8c9f-8be5-4b0b-8127-719eb9e0ee83]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:30:18 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2e4841b7-efaa-40c5-b0a4-f29b0a25a401 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ef661201-4276-45e1-bfa8-10fb2a3125ff {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:18 devstack sudo[91047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ef661201-4276-45e1-bfa8-10fb2a3125ff Nov 03 07:30:18 devstack sudo[91047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:19 devstack sudo[91047]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:19 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2e4841b7-efaa-40c5-b0a4-f29b0a25a401 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ef661201-4276-45e1-bfa8-10fb2a3125ff" returned: 0 in 0.544s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:19 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2e4841b7-efaa-40c5-b0a4-f29b0a25a401 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ef661201-4276-45e1-bfa8-10fb2a3125ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ef661201-4276-45e1-bfa8-10fb2a3125ff.c311682b-8e28-4ec0-9581-87b9ecf21502 1G {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:19 devstack sudo[91052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ef661201-4276-45e1-bfa8-10fb2a3125ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ef661201-4276-45e1-bfa8-10fb2a3125ff.c311682b-8e28-4ec0-9581-87b9ecf21502 1G Nov 03 07:30:19 devstack sudo[91052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:19 devstack sudo[91052]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:19 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2e4841b7-efaa-40c5-b0a4-f29b0a25a401 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ef661201-4276-45e1-bfa8-10fb2a3125ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ef661201-4276-45e1-bfa8-10fb2a3125ff.c311682b-8e28-4ec0-9581-87b9ecf21502 1G" returned: 0 in 0.585s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:19 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2e4841b7-efaa-40c5-b0a4-f29b0a25a401 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef661201-4276-45e1-bfa8-10fb2a3125ff -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ef661201-4276-45e1-bfa8-10fb2a3125ff.c311682b-8e28-4ec0-9581-87b9ecf21502 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:19 devstack sudo[91060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef661201-4276-45e1-bfa8-10fb2a3125ff -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ef661201-4276-45e1-bfa8-10fb2a3125ff.c311682b-8e28-4ec0-9581-87b9ecf21502 Nov 03 07:30:19 devstack sudo[91060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:20 devstack sudo[91060]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2e4841b7-efaa-40c5-b0a4-f29b0a25a401 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef661201-4276-45e1-bfa8-10fb2a3125ff -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ef661201-4276-45e1-bfa8-10fb2a3125ff.c311682b-8e28-4ec0-9581-87b9ecf21502" returned: 0 in 0.355s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:20 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-2e4841b7-efaa-40c5-b0a4-f29b0a25a401 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ef661201-4276-45e1-bfa8-10fb2a3125ff.c311682b-8e28-4ec0-9581-87b9ecf21502 is being set with open permissions: ugo+rw Nov 03 07:30:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2e4841b7-efaa-40c5-b0a4-f29b0a25a401 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ef661201-4276-45e1-bfa8-10fb2a3125ff.c311682b-8e28-4ec0-9581-87b9ecf21502 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:20 devstack sudo[91065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ef661201-4276-45e1-bfa8-10fb2a3125ff.c311682b-8e28-4ec0-9581-87b9ecf21502 Nov 03 07:30:20 devstack sudo[91065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:20 devstack sudo[91065]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2e4841b7-efaa-40c5-b0a4-f29b0a25a401 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ef661201-4276-45e1-bfa8-10fb2a3125ff.c311682b-8e28-4ec0-9581-87b9ecf21502" returned: 0 in 0.287s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2e4841b7-efaa-40c5-b0a4-f29b0a25a401 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ef661201-4276-45e1-bfa8-10fb2a3125ff.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:20 devstack sudo[91068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ef661201-4276-45e1-bfa8-10fb2a3125ff.info Nov 03 07:30:20 devstack sudo[91068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:20 devstack sudo[91068]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2e4841b7-efaa-40c5-b0a4-f29b0a25a401 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ef661201-4276-45e1-bfa8-10fb2a3125ff.info" returned: 0 in 0.312s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:20 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-2e4841b7-efaa-40c5-b0a4-f29b0a25a401 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ef661201-4276-45e1-bfa8-10fb2a3125ff.info is being set with open permissions: ugo+rw Nov 03 07:30:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2e4841b7-efaa-40c5-b0a4-f29b0a25a401 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ef661201-4276-45e1-bfa8-10fb2a3125ff.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:20 devstack sudo[91071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ef661201-4276-45e1-bfa8-10fb2a3125ff.info Nov 03 07:30:20 devstack sudo[91071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:21 devstack sudo[91071]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2e4841b7-efaa-40c5-b0a4-f29b0a25a401 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ef661201-4276-45e1-bfa8-10fb2a3125ff.info" returned: 0 in 0.276s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-2e4841b7-efaa-40c5-b0a4-f29b0a25a401 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.494s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:30:21 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-2e4841b7-efaa-40c5-b0a4-f29b0a25a401 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Create snapshot completed successfully Nov 03 07:30:22 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-e4c225bc-323e-4509-9444-8c40c540a9f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Acquiring lock "cinder-c311682b-8e28-4ec0-9581-87b9ecf21502-delete_snapshot" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:30:22 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-e4c225bc-323e-4509-9444-8c40c540a9f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Lock "cinder-c311682b-8e28-4ec0-9581-87b9ecf21502-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:30:22 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-e4c225bc-323e-4509-9444-8c40c540a9f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Acquiring lock "cinder-quobyte-ef661201-4276-45e1-bfa8-10fb2a3125ff" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:30:22 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-e4c225bc-323e-4509-9444-8c40c540a9f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Lock "cinder-quobyte-ef661201-4276-45e1-bfa8-10fb2a3125ff" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:30:22 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-e4c225bc-323e-4509-9444-8c40c540a9f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Acquiring lock "cinder-quobyte-c311682b-8e28-4ec0-9581-87b9ecf21502" by "_delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:30:22 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-e4c225bc-323e-4509-9444-8c40c540a9f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Lock "cinder-quobyte-c311682b-8e28-4ec0-9581-87b9ecf21502" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:30:22 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-e4c225bc-323e-4509-9444-8c40c540a9f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Deleting offline snapshot c311682b-8e28-4ec0-9581-87b9ecf21502 of volume ef661201-4276-45e1-bfa8-10fb2a3125ff {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:30:22 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-e4c225bc-323e-4509-9444-8c40c540a9f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] snapshot_file for this snap is: volume-ef661201-4276-45e1-bfa8-10fb2a3125ff.c311682b-8e28-4ec0-9581-87b9ecf21502 {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:30:22 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b63fb0-a092-415f-93ab-72950e9b45c1]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:30:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e4c225bc-323e-4509-9444-8c40c540a9f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ef661201-4276-45e1-bfa8-10fb2a3125ff.c311682b-8e28-4ec0-9581-87b9ecf21502 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:22 devstack sudo[91096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ef661201-4276-45e1-bfa8-10fb2a3125ff.c311682b-8e28-4ec0-9581-87b9ecf21502 Nov 03 07:30:22 devstack sudo[91096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:23 devstack sudo[91096]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e4c225bc-323e-4509-9444-8c40c540a9f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ef661201-4276-45e1-bfa8-10fb2a3125ff.c311682b-8e28-4ec0-9581-87b9ecf21502" returned: 0 in 0.512s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:23 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-e4c225bc-323e-4509-9444-8c40c540a9f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef661201-4276-45e1-bfa8-10fb2a3125ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:30:23 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64e0b88-1f57-4578-9120-e1ed0576115e]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:30:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e4c225bc-323e-4509-9444-8c40c540a9f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ef661201-4276-45e1-bfa8-10fb2a3125ff {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:23 devstack sudo[91121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ef661201-4276-45e1-bfa8-10fb2a3125ff Nov 03 07:30:23 devstack sudo[91121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:23 devstack sudo[91121]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e4c225bc-323e-4509-9444-8c40c540a9f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ef661201-4276-45e1-bfa8-10fb2a3125ff" returned: 0 in 0.455s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e4c225bc-323e-4509-9444-8c40c540a9f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ef661201-4276-45e1-bfa8-10fb2a3125ff.c311682b-8e28-4ec0-9581-87b9ecf21502 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:23 devstack sudo[91126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ef661201-4276-45e1-bfa8-10fb2a3125ff.c311682b-8e28-4ec0-9581-87b9ecf21502 Nov 03 07:30:23 devstack sudo[91126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:24 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf357ac9-fc01-471f-9e66-9c4ae7c81115 tempest-VolumeQuotasNegativeTestJSON-1699577606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:30:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-cf357ac9-fc01-471f-9e66-9c4ae7c81115 tempest-VolumeQuotasNegativeTestJSON-1699577606 None] Flow 'volume_create_manager' (6f2b117d-46a7-4086-8418-192bf94ecab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:30:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-cf357ac9-fc01-471f-9e66-9c4ae7c81115 tempest-VolumeQuotasNegativeTestJSON-1699577606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b41930b1-1d7b-44c5-91c9-15bfa1cd458b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-cf357ac9-fc01-471f-9e66-9c4ae7c81115 tempest-VolumeQuotasNegativeTestJSON-1699577606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b41930b1-1d7b-44c5-91c9-15bfa1cd458b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1457971566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2693634c-33e5-49da-b308-6a21249049b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00f6671c8fc3438585d24f85218187c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:30:24Z,use_quota=True,user_id='81d7d63850e841f3857854cce550f526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-cf357ac9-fc01-471f-9e66-9c4ae7c81115 tempest-VolumeQuotasNegativeTestJSON-1699577606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (830b1d4e-be8f-49b8-85f0-2d5d52745035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-cf357ac9-fc01-471f-9e66-9c4ae7c81115 tempest-VolumeQuotasNegativeTestJSON-1699577606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (830b1d4e-be8f-49b8-85f0-2d5d52745035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-cf357ac9-fc01-471f-9e66-9c4ae7c81115 tempest-VolumeQuotasNegativeTestJSON-1699577606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de485b49-70ac-4c64-b20c-40b14457cda3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-cf357ac9-fc01-471f-9e66-9c4ae7c81115 tempest-VolumeQuotasNegativeTestJSON-1699577606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de485b49-70ac-4c64-b20c-40b14457cda3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2693634c-33e5-49da-b308-6a21249049b6', 'volume_name': 'volume-2693634c-33e5-49da-b308-6a21249049b6', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-cf357ac9-fc01-471f-9e66-9c4ae7c81115 tempest-VolumeQuotasNegativeTestJSON-1699577606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68062b99-9727-440d-89fd-ae2404fff3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-cf357ac9-fc01-471f-9e66-9c4ae7c81115 tempest-VolumeQuotasNegativeTestJSON-1699577606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68062b99-9727-440d-89fd-ae2404fff3ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-cf357ac9-fc01-471f-9e66-9c4ae7c81115 tempest-VolumeQuotasNegativeTestJSON-1699577606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b6e20be-07bb-4feb-974c-2b02a164a19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:24 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-cf357ac9-fc01-471f-9e66-9c4ae7c81115 tempest-VolumeQuotasNegativeTestJSON-1699577606 None] Volume 2693634c-33e5-49da-b308-6a21249049b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2693634c-33e5-49da-b308-6a21249049b6', 'volume_size': 1} Nov 03 07:30:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-cf357ac9-fc01-471f-9e66-9c4ae7c81115 tempest-VolumeQuotasNegativeTestJSON-1699577606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:30:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-cf357ac9-fc01-471f-9e66-9c4ae7c81115 tempest-VolumeQuotasNegativeTestJSON-1699577606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:30:24 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-cf357ac9-fc01-471f-9e66-9c4ae7c81115 tempest-VolumeQuotasNegativeTestJSON-1699577606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1457971566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2693634c-33e5-49da-b308-6a21249049b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00f6671c8fc3438585d24f85218187c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:30:24Z,use_quota=True,user_id='81d7d63850e841f3857854cce550f526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:30:24 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-cf357ac9-fc01-471f-9e66-9c4ae7c81115 tempest-VolumeQuotasNegativeTestJSON-1699577606 None] Creating volume 2693634c-33e5-49da-b308-6a21249049b6 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:30:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-cf357ac9-fc01-471f-9e66-9c4ae7c81115 tempest-VolumeQuotasNegativeTestJSON-1699577606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:30:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-cf357ac9-fc01-471f-9e66-9c4ae7c81115 tempest-VolumeQuotasNegativeTestJSON-1699577606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:30:24 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-cf357ac9-fc01-471f-9e66-9c4ae7c81115 tempest-VolumeQuotasNegativeTestJSON-1699577606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:30:24 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-cf357ac9-fc01-471f-9e66-9c4ae7c81115 tempest-VolumeQuotasNegativeTestJSON-1699577606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:30:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-cf357ac9-fc01-471f-9e66-9c4ae7c81115 tempest-VolumeQuotasNegativeTestJSON-1699577606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:30:24 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-cf357ac9-fc01-471f-9e66-9c4ae7c81115 tempest-VolumeQuotasNegativeTestJSON-1699577606 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:30:24 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-cf357ac9-fc01-471f-9e66-9c4ae7c81115 tempest-VolumeQuotasNegativeTestJSON-1699577606 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:30:24 devstack sudo[91126]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-cf357ac9-fc01-471f-9e66-9c4ae7c81115 tempest-VolumeQuotasNegativeTestJSON-1699577606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2693634c-33e5-49da-b308-6a21249049b6 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e4c225bc-323e-4509-9444-8c40c540a9f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ef661201-4276-45e1-bfa8-10fb2a3125ff.c311682b-8e28-4ec0-9581-87b9ecf21502" returned: 0 in 0.373s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e4c225bc-323e-4509-9444-8c40c540a9f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ef661201-4276-45e1-bfa8-10fb2a3125ff.c311682b-8e28-4ec0-9581-87b9ecf21502 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:24 devstack sudo[91132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2693634c-33e5-49da-b308-6a21249049b6 1073741824 Nov 03 07:30:24 devstack sudo[91132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:24 devstack sudo[91133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ef661201-4276-45e1-bfa8-10fb2a3125ff.c311682b-8e28-4ec0-9581-87b9ecf21502 Nov 03 07:30:24 devstack sudo[91133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:24 devstack sudo[91133]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e4c225bc-323e-4509-9444-8c40c540a9f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ef661201-4276-45e1-bfa8-10fb2a3125ff.c311682b-8e28-4ec0-9581-87b9ecf21502" returned: 0 in 0.253s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:24 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-e4c225bc-323e-4509-9444-8c40c540a9f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Lock "cinder-quobyte-c311682b-8e28-4ec0-9581-87b9ecf21502" released by "_delete_snapshot" :: held 1.747s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:30:24 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-e4c225bc-323e-4509-9444-8c40c540a9f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Lock "cinder-quobyte-ef661201-4276-45e1-bfa8-10fb2a3125ff" released by "delete_snapshot" :: held 1.783s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:30:24 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-e4c225bc-323e-4509-9444-8c40c540a9f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Created reservations ['15392800-29e7-4780-a072-274b0c3c1ba6', '47c0848f-c675-4da7-b1ab-f40628259de0', '9218c1bb-ae42-45a8-8a0b-b35e0a36702f', 'fa890ccf-3800-4102-9de0-16dd70e2700d'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:30:24 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-e4c225bc-323e-4509-9444-8c40c540a9f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Delete snapshot completed successfully. Nov 03 07:30:24 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-e4c225bc-323e-4509-9444-8c40c540a9f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Lock "cinder-c311682b-8e28-4ec0-9581-87b9ecf21502-delete_snapshot" released by "delete_snapshot" :: held 1.963s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:30:24 devstack sudo[91132]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-cf357ac9-fc01-471f-9e66-9c4ae7c81115 tempest-VolumeQuotasNegativeTestJSON-1699577606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2693634c-33e5-49da-b308-6a21249049b6 1073741824" returned: 0 in 0.501s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-cf357ac9-fc01-471f-9e66-9c4ae7c81115 tempest-VolumeQuotasNegativeTestJSON-1699577606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2693634c-33e5-49da-b308-6a21249049b6 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:24 devstack sudo[91141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2693634c-33e5-49da-b308-6a21249049b6 Nov 03 07:30:24 devstack sudo[91141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:24 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-8c0d8af3-d0e4-4982-801f-7991ecf2d485 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Acquiring lock "cinder-ef661201-4276-45e1-bfa8-10fb2a3125ff-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:30:24 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-8c0d8af3-d0e4-4982-801f-7991ecf2d485 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Lock "cinder-ef661201-4276-45e1-bfa8-10fb2a3125ff-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:30:24 devstack sudo[91141]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:24 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-8c0d8af3-d0e4-4982-801f-7991ecf2d485 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Acquiring lock "cinder-quobyte-ef661201-4276-45e1-bfa8-10fb2a3125ff" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:30:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-cf357ac9-fc01-471f-9e66-9c4ae7c81115 tempest-VolumeQuotasNegativeTestJSON-1699577606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2693634c-33e5-49da-b308-6a21249049b6" returned: 0 in 0.300s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:24 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-cf357ac9-fc01-471f-9e66-9c4ae7c81115 tempest-VolumeQuotasNegativeTestJSON-1699577606 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:30:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-cf357ac9-fc01-471f-9e66-9c4ae7c81115 tempest-VolumeQuotasNegativeTestJSON-1699577606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:30:24 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-8c0d8af3-d0e4-4982-801f-7991ecf2d485 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Lock "cinder-quobyte-ef661201-4276-45e1-bfa8-10fb2a3125ff" acquired by "delete_volume" :: waited 0.019s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:30:25 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-cf357ac9-fc01-471f-9e66-9c4ae7c81115 tempest-VolumeQuotasNegativeTestJSON-1699577606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b6e20be-07bb-4feb-974c-2b02a164a19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2693634c-33e5-49da-b308-6a21249049b6', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:25 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-cf357ac9-fc01-471f-9e66-9c4ae7c81115 tempest-VolumeQuotasNegativeTestJSON-1699577606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a7aae62-f05b-4363-be75-50ad129b4845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:25 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49812ca-9ca5-4a48-ba1f-ce6caebe9a41]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:30:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8c0d8af3-d0e4-4982-801f-7991ecf2d485 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ef661201-4276-45e1-bfa8-10fb2a3125ff {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:25 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-cf357ac9-fc01-471f-9e66-9c4ae7c81115 tempest-VolumeQuotasNegativeTestJSON-1699577606 None] Volume volume-2693634c-33e5-49da-b308-6a21249049b6 (2693634c-33e5-49da-b308-6a21249049b6): created successfully Nov 03 07:30:25 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-cf357ac9-fc01-471f-9e66-9c4ae7c81115 tempest-VolumeQuotasNegativeTestJSON-1699577606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a7aae62-f05b-4363-be75-50ad129b4845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:25 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-cf357ac9-fc01-471f-9e66-9c4ae7c81115 tempest-VolumeQuotasNegativeTestJSON-1699577606 None] Flow 'volume_create_manager' (6f2b117d-46a7-4086-8418-192bf94ecab3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:30:25 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-cf357ac9-fc01-471f-9e66-9c4ae7c81115 tempest-VolumeQuotasNegativeTestJSON-1699577606 None] Created volume successfully. Nov 03 07:30:25 devstack sudo[91144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ef661201-4276-45e1-bfa8-10fb2a3125ff Nov 03 07:30:25 devstack sudo[91144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:25 devstack sudo[91144]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8c0d8af3-d0e4-4982-801f-7991ecf2d485 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ef661201-4276-45e1-bfa8-10fb2a3125ff" returned: 0 in 0.367s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8c0d8af3-d0e4-4982-801f-7991ecf2d485 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ef661201-4276-45e1-bfa8-10fb2a3125ff {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:25 devstack sudo[91151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ef661201-4276-45e1-bfa8-10fb2a3125ff Nov 03 07:30:25 devstack sudo[91151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:25 devstack sudo[91151]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8c0d8af3-d0e4-4982-801f-7991ecf2d485 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ef661201-4276-45e1-bfa8-10fb2a3125ff" returned: 0 in 0.270s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:25 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-8c0d8af3-d0e4-4982-801f-7991ecf2d485 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Lock "cinder-quobyte-ef661201-4276-45e1-bfa8-10fb2a3125ff" released by "delete_volume" :: held 0.710s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:30:25 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-8c0d8af3-d0e4-4982-801f-7991ecf2d485 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Created reservations ['2a81229e-d09b-4c97-ba09-88e3d37628e9', '9b511506-dd56-4ac9-8f16-07cdd28e8dd2', '73e27a45-02a8-4e15-8582-fcf1ec08016f', '2ef2897c-2e3b-4f87-ac7f-b3c31e2de633'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:30:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-8c0d8af3-d0e4-4982-801f-7991ecf2d485 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:30:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-8c0d8af3-d0e4-4982-801f-7991ecf2d485 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:30:25 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-8c0d8af3-d0e4-4982-801f-7991ecf2d485 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:30:25 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-8c0d8af3-d0e4-4982-801f-7991ecf2d485 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:30:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-8c0d8af3-d0e4-4982-801f-7991ecf2d485 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:30:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8c0d8af3-d0e4-4982-801f-7991ecf2d485 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:25 devstack sudo[91168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:30:25 devstack sudo[91168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:26 devstack sudo[91168]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:26 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8c0d8af3-d0e4-4982-801f-7991ecf2d485 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.282s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:26 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-8c0d8af3-d0e4-4982-801f-7991ecf2d485 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:30:26 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-8c0d8af3-d0e4-4982-801f-7991ecf2d485 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Deleted volume successfully. Nov 03 07:30:26 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-8c0d8af3-d0e4-4982-801f-7991ecf2d485 tempest-VolumeSnapshotQuotasNegativeTestJSON-1659326882 None] Lock "cinder-ef661201-4276-45e1-bfa8-10fb2a3125ff-delete_volume" released by "delete_volume" :: held 1.253s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:30:26 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-5a77e069-05ee-4699-819b-20d56eb51607 req-02748f2b-9e7b-448a-83f2-fad46ab476c7 tempest-ServerActionsTestOtherA-1944466382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:30:26 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-5a77e069-05ee-4699-819b-20d56eb51607 req-02748f2b-9e7b-448a-83f2-fad46ab476c7 tempest-ServerActionsTestOtherA-1944466382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:30:26 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-5a77e069-05ee-4699-819b-20d56eb51607 req-02748f2b-9e7b-448a-83f2-fad46ab476c7 tempest-ServerActionsTestOtherA-1944466382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:30:26 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-5a77e069-05ee-4699-819b-20d56eb51607 req-02748f2b-9e7b-448a-83f2-fad46ab476c7 tempest-ServerActionsTestOtherA-1944466382 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1', 'name': 'volume-2cedef2e-36c7-41b1-b810-af924a9eb4ec', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '491361c4-4e0a-49d6-96b2-838dfba7b4fa', 'enforce_multipath': True} {{(pid=86875) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:30:26 devstack cinder-volume[86875]: INFO cinder.volume.manager [req-5a77e069-05ee-4699-819b-20d56eb51607 req-02748f2b-9e7b-448a-83f2-fad46ab476c7 tempest-ServerActionsTestOtherA-1944466382 None] attachment_update completed successfully. Nov 03 07:30:27 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-c9b14117-173a-40b0-b288-d6ac3eefb98e tempest-VolumeQuotasNegativeTestJSON-1699577606 None] Acquiring lock "cinder-2693634c-33e5-49da-b308-6a21249049b6-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:30:27 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-c9b14117-173a-40b0-b288-d6ac3eefb98e tempest-VolumeQuotasNegativeTestJSON-1699577606 None] Lock "cinder-2693634c-33e5-49da-b308-6a21249049b6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:30:27 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-c9b14117-173a-40b0-b288-d6ac3eefb98e tempest-VolumeQuotasNegativeTestJSON-1699577606 None] Acquiring lock "cinder-quobyte-2693634c-33e5-49da-b308-6a21249049b6" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:30:27 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-c9b14117-173a-40b0-b288-d6ac3eefb98e tempest-VolumeQuotasNegativeTestJSON-1699577606 None] Lock "cinder-quobyte-2693634c-33e5-49da-b308-6a21249049b6" acquired by "delete_volume" :: waited 0.035s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:30:27 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[607466f5-c561-438b-9ba0-6187599707b2]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:30:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c9b14117-173a-40b0-b288-d6ac3eefb98e tempest-VolumeQuotasNegativeTestJSON-1699577606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2693634c-33e5-49da-b308-6a21249049b6 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:27 devstack sudo[91211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2693634c-33e5-49da-b308-6a21249049b6 Nov 03 07:30:27 devstack sudo[91211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:28 devstack sudo[91211]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c9b14117-173a-40b0-b288-d6ac3eefb98e tempest-VolumeQuotasNegativeTestJSON-1699577606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2693634c-33e5-49da-b308-6a21249049b6" returned: 0 in 0.492s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c9b14117-173a-40b0-b288-d6ac3eefb98e tempest-VolumeQuotasNegativeTestJSON-1699577606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2693634c-33e5-49da-b308-6a21249049b6 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:28 devstack sudo[91216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2693634c-33e5-49da-b308-6a21249049b6 Nov 03 07:30:28 devstack sudo[91216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:28 devstack sudo[91216]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c9b14117-173a-40b0-b288-d6ac3eefb98e tempest-VolumeQuotasNegativeTestJSON-1699577606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2693634c-33e5-49da-b308-6a21249049b6" returned: 0 in 0.330s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:28 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-c9b14117-173a-40b0-b288-d6ac3eefb98e tempest-VolumeQuotasNegativeTestJSON-1699577606 None] Lock "cinder-quobyte-2693634c-33e5-49da-b308-6a21249049b6" released by "delete_volume" :: held 0.903s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:30:28 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-c9b14117-173a-40b0-b288-d6ac3eefb98e tempest-VolumeQuotasNegativeTestJSON-1699577606 None] Created reservations ['c497b5f9-77a2-4c96-9dd0-adab9f4d2fe2', '45832807-4f9e-4288-9475-bcd0c9cd0f30', '32a673fe-2ba2-4684-bbb0-2d8ad7521e70', '8af32c14-dc59-4b33-aafe-64b037cdadf3'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:30:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-c9b14117-173a-40b0-b288-d6ac3eefb98e tempest-VolumeQuotasNegativeTestJSON-1699577606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:30:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-c9b14117-173a-40b0-b288-d6ac3eefb98e tempest-VolumeQuotasNegativeTestJSON-1699577606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:30:28 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-c9b14117-173a-40b0-b288-d6ac3eefb98e tempest-VolumeQuotasNegativeTestJSON-1699577606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:30:28 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-c9b14117-173a-40b0-b288-d6ac3eefb98e tempest-VolumeQuotasNegativeTestJSON-1699577606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:30:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-c9b14117-173a-40b0-b288-d6ac3eefb98e tempest-VolumeQuotasNegativeTestJSON-1699577606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:30:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c9b14117-173a-40b0-b288-d6ac3eefb98e tempest-VolumeQuotasNegativeTestJSON-1699577606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:28 devstack sudo[91219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:30:28 devstack sudo[91219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:29 devstack sudo[91219]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:29 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c9b14117-173a-40b0-b288-d6ac3eefb98e tempest-VolumeQuotasNegativeTestJSON-1699577606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.487s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:29 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-c9b14117-173a-40b0-b288-d6ac3eefb98e tempest-VolumeQuotasNegativeTestJSON-1699577606 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:30:29 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-c9b14117-173a-40b0-b288-d6ac3eefb98e tempest-VolumeQuotasNegativeTestJSON-1699577606 None] Deleted volume successfully. Nov 03 07:30:29 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-c9b14117-173a-40b0-b288-d6ac3eefb98e tempest-VolumeQuotasNegativeTestJSON-1699577606 None] Lock "cinder-2693634c-33e5-49da-b308-6a21249049b6-delete_volume" released by "delete_volume" :: held 1.793s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:30:30 devstack cinder-volume[86875]: INFO cinder.volume.manager [req-e6fe8bcb-4277-45cd-a165-b00ea986ad94 req-3ce83473-1cb6-493b-94ae-832b3e8f4a5a tempest-ServerActionsTestOtherA-1944466382 None] Terminate volume connection completed successfully. Nov 03 07:30:30 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-e6fe8bcb-4277-45cd-a165-b00ea986ad94 req-3ce83473-1cb6-493b-94ae-832b3e8f4a5a tempest-ServerActionsTestOtherA-1944466382 None] Deleting attachment 491361c4-4e0a-49d6-96b2-838dfba7b4fa. {{(pid=86875) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:30:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-e6fe8bcb-4277-45cd-a165-b00ea986ad94 req-38fc4d10-0d37-4c59-9036-26bdd204a973 tempest-ServerActionsTestOtherA-1944466382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:30:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-e6fe8bcb-4277-45cd-a165-b00ea986ad94 req-38fc4d10-0d37-4c59-9036-26bdd204a973 tempest-ServerActionsTestOtherA-1944466382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:30:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-e6fe8bcb-4277-45cd-a165-b00ea986ad94 req-38fc4d10-0d37-4c59-9036-26bdd204a973 tempest-ServerActionsTestOtherA-1944466382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:30:31 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-e6fe8bcb-4277-45cd-a165-b00ea986ad94 req-38fc4d10-0d37-4c59-9036-26bdd204a973 tempest-ServerActionsTestOtherA-1944466382 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1', 'name': 'volume-2cedef2e-36c7-41b1-b810-af924a9eb4ec', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e7fd1a3f-35b2-4eb6-aeec-1d9df5275a6d', 'enforce_multipath': True} {{(pid=86875) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:30:31 devstack cinder-volume[86875]: INFO cinder.volume.manager [req-e6fe8bcb-4277-45cd-a165-b00ea986ad94 req-38fc4d10-0d37-4c59-9036-26bdd204a973 tempest-ServerActionsTestOtherA-1944466382 None] attachment_update completed successfully. Nov 03 07:30:34 devstack cinder-volume[86875]: INFO cinder.volume.manager [req-c2d0550b-578a-4dfa-8920-8ef586505010 req-9989e1b2-52fd-4150-9617-f47a57200e23 tempest-AttachVolumeTestJSON-1835319745 None] Terminate volume connection completed successfully. Nov 03 07:30:34 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-c2d0550b-578a-4dfa-8920-8ef586505010 req-9989e1b2-52fd-4150-9617-f47a57200e23 tempest-AttachVolumeTestJSON-1835319745 None] Deleting attachment 4ad037e8-eb47-417a-866a-b4c6e6867daf. {{(pid=86875) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:30:41 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5d6be15-ae67-4646-8ff2-08dd9634698e tempest-VolumeRetypeWithoutMigrationTest-222164508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:30:41 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b5d6be15-ae67-4646-8ff2-08dd9634698e tempest-VolumeRetypeWithoutMigrationTest-222164508 None] Flow 'volume_create_manager' (e43331cf-e673-475f-a2f8-88dcf59163c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:30:41 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b5d6be15-ae67-4646-8ff2-08dd9634698e tempest-VolumeRetypeWithoutMigrationTest-222164508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (695cba2f-1c57-4c86-a289-be6f47f4ed4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:41 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b5d6be15-ae67-4646-8ff2-08dd9634698e tempest-VolumeRetypeWithoutMigrationTest-222164508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (695cba2f-1c57-4c86-a289-be6f47f4ed4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:30:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1740021342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35aa994e-e9bd-48d0-8748-a5b10280bcfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5193a9ecdc7438c8e241841f26dfb9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:30:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:30:41Z,use_quota=True,user_id='43c35872328344b19b30cd67b940c2c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03122e3e-24a5-4312-b716-f74506429527),volume_type_id=03122e3e-24a5-4312-b716-f74506429527)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:41 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b5d6be15-ae67-4646-8ff2-08dd9634698e tempest-VolumeRetypeWithoutMigrationTest-222164508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff7ea7f0-9c68-4b8c-94c2-72772fe082f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:41 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b5d6be15-ae67-4646-8ff2-08dd9634698e tempest-VolumeRetypeWithoutMigrationTest-222164508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff7ea7f0-9c68-4b8c-94c2-72772fe082f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:41 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b5d6be15-ae67-4646-8ff2-08dd9634698e tempest-VolumeRetypeWithoutMigrationTest-222164508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8dc3afd-d767-4d92-9297-5423cf6bc727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:41 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b5d6be15-ae67-4646-8ff2-08dd9634698e tempest-VolumeRetypeWithoutMigrationTest-222164508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8dc3afd-d767-4d92-9297-5423cf6bc727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35aa994e-e9bd-48d0-8748-a5b10280bcfd', 'volume_name': 'volume-35aa994e-e9bd-48d0-8748-a5b10280bcfd', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:41 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b5d6be15-ae67-4646-8ff2-08dd9634698e tempest-VolumeRetypeWithoutMigrationTest-222164508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f62fd343-a790-4d7c-8814-754ab6b3309a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:41 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b5d6be15-ae67-4646-8ff2-08dd9634698e tempest-VolumeRetypeWithoutMigrationTest-222164508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f62fd343-a790-4d7c-8814-754ab6b3309a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:41 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b5d6be15-ae67-4646-8ff2-08dd9634698e tempest-VolumeRetypeWithoutMigrationTest-222164508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef27c52e-c22b-4219-81d7-05c18c07abb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:41 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-b5d6be15-ae67-4646-8ff2-08dd9634698e tempest-VolumeRetypeWithoutMigrationTest-222164508 None] Volume 35aa994e-e9bd-48d0-8748-a5b10280bcfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35aa994e-e9bd-48d0-8748-a5b10280bcfd', 'volume_size': 1} Nov 03 07:30:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b5d6be15-ae67-4646-8ff2-08dd9634698e tempest-VolumeRetypeWithoutMigrationTest-222164508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:30:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b5d6be15-ae67-4646-8ff2-08dd9634698e tempest-VolumeRetypeWithoutMigrationTest-222164508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:30:41 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b5d6be15-ae67-4646-8ff2-08dd9634698e tempest-VolumeRetypeWithoutMigrationTest-222164508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:30:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1740021342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35aa994e-e9bd-48d0-8748-a5b10280bcfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5193a9ecdc7438c8e241841f26dfb9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:30:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:30:41Z,use_quota=True,user_id='43c35872328344b19b30cd67b940c2c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03122e3e-24a5-4312-b716-f74506429527),volume_type_id=03122e3e-24a5-4312-b716-f74506429527)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:30:41 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-b5d6be15-ae67-4646-8ff2-08dd9634698e tempest-VolumeRetypeWithoutMigrationTest-222164508 None] Creating volume 35aa994e-e9bd-48d0-8748-a5b10280bcfd {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:30:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b5d6be15-ae67-4646-8ff2-08dd9634698e tempest-VolumeRetypeWithoutMigrationTest-222164508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:30:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b5d6be15-ae67-4646-8ff2-08dd9634698e tempest-VolumeRetypeWithoutMigrationTest-222164508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:30:41 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b5d6be15-ae67-4646-8ff2-08dd9634698e tempest-VolumeRetypeWithoutMigrationTest-222164508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:30:41 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b5d6be15-ae67-4646-8ff2-08dd9634698e tempest-VolumeRetypeWithoutMigrationTest-222164508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:30:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b5d6be15-ae67-4646-8ff2-08dd9634698e tempest-VolumeRetypeWithoutMigrationTest-222164508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:30:41 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b5d6be15-ae67-4646-8ff2-08dd9634698e tempest-VolumeRetypeWithoutMigrationTest-222164508 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:30:41 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-b5d6be15-ae67-4646-8ff2-08dd9634698e tempest-VolumeRetypeWithoutMigrationTest-222164508 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:30:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b5d6be15-ae67-4646-8ff2-08dd9634698e tempest-VolumeRetypeWithoutMigrationTest-222164508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35aa994e-e9bd-48d0-8748-a5b10280bcfd 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:41 devstack sudo[91428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35aa994e-e9bd-48d0-8748-a5b10280bcfd 1073741824 Nov 03 07:30:41 devstack sudo[91428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:42 devstack sudo[91428]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b5d6be15-ae67-4646-8ff2-08dd9634698e tempest-VolumeRetypeWithoutMigrationTest-222164508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35aa994e-e9bd-48d0-8748-a5b10280bcfd 1073741824" returned: 0 in 0.806s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b5d6be15-ae67-4646-8ff2-08dd9634698e tempest-VolumeRetypeWithoutMigrationTest-222164508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35aa994e-e9bd-48d0-8748-a5b10280bcfd {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:42 devstack sudo[91445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35aa994e-e9bd-48d0-8748-a5b10280bcfd Nov 03 07:30:42 devstack sudo[91445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:42 devstack sudo[91445]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b5d6be15-ae67-4646-8ff2-08dd9634698e tempest-VolumeRetypeWithoutMigrationTest-222164508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35aa994e-e9bd-48d0-8748-a5b10280bcfd" returned: 0 in 0.497s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:42 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b5d6be15-ae67-4646-8ff2-08dd9634698e tempest-VolumeRetypeWithoutMigrationTest-222164508 None] <== create_volume: return (1396ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:30:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b5d6be15-ae67-4646-8ff2-08dd9634698e tempest-VolumeRetypeWithoutMigrationTest-222164508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.403s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:30:43 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b5d6be15-ae67-4646-8ff2-08dd9634698e tempest-VolumeRetypeWithoutMigrationTest-222164508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef27c52e-c22b-4219-81d7-05c18c07abb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35aa994e-e9bd-48d0-8748-a5b10280bcfd', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:43 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b5d6be15-ae67-4646-8ff2-08dd9634698e tempest-VolumeRetypeWithoutMigrationTest-222164508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f3b89c7-aa78-45ac-9ea0-d332e3345451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:43 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-b5d6be15-ae67-4646-8ff2-08dd9634698e tempest-VolumeRetypeWithoutMigrationTest-222164508 None] Volume volume-35aa994e-e9bd-48d0-8748-a5b10280bcfd (35aa994e-e9bd-48d0-8748-a5b10280bcfd): created successfully Nov 03 07:30:43 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b5d6be15-ae67-4646-8ff2-08dd9634698e tempest-VolumeRetypeWithoutMigrationTest-222164508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f3b89c7-aa78-45ac-9ea0-d332e3345451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:43 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b5d6be15-ae67-4646-8ff2-08dd9634698e tempest-VolumeRetypeWithoutMigrationTest-222164508 None] Flow 'volume_create_manager' (e43331cf-e673-475f-a2f8-88dcf59163c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:30:43 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-b5d6be15-ae67-4646-8ff2-08dd9634698e tempest-VolumeRetypeWithoutMigrationTest-222164508 None] Created volume successfully. Nov 03 07:30:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-30063184-9fca-4aeb-8b69-708764a9ef9a tempest-VolumeRetypeWithoutMigrationTest-222164508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:30:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-30063184-9fca-4aeb-8b69-708764a9ef9a tempest-VolumeRetypeWithoutMigrationTest-222164508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:30:44 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-30063184-9fca-4aeb-8b69-708764a9ef9a tempest-VolumeRetypeWithoutMigrationTest-222164508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:30:44 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-30063184-9fca-4aeb-8b69-708764a9ef9a tempest-VolumeRetypeWithoutMigrationTest-222164508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:30:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-30063184-9fca-4aeb-8b69-708764a9ef9a tempest-VolumeRetypeWithoutMigrationTest-222164508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:30:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-30063184-9fca-4aeb-8b69-708764a9ef9a tempest-VolumeRetypeWithoutMigrationTest-222164508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:44 devstack sudo[91452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:30:44 devstack sudo[91452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-30063184-9fca-4aeb-8b69-708764a9ef9a tempest-VolumeRetypeWithoutMigrationTest-222164508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.364s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:44 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-30063184-9fca-4aeb-8b69-708764a9ef9a tempest-VolumeRetypeWithoutMigrationTest-222164508 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:30:44 devstack sudo[91452]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:44 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-30063184-9fca-4aeb-8b69-708764a9ef9a tempest-VolumeRetypeWithoutMigrationTest-222164508 None] Retype volume completed successfully. Nov 03 07:30:45 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-89439093-2c69-4660-9ad7-74e68e1b66b7 tempest-VolumeRetypeWithoutMigrationTest-222164508 None] Acquiring lock "cinder-35aa994e-e9bd-48d0-8748-a5b10280bcfd-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:30:45 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-89439093-2c69-4660-9ad7-74e68e1b66b7 tempest-VolumeRetypeWithoutMigrationTest-222164508 None] Lock "cinder-35aa994e-e9bd-48d0-8748-a5b10280bcfd-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:30:45 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-89439093-2c69-4660-9ad7-74e68e1b66b7 tempest-VolumeRetypeWithoutMigrationTest-222164508 None] Acquiring lock "cinder-quobyte-35aa994e-e9bd-48d0-8748-a5b10280bcfd" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:30:45 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-89439093-2c69-4660-9ad7-74e68e1b66b7 tempest-VolumeRetypeWithoutMigrationTest-222164508 None] Lock "cinder-quobyte-35aa994e-e9bd-48d0-8748-a5b10280bcfd" acquired by "delete_volume" :: waited 0.057s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:30:45 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0cb1c0b-3a01-4070-a994-3094a1b6b1cd]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:30:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-89439093-2c69-4660-9ad7-74e68e1b66b7 tempest-VolumeRetypeWithoutMigrationTest-222164508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35aa994e-e9bd-48d0-8748-a5b10280bcfd {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:45 devstack sudo[91456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35aa994e-e9bd-48d0-8748-a5b10280bcfd Nov 03 07:30:45 devstack sudo[91456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:46 devstack sudo[91456]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-89439093-2c69-4660-9ad7-74e68e1b66b7 tempest-VolumeRetypeWithoutMigrationTest-222164508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35aa994e-e9bd-48d0-8748-a5b10280bcfd" returned: 0 in 0.641s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-89439093-2c69-4660-9ad7-74e68e1b66b7 tempest-VolumeRetypeWithoutMigrationTest-222164508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35aa994e-e9bd-48d0-8748-a5b10280bcfd {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:46 devstack sudo[91461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35aa994e-e9bd-48d0-8748-a5b10280bcfd Nov 03 07:30:46 devstack sudo[91461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:47 devstack sudo[91461]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:47 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-89439093-2c69-4660-9ad7-74e68e1b66b7 tempest-VolumeRetypeWithoutMigrationTest-222164508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-35aa994e-e9bd-48d0-8748-a5b10280bcfd" returned: 0 in 0.715s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:47 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-89439093-2c69-4660-9ad7-74e68e1b66b7 tempest-VolumeRetypeWithoutMigrationTest-222164508 None] Lock "cinder-quobyte-35aa994e-e9bd-48d0-8748-a5b10280bcfd" released by "delete_volume" :: held 1.447s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:30:47 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:SELECT=77,cinder:INSERT=19,cinder:UPDATE=67,cinder:DELETE=7 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:30:47 devstack cinder-volume[86875]: WARNING cinder.quota [None req-89439093-2c69-4660-9ad7-74e68e1b66b7 tempest-VolumeRetypeWithoutMigrationTest-222164508 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:30:47 devstack cinder-volume[86875]: WARNING cinder.quota [None req-89439093-2c69-4660-9ad7-74e68e1b66b7 tempest-VolumeRetypeWithoutMigrationTest-222164508 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:30:47 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-89439093-2c69-4660-9ad7-74e68e1b66b7 tempest-VolumeRetypeWithoutMigrationTest-222164508 None] Created reservations ['a7b2c089-cbb8-402a-abd1-397af0739f3e', '102391a9-78a1-44fc-a422-267e28e72f47', '43018104-072d-402f-92e4-34b3e13f25e7', '5c1979f1-2418-4a66-9bdf-98edef4184f4'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:30:47 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-89439093-2c69-4660-9ad7-74e68e1b66b7 tempest-VolumeRetypeWithoutMigrationTest-222164508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:30:47 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-89439093-2c69-4660-9ad7-74e68e1b66b7 tempest-VolumeRetypeWithoutMigrationTest-222164508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:30:47 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-89439093-2c69-4660-9ad7-74e68e1b66b7 tempest-VolumeRetypeWithoutMigrationTest-222164508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:30:47 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-89439093-2c69-4660-9ad7-74e68e1b66b7 tempest-VolumeRetypeWithoutMigrationTest-222164508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:30:47 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-89439093-2c69-4660-9ad7-74e68e1b66b7 tempest-VolumeRetypeWithoutMigrationTest-222164508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:30:47 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-89439093-2c69-4660-9ad7-74e68e1b66b7 tempest-VolumeRetypeWithoutMigrationTest-222164508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:47 devstack sudo[91465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:30:47 devstack sudo[91465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:30:48 devstack sudo[91465]: pam_unix(sudo:session): session closed for user root Nov 03 07:30:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-89439093-2c69-4660-9ad7-74e68e1b66b7 tempest-VolumeRetypeWithoutMigrationTest-222164508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.646s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:30:48 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-89439093-2c69-4660-9ad7-74e68e1b66b7 tempest-VolumeRetypeWithoutMigrationTest-222164508 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:30:48 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-89439093-2c69-4660-9ad7-74e68e1b66b7 tempest-VolumeRetypeWithoutMigrationTest-222164508 None] Deleted volume successfully. Nov 03 07:30:48 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-89439093-2c69-4660-9ad7-74e68e1b66b7 tempest-VolumeRetypeWithoutMigrationTest-222164508 None] Lock "cinder-35aa994e-e9bd-48d0-8748-a5b10280bcfd-delete_volume" released by "delete_volume" :: held 2.588s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:30:57 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:UPDATE=7,cinder:SELECT=3 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:30:58 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:SELECT=74,cinder:UPDATE=81,cinder:INSERT=14,cinder:DELETE=6 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:30:59 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-209bbd6d-6dc9-44e1-a31a-1dbba36af2c3 tempest-VolumesServicesTestJSON-964728807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:30:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-209bbd6d-6dc9-44e1-a31a-1dbba36af2c3 tempest-VolumesServicesTestJSON-964728807 None] Flow 'volume_create_manager' (69e03c16-2d23-421b-81f0-010cd35de506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:30:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-209bbd6d-6dc9-44e1-a31a-1dbba36af2c3 tempest-VolumesServicesTestJSON-964728807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ac3b63b-11dd-4be7-845b-dd8474976454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-209bbd6d-6dc9-44e1-a31a-1dbba36af2c3 tempest-VolumesServicesTestJSON-964728807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ac3b63b-11dd-4be7-845b-dd8474976454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1812759695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19ca4cf5-8842-466c-ae50-9a9103969fe9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='309ad966dc9c4097ad2b70a150401e6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:30:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:30:59Z,use_quota=True,user_id='7f409400e5a642a99cf62819c0a20520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-209bbd6d-6dc9-44e1-a31a-1dbba36af2c3 tempest-VolumesServicesTestJSON-964728807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f823ef90-f786-4684-83cb-30c4eb9381d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-209bbd6d-6dc9-44e1-a31a-1dbba36af2c3 tempest-VolumesServicesTestJSON-964728807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f823ef90-f786-4684-83cb-30c4eb9381d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-209bbd6d-6dc9-44e1-a31a-1dbba36af2c3 tempest-VolumesServicesTestJSON-964728807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (294a7e57-4273-4303-8480-9ecbbe64f9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-209bbd6d-6dc9-44e1-a31a-1dbba36af2c3 tempest-VolumesServicesTestJSON-964728807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (294a7e57-4273-4303-8480-9ecbbe64f9eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19ca4cf5-8842-466c-ae50-9a9103969fe9', 'volume_name': 'volume-19ca4cf5-8842-466c-ae50-9a9103969fe9', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-209bbd6d-6dc9-44e1-a31a-1dbba36af2c3 tempest-VolumesServicesTestJSON-964728807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df88a669-60f1-4ef5-9050-c0b10c4cfa6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-209bbd6d-6dc9-44e1-a31a-1dbba36af2c3 tempest-VolumesServicesTestJSON-964728807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df88a669-60f1-4ef5-9050-c0b10c4cfa6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:30:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-209bbd6d-6dc9-44e1-a31a-1dbba36af2c3 tempest-VolumesServicesTestJSON-964728807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e7f1ab0-c83a-4bf4-b4d0-b24a8ca16594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:30:59 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-209bbd6d-6dc9-44e1-a31a-1dbba36af2c3 tempest-VolumesServicesTestJSON-964728807 None] Volume 19ca4cf5-8842-466c-ae50-9a9103969fe9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19ca4cf5-8842-466c-ae50-9a9103969fe9', 'volume_size': 1} Nov 03 07:30:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-209bbd6d-6dc9-44e1-a31a-1dbba36af2c3 tempest-VolumesServicesTestJSON-964728807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:30:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-209bbd6d-6dc9-44e1-a31a-1dbba36af2c3 tempest-VolumesServicesTestJSON-964728807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:30:59 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-209bbd6d-6dc9-44e1-a31a-1dbba36af2c3 tempest-VolumesServicesTestJSON-964728807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1812759695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19ca4cf5-8842-466c-ae50-9a9103969fe9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='309ad966dc9c4097ad2b70a150401e6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:30:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:30:59Z,use_quota=True,user_id='7f409400e5a642a99cf62819c0a20520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:30:59 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-209bbd6d-6dc9-44e1-a31a-1dbba36af2c3 tempest-VolumesServicesTestJSON-964728807 None] Creating volume 19ca4cf5-8842-466c-ae50-9a9103969fe9 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:30:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-209bbd6d-6dc9-44e1-a31a-1dbba36af2c3 tempest-VolumesServicesTestJSON-964728807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:30:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-209bbd6d-6dc9-44e1-a31a-1dbba36af2c3 tempest-VolumesServicesTestJSON-964728807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:30:59 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-209bbd6d-6dc9-44e1-a31a-1dbba36af2c3 tempest-VolumesServicesTestJSON-964728807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:30:59 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-209bbd6d-6dc9-44e1-a31a-1dbba36af2c3 tempest-VolumesServicesTestJSON-964728807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:30:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-209bbd6d-6dc9-44e1-a31a-1dbba36af2c3 tempest-VolumesServicesTestJSON-964728807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:30:59 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-209bbd6d-6dc9-44e1-a31a-1dbba36af2c3 tempest-VolumesServicesTestJSON-964728807 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:30:59 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-209bbd6d-6dc9-44e1-a31a-1dbba36af2c3 tempest-VolumesServicesTestJSON-964728807 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:30:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-209bbd6d-6dc9-44e1-a31a-1dbba36af2c3 tempest-VolumesServicesTestJSON-964728807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-19ca4cf5-8842-466c-ae50-9a9103969fe9 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:30:59 devstack sudo[91504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-19ca4cf5-8842-466c-ae50-9a9103969fe9 1073741824 Nov 03 07:30:59 devstack sudo[91504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:00 devstack sudo[91504]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-209bbd6d-6dc9-44e1-a31a-1dbba36af2c3 tempest-VolumesServicesTestJSON-964728807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-19ca4cf5-8842-466c-ae50-9a9103969fe9 1073741824" returned: 0 in 0.836s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-209bbd6d-6dc9-44e1-a31a-1dbba36af2c3 tempest-VolumesServicesTestJSON-964728807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-19ca4cf5-8842-466c-ae50-9a9103969fe9 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:00 devstack sudo[91511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-19ca4cf5-8842-466c-ae50-9a9103969fe9 Nov 03 07:31:00 devstack sudo[91511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:00 devstack sudo[91511]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-209bbd6d-6dc9-44e1-a31a-1dbba36af2c3 tempest-VolumesServicesTestJSON-964728807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-19ca4cf5-8842-466c-ae50-9a9103969fe9" returned: 0 in 0.315s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:00 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-209bbd6d-6dc9-44e1-a31a-1dbba36af2c3 tempest-VolumesServicesTestJSON-964728807 None] <== create_volume: return (1235ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:31:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-209bbd6d-6dc9-44e1-a31a-1dbba36af2c3 tempest-VolumesServicesTestJSON-964728807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.239s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-209bbd6d-6dc9-44e1-a31a-1dbba36af2c3 tempest-VolumesServicesTestJSON-964728807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e7f1ab0-c83a-4bf4-b4d0-b24a8ca16594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19ca4cf5-8842-466c-ae50-9a9103969fe9', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-209bbd6d-6dc9-44e1-a31a-1dbba36af2c3 tempest-VolumesServicesTestJSON-964728807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (722d4206-2c3f-4e6b-aadf-4e01821f01ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:00 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-209bbd6d-6dc9-44e1-a31a-1dbba36af2c3 tempest-VolumesServicesTestJSON-964728807 None] Volume volume-19ca4cf5-8842-466c-ae50-9a9103969fe9 (19ca4cf5-8842-466c-ae50-9a9103969fe9): created successfully Nov 03 07:31:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-209bbd6d-6dc9-44e1-a31a-1dbba36af2c3 tempest-VolumesServicesTestJSON-964728807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (722d4206-2c3f-4e6b-aadf-4e01821f01ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-209bbd6d-6dc9-44e1-a31a-1dbba36af2c3 tempest-VolumesServicesTestJSON-964728807 None] Flow 'volume_create_manager' (69e03c16-2d23-421b-81f0-010cd35de506) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:31:00 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-209bbd6d-6dc9-44e1-a31a-1dbba36af2c3 tempest-VolumesServicesTestJSON-964728807 None] Created volume successfully. Nov 03 07:31:01 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-0626ffc4-0e67-46b7-ab4a-a4c567905222 tempest-VolumesServicesTestJSON-964728807 None] Acquiring lock "cinder-19ca4cf5-8842-466c-ae50-9a9103969fe9-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:01 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-0626ffc4-0e67-46b7-ab4a-a4c567905222 tempest-VolumesServicesTestJSON-964728807 None] Lock "cinder-19ca4cf5-8842-466c-ae50-9a9103969fe9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:01 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-0626ffc4-0e67-46b7-ab4a-a4c567905222 tempest-VolumesServicesTestJSON-964728807 None] Acquiring lock "cinder-quobyte-19ca4cf5-8842-466c-ae50-9a9103969fe9" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:01 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-0626ffc4-0e67-46b7-ab4a-a4c567905222 tempest-VolumesServicesTestJSON-964728807 None] Lock "cinder-quobyte-19ca4cf5-8842-466c-ae50-9a9103969fe9" acquired by "delete_volume" :: waited 0.028s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:01 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d68e72-8ed8-4290-af6a-739abc9c6a52]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:31:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0626ffc4-0e67-46b7-ab4a-a4c567905222 tempest-VolumesServicesTestJSON-964728807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-19ca4cf5-8842-466c-ae50-9a9103969fe9 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:02 devstack sudo[91514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-19ca4cf5-8842-466c-ae50-9a9103969fe9 Nov 03 07:31:02 devstack sudo[91514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:02 devstack sudo[91514]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0626ffc4-0e67-46b7-ab4a-a4c567905222 tempest-VolumesServicesTestJSON-964728807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-19ca4cf5-8842-466c-ae50-9a9103969fe9" returned: 0 in 0.592s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0626ffc4-0e67-46b7-ab4a-a4c567905222 tempest-VolumesServicesTestJSON-964728807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-19ca4cf5-8842-466c-ae50-9a9103969fe9 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:02 devstack sudo[91519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-19ca4cf5-8842-466c-ae50-9a9103969fe9 Nov 03 07:31:02 devstack sudo[91519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:02 devstack sudo[91519]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0626ffc4-0e67-46b7-ab4a-a4c567905222 tempest-VolumesServicesTestJSON-964728807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-19ca4cf5-8842-466c-ae50-9a9103969fe9" returned: 0 in 0.276s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:02 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-0626ffc4-0e67-46b7-ab4a-a4c567905222 tempest-VolumesServicesTestJSON-964728807 None] Lock "cinder-quobyte-19ca4cf5-8842-466c-ae50-9a9103969fe9" released by "delete_volume" :: held 0.933s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:31:02 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-0626ffc4-0e67-46b7-ab4a-a4c567905222 tempest-VolumesServicesTestJSON-964728807 None] Created reservations ['c1e6ff3e-b73a-402b-993c-5d9fde001066', 'b9f0e490-ce69-472b-9e79-1899b9b1f82b', '69c5b9c8-6636-499b-bbb6-cbdcf30f28ec', 'aca212d3-b2c9-43d2-bdd3-ef5ecf5dfcd0'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:31:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0626ffc4-0e67-46b7-ab4a-a4c567905222 tempest-VolumesServicesTestJSON-964728807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0626ffc4-0e67-46b7-ab4a-a4c567905222 tempest-VolumesServicesTestJSON-964728807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:02 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-0626ffc4-0e67-46b7-ab4a-a4c567905222 tempest-VolumesServicesTestJSON-964728807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:31:02 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-0626ffc4-0e67-46b7-ab4a-a4c567905222 tempest-VolumesServicesTestJSON-964728807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:31:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0626ffc4-0e67-46b7-ab4a-a4c567905222 tempest-VolumesServicesTestJSON-964728807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0626ffc4-0e67-46b7-ab4a-a4c567905222 tempest-VolumesServicesTestJSON-964728807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:02 devstack sudo[91522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:31:02 devstack sudo[91522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:03 devstack sudo[91522]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0626ffc4-0e67-46b7-ab4a-a4c567905222 tempest-VolumesServicesTestJSON-964728807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.381s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:03 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-0626ffc4-0e67-46b7-ab4a-a4c567905222 tempest-VolumesServicesTestJSON-964728807 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:31:03 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-0626ffc4-0e67-46b7-ab4a-a4c567905222 tempest-VolumesServicesTestJSON-964728807 None] Deleted volume successfully. Nov 03 07:31:03 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-0626ffc4-0e67-46b7-ab4a-a4c567905222 tempest-VolumesServicesTestJSON-964728807 None] Lock "cinder-19ca4cf5-8842-466c-ae50-9a9103969fe9-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:31:03 devstack cinder-volume[86875]: DEBUG oslo_service.periodic_task [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86875) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:31:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:31:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:31:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:03 devstack sudo[91525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:31:03 devstack sudo[91525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:03 devstack sudo[91525]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.336s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:03 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:31:03 devstack cinder-volume[86875]: DEBUG oslo_service.periodic_task [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running periodic task VolumeManager._thread_info {{(pid=86875) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:31:03 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] thread count: 8 {{(pid=86875) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:31:03 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] thread info: [<_MainThread(MainThread, started 125626325639296)>, , , , , , , ] {{(pid=86875) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:31:12 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:SELECT=7,cinder:UPDATE=11,cinder:INSERT=2 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:31:13 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:SELECT=7,cinder:UPDATE=11,cinder:INSERT=3,cinder:DELETE=2 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:31:16 devstack cinder-volume[86875]: INFO cinder.volume.manager [req-6cbb1095-24d2-482c-92c4-a8077fa936d4 req-53b70aa1-287c-4dd3-8616-9c50a250b2d0 tempest-ServerActionsTestOtherA-1944466382 None] Terminate volume connection completed successfully. Nov 03 07:31:16 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-6cbb1095-24d2-482c-92c4-a8077fa936d4 req-53b70aa1-287c-4dd3-8616-9c50a250b2d0 tempest-ServerActionsTestOtherA-1944466382 None] Deleting attachment e7fd1a3f-35b2-4eb6-aeec-1d9df5275a6d. {{(pid=86875) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:31:21 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-11d3b7ca-ab05-4a44-9bd0-ab6aae9386ac tempest-VolumesActionsTest-1562044613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:31:21 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-11d3b7ca-ab05-4a44-9bd0-ab6aae9386ac tempest-VolumesActionsTest-1562044613 None] Flow 'volume_create_manager' (da90b08c-57d2-408e-8a60-f13cc6929f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:31:21 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-11d3b7ca-ab05-4a44-9bd0-ab6aae9386ac tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (530be44b-962a-439c-90e7-1dc6760101ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:21 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-11d3b7ca-ab05-4a44-9bd0-ab6aae9386ac tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (530be44b-962a-439c-90e7-1dc6760101ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:31:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1667984808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63ce6a41-9d65-4abf-82a3-f8f467cdf8f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33fdd7b0bfb943bd87e5ddcdbd730b5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:31:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:31:21Z,use_quota=True,user_id='a96d47c1521a4560be32f33768324e83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:21 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-11d3b7ca-ab05-4a44-9bd0-ab6aae9386ac tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a127eb2d-aad2-49e7-90c2-60157fc1e264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:21 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-11d3b7ca-ab05-4a44-9bd0-ab6aae9386ac tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a127eb2d-aad2-49e7-90c2-60157fc1e264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:21 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-11d3b7ca-ab05-4a44-9bd0-ab6aae9386ac tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b69880be-cb86-417c-8ed8-6d13c779aadc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:21 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-11d3b7ca-ab05-4a44-9bd0-ab6aae9386ac tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b69880be-cb86-417c-8ed8-6d13c779aadc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63ce6a41-9d65-4abf-82a3-f8f467cdf8f4', 'volume_name': 'volume-63ce6a41-9d65-4abf-82a3-f8f467cdf8f4', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:21 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-11d3b7ca-ab05-4a44-9bd0-ab6aae9386ac tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81c9f073-7ac0-4be4-89c0-a8276ea1c77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:21 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-11d3b7ca-ab05-4a44-9bd0-ab6aae9386ac tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81c9f073-7ac0-4be4-89c0-a8276ea1c77c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:21 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-11d3b7ca-ab05-4a44-9bd0-ab6aae9386ac tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e613b89-d956-4d21-a5b2-552bf0e38f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:21 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-11d3b7ca-ab05-4a44-9bd0-ab6aae9386ac tempest-VolumesActionsTest-1562044613 None] Volume 63ce6a41-9d65-4abf-82a3-f8f467cdf8f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63ce6a41-9d65-4abf-82a3-f8f467cdf8f4', 'volume_size': 1} Nov 03 07:31:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-11d3b7ca-ab05-4a44-9bd0-ab6aae9386ac tempest-VolumesActionsTest-1562044613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-11d3b7ca-ab05-4a44-9bd0-ab6aae9386ac tempest-VolumesActionsTest-1562044613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:21 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-11d3b7ca-ab05-4a44-9bd0-ab6aae9386ac tempest-VolumesActionsTest-1562044613 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:31:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1667984808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63ce6a41-9d65-4abf-82a3-f8f467cdf8f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33fdd7b0bfb943bd87e5ddcdbd730b5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:31:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:31:21Z,use_quota=True,user_id='a96d47c1521a4560be32f33768324e83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:31:21 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-11d3b7ca-ab05-4a44-9bd0-ab6aae9386ac tempest-VolumesActionsTest-1562044613 None] Creating volume 63ce6a41-9d65-4abf-82a3-f8f467cdf8f4 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:31:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-11d3b7ca-ab05-4a44-9bd0-ab6aae9386ac tempest-VolumesActionsTest-1562044613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-11d3b7ca-ab05-4a44-9bd0-ab6aae9386ac tempest-VolumesActionsTest-1562044613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:21 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-11d3b7ca-ab05-4a44-9bd0-ab6aae9386ac tempest-VolumesActionsTest-1562044613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:31:21 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-11d3b7ca-ab05-4a44-9bd0-ab6aae9386ac tempest-VolumesActionsTest-1562044613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:31:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-11d3b7ca-ab05-4a44-9bd0-ab6aae9386ac tempest-VolumesActionsTest-1562044613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:21 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-11d3b7ca-ab05-4a44-9bd0-ab6aae9386ac tempest-VolumesActionsTest-1562044613 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:31:21 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-11d3b7ca-ab05-4a44-9bd0-ab6aae9386ac tempest-VolumesActionsTest-1562044613 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:31:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-11d3b7ca-ab05-4a44-9bd0-ab6aae9386ac tempest-VolumesActionsTest-1562044613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-63ce6a41-9d65-4abf-82a3-f8f467cdf8f4 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:21 devstack sudo[91704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-63ce6a41-9d65-4abf-82a3-f8f467cdf8f4 1073741824 Nov 03 07:31:21 devstack sudo[91704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:22 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2a4d430-c962-4522-8e06-68a6e49fd6b5 tempest-AbsoluteLimitsTests-523470984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:31:22 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e2a4d430-c962-4522-8e06-68a6e49fd6b5 tempest-AbsoluteLimitsTests-523470984 None] Flow 'volume_create_manager' (34544116-6531-443f-9b73-700f5acbf98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:31:22 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e2a4d430-c962-4522-8e06-68a6e49fd6b5 tempest-AbsoluteLimitsTests-523470984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41160e66-3736-4dd6-b8c5-8e47f8bbcf84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:22 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e2a4d430-c962-4522-8e06-68a6e49fd6b5 tempest-AbsoluteLimitsTests-523470984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41160e66-3736-4dd6-b8c5-8e47f8bbcf84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:31:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-591657872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e7b5e6f-600e-4901-ab9d-c7693cdfd469,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c462174ca4344a049106039cc52a8beb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:31:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:31:22Z,use_quota=True,user_id='bd15d699872845be92794ae1c8834db9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:22 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e2a4d430-c962-4522-8e06-68a6e49fd6b5 tempest-AbsoluteLimitsTests-523470984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4713f086-5928-478f-ae22-ebfba5f15e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:22 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e2a4d430-c962-4522-8e06-68a6e49fd6b5 tempest-AbsoluteLimitsTests-523470984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4713f086-5928-478f-ae22-ebfba5f15e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:22 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e2a4d430-c962-4522-8e06-68a6e49fd6b5 tempest-AbsoluteLimitsTests-523470984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7e3c39e-a421-4e44-b95f-6e500306a5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:22 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e2a4d430-c962-4522-8e06-68a6e49fd6b5 tempest-AbsoluteLimitsTests-523470984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7e3c39e-a421-4e44-b95f-6e500306a5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e7b5e6f-600e-4901-ab9d-c7693cdfd469', 'volume_name': 'volume-7e7b5e6f-600e-4901-ab9d-c7693cdfd469', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:22 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e2a4d430-c962-4522-8e06-68a6e49fd6b5 tempest-AbsoluteLimitsTests-523470984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d7c82d8-3533-42e3-abc8-6c3065360eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:22 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e2a4d430-c962-4522-8e06-68a6e49fd6b5 tempest-AbsoluteLimitsTests-523470984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d7c82d8-3533-42e3-abc8-6c3065360eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:22 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e2a4d430-c962-4522-8e06-68a6e49fd6b5 tempest-AbsoluteLimitsTests-523470984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69574fd5-f10b-4430-8c74-2488652414f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:22 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-e2a4d430-c962-4522-8e06-68a6e49fd6b5 tempest-AbsoluteLimitsTests-523470984 None] Volume 7e7b5e6f-600e-4901-ab9d-c7693cdfd469: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e7b5e6f-600e-4901-ab9d-c7693cdfd469', 'volume_size': 1} Nov 03 07:31:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e2a4d430-c962-4522-8e06-68a6e49fd6b5 tempest-AbsoluteLimitsTests-523470984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:22 devstack sudo[91704]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-11d3b7ca-ab05-4a44-9bd0-ab6aae9386ac tempest-VolumesActionsTest-1562044613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-63ce6a41-9d65-4abf-82a3-f8f467cdf8f4 1073741824" returned: 0 in 1.201s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-11d3b7ca-ab05-4a44-9bd0-ab6aae9386ac tempest-VolumesActionsTest-1562044613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-63ce6a41-9d65-4abf-82a3-f8f467cdf8f4 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:23 devstack sudo[91733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-63ce6a41-9d65-4abf-82a3-f8f467cdf8f4 Nov 03 07:31:23 devstack sudo[91733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:23 devstack sudo[91733]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-11d3b7ca-ab05-4a44-9bd0-ab6aae9386ac tempest-VolumesActionsTest-1562044613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-63ce6a41-9d65-4abf-82a3-f8f467cdf8f4" returned: 0 in 0.550s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:23 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-11d3b7ca-ab05-4a44-9bd0-ab6aae9386ac tempest-VolumesActionsTest-1562044613 None] <== create_volume: return (1866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:31:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-11d3b7ca-ab05-4a44-9bd0-ab6aae9386ac tempest-VolumesActionsTest-1562044613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.872s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e2a4d430-c962-4522-8e06-68a6e49fd6b5 tempest-AbsoluteLimitsTests-523470984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.750s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:23 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-e2a4d430-c962-4522-8e06-68a6e49fd6b5 tempest-AbsoluteLimitsTests-523470984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:31:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-591657872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e7b5e6f-600e-4901-ab9d-c7693cdfd469,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c462174ca4344a049106039cc52a8beb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:31:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:31:22Z,use_quota=True,user_id='bd15d699872845be92794ae1c8834db9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:31:23 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-e2a4d430-c962-4522-8e06-68a6e49fd6b5 tempest-AbsoluteLimitsTests-523470984 None] Creating volume 7e7b5e6f-600e-4901-ab9d-c7693cdfd469 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:31:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e2a4d430-c962-4522-8e06-68a6e49fd6b5 tempest-AbsoluteLimitsTests-523470984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e2a4d430-c962-4522-8e06-68a6e49fd6b5 tempest-AbsoluteLimitsTests-523470984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:23 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-e2a4d430-c962-4522-8e06-68a6e49fd6b5 tempest-AbsoluteLimitsTests-523470984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:31:23 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-e2a4d430-c962-4522-8e06-68a6e49fd6b5 tempest-AbsoluteLimitsTests-523470984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:31:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e2a4d430-c962-4522-8e06-68a6e49fd6b5 tempest-AbsoluteLimitsTests-523470984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:23 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-e2a4d430-c962-4522-8e06-68a6e49fd6b5 tempest-AbsoluteLimitsTests-523470984 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:31:23 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-e2a4d430-c962-4522-8e06-68a6e49fd6b5 tempest-AbsoluteLimitsTests-523470984 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:31:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e2a4d430-c962-4522-8e06-68a6e49fd6b5 tempest-AbsoluteLimitsTests-523470984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7e7b5e6f-600e-4901-ab9d-c7693cdfd469 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:23 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-11d3b7ca-ab05-4a44-9bd0-ab6aae9386ac tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e613b89-d956-4d21-a5b2-552bf0e38f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63ce6a41-9d65-4abf-82a3-f8f467cdf8f4', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:23 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-11d3b7ca-ab05-4a44-9bd0-ab6aae9386ac tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea95f90c-e928-46d2-95b6-0b5f369a2ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:23 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-11d3b7ca-ab05-4a44-9bd0-ab6aae9386ac tempest-VolumesActionsTest-1562044613 None] Volume volume-63ce6a41-9d65-4abf-82a3-f8f467cdf8f4 (63ce6a41-9d65-4abf-82a3-f8f467cdf8f4): created successfully Nov 03 07:31:23 devstack sudo[91745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7e7b5e6f-600e-4901-ab9d-c7693cdfd469 1073741824 Nov 03 07:31:23 devstack sudo[91745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:23 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-11d3b7ca-ab05-4a44-9bd0-ab6aae9386ac tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea95f90c-e928-46d2-95b6-0b5f369a2ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:23 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-11d3b7ca-ab05-4a44-9bd0-ab6aae9386ac tempest-VolumesActionsTest-1562044613 None] Flow 'volume_create_manager' (da90b08c-57d2-408e-8a60-f13cc6929f64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:31:23 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-11d3b7ca-ab05-4a44-9bd0-ab6aae9386ac tempest-VolumesActionsTest-1562044613 None] Created volume successfully. Nov 03 07:31:24 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d266be8c-b82a-449a-a97d-62e6e3782a9b tempest-VolumesActionsTest-1562044613 None] Acquiring lock "cinder-63ce6a41-9d65-4abf-82a3-f8f467cdf8f4" by "attach_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:24 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d266be8c-b82a-449a-a97d-62e6e3782a9b tempest-VolumesActionsTest-1562044613 None] Lock "cinder-63ce6a41-9d65-4abf-82a3-f8f467cdf8f4" acquired by "attach_volume" :: waited 0.045s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:24 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-d266be8c-b82a-449a-a97d-62e6e3782a9b tempest-VolumesActionsTest-1562044613 None] Attaching volume 63ce6a41-9d65-4abf-82a3-f8f467cdf8f4 to instance 4b85a999-ad0a-49e3-b77a-7712391237bf at mountpoint /dev/vdb on host None. Nov 03 07:31:24 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-d266be8c-b82a-449a-a97d-62e6e3782a9b tempest-VolumesActionsTest-1562044613 None] Attach volume completed successfully. Nov 03 07:31:24 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d266be8c-b82a-449a-a97d-62e6e3782a9b tempest-VolumesActionsTest-1562044613 None] Lock "cinder-63ce6a41-9d65-4abf-82a3-f8f467cdf8f4" released by "attach_volume" :: held 0.247s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:31:24 devstack sudo[91745]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e2a4d430-c962-4522-8e06-68a6e49fd6b5 tempest-AbsoluteLimitsTests-523470984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7e7b5e6f-600e-4901-ab9d-c7693cdfd469 1073741824" returned: 0 in 1.089s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e2a4d430-c962-4522-8e06-68a6e49fd6b5 tempest-AbsoluteLimitsTests-523470984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7e7b5e6f-600e-4901-ab9d-c7693cdfd469 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:24 devstack sudo[91760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7e7b5e6f-600e-4901-ab9d-c7693cdfd469 Nov 03 07:31:24 devstack sudo[91760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:25 devstack sudo[91760]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e2a4d430-c962-4522-8e06-68a6e49fd6b5 tempest-AbsoluteLimitsTests-523470984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7e7b5e6f-600e-4901-ab9d-c7693cdfd469" returned: 0 in 0.410s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:25 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-e2a4d430-c962-4522-8e06-68a6e49fd6b5 tempest-AbsoluteLimitsTests-523470984 None] <== create_volume: return (1581ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:31:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e2a4d430-c962-4522-8e06-68a6e49fd6b5 tempest-AbsoluteLimitsTests-523470984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.590s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:25 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e2a4d430-c962-4522-8e06-68a6e49fd6b5 tempest-AbsoluteLimitsTests-523470984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69574fd5-f10b-4430-8c74-2488652414f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e7b5e6f-600e-4901-ab9d-c7693cdfd469', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:25 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e2a4d430-c962-4522-8e06-68a6e49fd6b5 tempest-AbsoluteLimitsTests-523470984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (326aa303-50fb-4ba6-9cf7-59d57d40e291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:25 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-e2a4d430-c962-4522-8e06-68a6e49fd6b5 tempest-AbsoluteLimitsTests-523470984 None] Volume volume-7e7b5e6f-600e-4901-ab9d-c7693cdfd469 (7e7b5e6f-600e-4901-ab9d-c7693cdfd469): created successfully Nov 03 07:31:25 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e2a4d430-c962-4522-8e06-68a6e49fd6b5 tempest-AbsoluteLimitsTests-523470984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (326aa303-50fb-4ba6-9cf7-59d57d40e291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:25 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e2a4d430-c962-4522-8e06-68a6e49fd6b5 tempest-AbsoluteLimitsTests-523470984 None] Flow 'volume_create_manager' (34544116-6531-443f-9b73-700f5acbf98d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:31:25 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-e2a4d430-c962-4522-8e06-68a6e49fd6b5 tempest-AbsoluteLimitsTests-523470984 None] Created volume successfully. Nov 03 07:31:26 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-419b5a8a-2387-48a4-b07e-a9e9f0b0fa46 tempest-VolumesActionsTest-629355249 None] Terminate volume connection completed successfully. Nov 03 07:31:26 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-3494c62b-2829-4fb1-97b2-842ceb1139b3 tempest-AbsoluteLimitsTests-523470984 None] Acquiring lock "cinder-7e7b5e6f-600e-4901-ab9d-c7693cdfd469-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:26 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-3494c62b-2829-4fb1-97b2-842ceb1139b3 tempest-AbsoluteLimitsTests-523470984 None] Lock "cinder-7e7b5e6f-600e-4901-ab9d-c7693cdfd469-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:26 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-419b5a8a-2387-48a4-b07e-a9e9f0b0fa46 tempest-VolumesActionsTest-629355249 None] Acquiring lock "cinder-63ce6a41-9d65-4abf-82a3-f8f467cdf8f4-detach_volume" by "detach_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:26 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-3494c62b-2829-4fb1-97b2-842ceb1139b3 tempest-AbsoluteLimitsTests-523470984 None] Acquiring lock "cinder-quobyte-7e7b5e6f-600e-4901-ab9d-c7693cdfd469" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:26 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-419b5a8a-2387-48a4-b07e-a9e9f0b0fa46 tempest-VolumesActionsTest-629355249 None] Lock "cinder-63ce6a41-9d65-4abf-82a3-f8f467cdf8f4-detach_volume" acquired by "detach_volume" :: waited 0.056s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:26 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-3494c62b-2829-4fb1-97b2-842ceb1139b3 tempest-AbsoluteLimitsTests-523470984 None] Lock "cinder-quobyte-7e7b5e6f-600e-4901-ab9d-c7693cdfd469" acquired by "delete_volume" :: waited 0.064s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:26 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe3855a-8a15-4ee4-a550-5a6fbc189a57]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:31:26 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3494c62b-2829-4fb1-97b2-842ceb1139b3 tempest-AbsoluteLimitsTests-523470984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7e7b5e6f-600e-4901-ab9d-c7693cdfd469 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:26 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-419b5a8a-2387-48a4-b07e-a9e9f0b0fa46 tempest-VolumesActionsTest-629355249 None] Detaching volume 63ce6a41-9d65-4abf-82a3-f8f467cdf8f4 from instance 4b85a999-ad0a-49e3-b77a-7712391237bf. Nov 03 07:31:26 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-419b5a8a-2387-48a4-b07e-a9e9f0b0fa46 tempest-VolumesActionsTest-629355249 None] Detach volume completed successfully. Nov 03 07:31:26 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-419b5a8a-2387-48a4-b07e-a9e9f0b0fa46 tempest-VolumesActionsTest-629355249 None] Lock "cinder-63ce6a41-9d65-4abf-82a3-f8f467cdf8f4-detach_volume" released by "detach_volume" :: held 0.316s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:31:26 devstack sudo[91764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7e7b5e6f-600e-4901-ab9d-c7693cdfd469 Nov 03 07:31:26 devstack sudo[91764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:27 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-70c66056-95f5-4bc7-8988-5bb4143b6ba1 tempest-VolumesActionsTest-1562044613 None] Acquiring lock "cinder-63ce6a41-9d65-4abf-82a3-f8f467cdf8f4-detach_volume" by "detach_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:27 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-70c66056-95f5-4bc7-8988-5bb4143b6ba1 tempest-VolumesActionsTest-1562044613 None] Lock "cinder-63ce6a41-9d65-4abf-82a3-f8f467cdf8f4-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:27 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-70c66056-95f5-4bc7-8988-5bb4143b6ba1 tempest-VolumesActionsTest-1562044613 None] Volume detach called, but volume not attached. Nov 03 07:31:27 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-70c66056-95f5-4bc7-8988-5bb4143b6ba1 tempest-VolumesActionsTest-1562044613 None] Lock "cinder-63ce6a41-9d65-4abf-82a3-f8f467cdf8f4-detach_volume" released by "detach_volume" :: held 0.037s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:31:27 devstack sudo[91764]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3494c62b-2829-4fb1-97b2-842ceb1139b3 tempest-AbsoluteLimitsTests-523470984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7e7b5e6f-600e-4901-ab9d-c7693cdfd469" returned: 0 in 0.774s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3494c62b-2829-4fb1-97b2-842ceb1139b3 tempest-AbsoluteLimitsTests-523470984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7e7b5e6f-600e-4901-ab9d-c7693cdfd469 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:27 devstack sudo[91773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7e7b5e6f-600e-4901-ab9d-c7693cdfd469 Nov 03 07:31:27 devstack sudo[91773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:27 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-07b0cb27-a025-443b-befe-2ae767f8dfdd tempest-VolumesActionsTest-1562044613 None] Acquiring lock "cinder-63ce6a41-9d65-4abf-82a3-f8f467cdf8f4-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:27 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-07b0cb27-a025-443b-befe-2ae767f8dfdd tempest-VolumesActionsTest-1562044613 None] Lock "cinder-63ce6a41-9d65-4abf-82a3-f8f467cdf8f4-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:27 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-07b0cb27-a025-443b-befe-2ae767f8dfdd tempest-VolumesActionsTest-1562044613 None] Acquiring lock "cinder-quobyte-63ce6a41-9d65-4abf-82a3-f8f467cdf8f4" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:27 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-07b0cb27-a025-443b-befe-2ae767f8dfdd tempest-VolumesActionsTest-1562044613 None] Lock "cinder-quobyte-63ce6a41-9d65-4abf-82a3-f8f467cdf8f4" acquired by "delete_volume" :: waited 0.023s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:27 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b08e62-ad5a-4ae3-9ca7-c56f62b6dc07]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:31:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-07b0cb27-a025-443b-befe-2ae767f8dfdd tempest-VolumesActionsTest-1562044613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-63ce6a41-9d65-4abf-82a3-f8f467cdf8f4 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:27 devstack sudo[91773]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3494c62b-2829-4fb1-97b2-842ceb1139b3 tempest-AbsoluteLimitsTests-523470984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7e7b5e6f-600e-4901-ab9d-c7693cdfd469" returned: 0 in 0.501s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:27 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-3494c62b-2829-4fb1-97b2-842ceb1139b3 tempest-AbsoluteLimitsTests-523470984 None] Lock "cinder-quobyte-7e7b5e6f-600e-4901-ab9d-c7693cdfd469" released by "delete_volume" :: held 1.369s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:31:27 devstack sudo[91775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-63ce6a41-9d65-4abf-82a3-f8f467cdf8f4 Nov 03 07:31:27 devstack sudo[91775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:28 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-3494c62b-2829-4fb1-97b2-842ceb1139b3 tempest-AbsoluteLimitsTests-523470984 None] Created reservations ['1bd54d1f-cd20-4e52-a6cb-ecc757612ad9', 'a27f6303-2728-410d-9a59-4d5e0a5bf3d5', '723eb05c-46d2-49f4-af40-637d5040c124', 'c61895f4-7f3e-4f63-987c-9f2f9cb16f97'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:31:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3494c62b-2829-4fb1-97b2-842ceb1139b3 tempest-AbsoluteLimitsTests-523470984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3494c62b-2829-4fb1-97b2-842ceb1139b3 tempest-AbsoluteLimitsTests-523470984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:28 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-3494c62b-2829-4fb1-97b2-842ceb1139b3 tempest-AbsoluteLimitsTests-523470984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:31:28 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-3494c62b-2829-4fb1-97b2-842ceb1139b3 tempest-AbsoluteLimitsTests-523470984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:31:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3494c62b-2829-4fb1-97b2-842ceb1139b3 tempest-AbsoluteLimitsTests-523470984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3494c62b-2829-4fb1-97b2-842ceb1139b3 tempest-AbsoluteLimitsTests-523470984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:28 devstack sudo[91778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:31:28 devstack sudo[91778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:28 devstack sudo[91775]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-07b0cb27-a025-443b-befe-2ae767f8dfdd tempest-VolumesActionsTest-1562044613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-63ce6a41-9d65-4abf-82a3-f8f467cdf8f4" returned: 0 in 0.635s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-07b0cb27-a025-443b-befe-2ae767f8dfdd tempest-VolumesActionsTest-1562044613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-63ce6a41-9d65-4abf-82a3-f8f467cdf8f4 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:28 devstack sudo[91783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-63ce6a41-9d65-4abf-82a3-f8f467cdf8f4 Nov 03 07:31:28 devstack sudo[91783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:28 devstack sudo[91778]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3494c62b-2829-4fb1-97b2-842ceb1139b3 tempest-AbsoluteLimitsTests-523470984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.380s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:28 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-3494c62b-2829-4fb1-97b2-842ceb1139b3 tempest-AbsoluteLimitsTests-523470984 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:31:28 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-3494c62b-2829-4fb1-97b2-842ceb1139b3 tempest-AbsoluteLimitsTests-523470984 None] Deleted volume successfully. Nov 03 07:31:28 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-3494c62b-2829-4fb1-97b2-842ceb1139b3 tempest-AbsoluteLimitsTests-523470984 None] Lock "cinder-7e7b5e6f-600e-4901-ab9d-c7693cdfd469-delete_volume" released by "delete_volume" :: held 2.246s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:31:28 devstack sudo[91783]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-07b0cb27-a025-443b-befe-2ae767f8dfdd tempest-VolumesActionsTest-1562044613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-63ce6a41-9d65-4abf-82a3-f8f467cdf8f4" returned: 0 in 0.474s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:28 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-07b0cb27-a025-443b-befe-2ae767f8dfdd tempest-VolumesActionsTest-1562044613 None] Lock "cinder-quobyte-63ce6a41-9d65-4abf-82a3-f8f467cdf8f4" released by "delete_volume" :: held 1.175s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:31:29 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-07b0cb27-a025-443b-befe-2ae767f8dfdd tempest-VolumesActionsTest-1562044613 None] Created reservations ['65043a1f-bcd2-4e97-bdc0-acf5d02a5c22', 'fbc6c399-6e94-4611-93aa-5cd976fd3090', '1ca78be1-84ba-4d20-a881-fa86b5da9731', '1510c7a2-9c4d-475d-b60e-c81d792767a6'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:31:29 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-07b0cb27-a025-443b-befe-2ae767f8dfdd tempest-VolumesActionsTest-1562044613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:29 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-07b0cb27-a025-443b-befe-2ae767f8dfdd tempest-VolumesActionsTest-1562044613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:29 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-07b0cb27-a025-443b-befe-2ae767f8dfdd tempest-VolumesActionsTest-1562044613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:31:29 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-07b0cb27-a025-443b-befe-2ae767f8dfdd tempest-VolumesActionsTest-1562044613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:31:29 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-07b0cb27-a025-443b-befe-2ae767f8dfdd tempest-VolumesActionsTest-1562044613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:29 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-07b0cb27-a025-443b-befe-2ae767f8dfdd tempest-VolumesActionsTest-1562044613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:29 devstack sudo[91787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:31:29 devstack sudo[91787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:29 devstack sudo[91787]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:29 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-07b0cb27-a025-443b-befe-2ae767f8dfdd tempest-VolumesActionsTest-1562044613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.340s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:29 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-07b0cb27-a025-443b-befe-2ae767f8dfdd tempest-VolumesActionsTest-1562044613 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:31:29 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-07b0cb27-a025-443b-befe-2ae767f8dfdd tempest-VolumesActionsTest-1562044613 None] Deleted volume successfully. Nov 03 07:31:29 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-07b0cb27-a025-443b-befe-2ae767f8dfdd tempest-VolumesActionsTest-1562044613 None] Lock "cinder-63ce6a41-9d65-4abf-82a3-f8f467cdf8f4-delete_volume" released by "delete_volume" :: held 1.835s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:31:29 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6a2e8bc-b9e1-4df2-8d1a-8d95c197cbdd tempest-ServerActionsTestOtherA-1944466382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:31:29 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e6a2e8bc-b9e1-4df2-8d1a-8d95c197cbdd tempest-ServerActionsTestOtherA-1944466382 None] Flow 'volume_create_manager' (52e39b65-9baf-4971-b41d-9391f7b4dbd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:31:29 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e6a2e8bc-b9e1-4df2-8d1a-8d95c197cbdd tempest-ServerActionsTestOtherA-1944466382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e967d92-1bae-44cb-bc20-d354817469c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:30 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e6a2e8bc-b9e1-4df2-8d1a-8d95c197cbdd tempest-ServerActionsTestOtherA-1944466382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e967d92-1bae-44cb-bc20-d354817469c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:31:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-774691581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6ce31ba-b408-4a95-8d8b-143709c51ec0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c173927b332e4eb49c8016ba08236532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:31:30Z,use_quota=True,user_id='16ad853cf9a64a4fb504caee736c1fb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:30 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e6a2e8bc-b9e1-4df2-8d1a-8d95c197cbdd tempest-ServerActionsTestOtherA-1944466382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1392c0d2-4ebf-4321-b539-8991d26f951b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:30 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e6a2e8bc-b9e1-4df2-8d1a-8d95c197cbdd tempest-ServerActionsTestOtherA-1944466382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1392c0d2-4ebf-4321-b539-8991d26f951b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:30 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e6a2e8bc-b9e1-4df2-8d1a-8d95c197cbdd tempest-ServerActionsTestOtherA-1944466382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (089ef4ec-f002-4cff-9868-50635a76c514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:30 devstack cinder-volume[86875]: DEBUG cinder.image.glance [None req-e6a2e8bc-b9e1-4df2-8d1a-8d95c197cbdd tempest-ServerActionsTestOtherA-1944466382 None] Creating Keystone auth plugin from conf {{(pid=86875) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 07:31:31 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e6a2e8bc-b9e1-4df2-8d1a-8d95c197cbdd tempest-ServerActionsTestOtherA-1944466382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (089ef4ec-f002-4cff-9868-50635a76c514) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a6ce31ba-b408-4a95-8d8b-143709c51ec0', 'volume_name': 'volume-a6ce31ba-b408-4a95-8d8b-143709c51ec0', 'volume_size': 1, 'image_id': 'eb68a148-0c9c-4237-9d8d-94a6a7cd87d9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eb68a148-0c9c-4237-9d8d-94a6a7cd87d9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c9ace38ee46b42979b3d4c79532bd66e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eb68a148-0c9c-4237-9d8d-94a6a7cd87d9', 'created_at': datetime.datetime(2026, 11, 3, 6, 21, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 21, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eb68a148-0c9c-4237-9d8d-94a6a7cd87d9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:31 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e6a2e8bc-b9e1-4df2-8d1a-8d95c197cbdd tempest-ServerActionsTestOtherA-1944466382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9c3ceb8-5558-4b1e-b86e-b155fa62e6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:31 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e6a2e8bc-b9e1-4df2-8d1a-8d95c197cbdd tempest-ServerActionsTestOtherA-1944466382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9c3ceb8-5558-4b1e-b86e-b155fa62e6fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:31 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e6a2e8bc-b9e1-4df2-8d1a-8d95c197cbdd tempest-ServerActionsTestOtherA-1944466382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8c4b86a-8499-4aee-9f7a-862a29cb63ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:31 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-e6a2e8bc-b9e1-4df2-8d1a-8d95c197cbdd tempest-ServerActionsTestOtherA-1944466382 None] Volume a6ce31ba-b408-4a95-8d8b-143709c51ec0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a6ce31ba-b408-4a95-8d8b-143709c51ec0', 'volume_size': 1, 'image_id': 'eb68a148-0c9c-4237-9d8d-94a6a7cd87d9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eb68a148-0c9c-4237-9d8d-94a6a7cd87d9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c9ace38ee46b42979b3d4c79532bd66e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eb68a148-0c9c-4237-9d8d-94a6a7cd87d9', 'created_at': datetime.datetime(2026, 11, 3, 6, 21, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 21, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eb68a148-0c9c-4237-9d8d-94a6a7cd87d9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 03 07:31:31 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6a2e8bc-b9e1-4df2-8d1a-8d95c197cbdd tempest-ServerActionsTestOtherA-1944466382 None] Trying to clone a6ce31ba-b408-4a95-8d8b-143709c51ec0 from image eb68a148-0c9c-4237-9d8d-94a6a7cd87d9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/eb68a148-0c9c-4237-9d8d-94a6a7cd87d9', 'metadata': {}}]). {{(pid=86875) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 07:31:31 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-e6a2e8bc-b9e1-4df2-8d1a-8d95c197cbdd tempest-ServerActionsTestOtherA-1944466382 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_g05he0mcdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86875) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 07:31:31 devstack cinder-volume[86875]: INFO cinder.image.image_utils [None req-e6a2e8bc-b9e1-4df2-8d1a-8d95c197cbdd tempest-ServerActionsTestOtherA-1944466382 None] Image download 20.69 MB at 20.69 MB/s Nov 03 07:31:31 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[d380fd97-e598-4d02-bf01-7990a0bd42bf]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:31:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e6a2e8bc-b9e1-4df2-8d1a-8d95c197cbdd tempest-ServerActionsTestOtherA-1944466382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_g05he0mcdevstack@QuobyteHD {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:31 devstack sudo[91834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_g05he0mcdevstack@QuobyteHD Nov 03 07:31:31 devstack sudo[91834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:32 devstack sudo[91834]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:32 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e6a2e8bc-b9e1-4df2-8d1a-8d95c197cbdd tempest-ServerActionsTestOtherA-1944466382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_g05he0mcdevstack@QuobyteHD" returned: 0 in 0.400s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:32 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-e6a2e8bc-b9e1-4df2-8d1a-8d95c197cbdd tempest-ServerActionsTestOtherA-1944466382 None] Temporary image eb68a148-0c9c-4237-9d8d-94a6a7cd87d9 is fetched for user 16ad853cf9a64a4fb504caee736c1fb5. {{(pid=86875) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 07:31:32 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed8394a-3179-4a24-8829-a49eeaf7c5b0]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:31:32 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e6a2e8bc-b9e1-4df2-8d1a-8d95c197cbdd tempest-ServerActionsTestOtherA-1944466382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_g05he0mcdevstack@QuobyteHD {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:32 devstack sudo[91840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_g05he0mcdevstack@QuobyteHD Nov 03 07:31:32 devstack sudo[91840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:32 devstack sudo[91840]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:32 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e6a2e8bc-b9e1-4df2-8d1a-8d95c197cbdd tempest-ServerActionsTestOtherA-1944466382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_g05he0mcdevstack@QuobyteHD" returned: 0 in 0.434s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:32 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e6a2e8bc-b9e1-4df2-8d1a-8d95c197cbdd tempest-ServerActionsTestOtherA-1944466382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:32 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e6a2e8bc-b9e1-4df2-8d1a-8d95c197cbdd tempest-ServerActionsTestOtherA-1944466382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:32 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-e6a2e8bc-b9e1-4df2-8d1a-8d95c197cbdd tempest-ServerActionsTestOtherA-1944466382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:31:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-774691581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6ce31ba-b408-4a95-8d8b-143709c51ec0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c173927b332e4eb49c8016ba08236532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:31:30Z,use_quota=True,user_id='16ad853cf9a64a4fb504caee736c1fb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:31:32 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-e6a2e8bc-b9e1-4df2-8d1a-8d95c197cbdd tempest-ServerActionsTestOtherA-1944466382 None] Creating volume a6ce31ba-b408-4a95-8d8b-143709c51ec0 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:31:32 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e6a2e8bc-b9e1-4df2-8d1a-8d95c197cbdd tempest-ServerActionsTestOtherA-1944466382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:32 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e6a2e8bc-b9e1-4df2-8d1a-8d95c197cbdd tempest-ServerActionsTestOtherA-1944466382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:32 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-e6a2e8bc-b9e1-4df2-8d1a-8d95c197cbdd tempest-ServerActionsTestOtherA-1944466382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:31:32 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-e6a2e8bc-b9e1-4df2-8d1a-8d95c197cbdd tempest-ServerActionsTestOtherA-1944466382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:31:32 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e6a2e8bc-b9e1-4df2-8d1a-8d95c197cbdd tempest-ServerActionsTestOtherA-1944466382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:32 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-e6a2e8bc-b9e1-4df2-8d1a-8d95c197cbdd tempest-ServerActionsTestOtherA-1944466382 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:31:32 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-e6a2e8bc-b9e1-4df2-8d1a-8d95c197cbdd tempest-ServerActionsTestOtherA-1944466382 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:31:32 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e6a2e8bc-b9e1-4df2-8d1a-8d95c197cbdd tempest-ServerActionsTestOtherA-1944466382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a6ce31ba-b408-4a95-8d8b-143709c51ec0 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:32 devstack sudo[91846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a6ce31ba-b408-4a95-8d8b-143709c51ec0 1073741824 Nov 03 07:31:32 devstack sudo[91846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:33 devstack sudo[91846]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e6a2e8bc-b9e1-4df2-8d1a-8d95c197cbdd tempest-ServerActionsTestOtherA-1944466382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a6ce31ba-b408-4a95-8d8b-143709c51ec0 1073741824" returned: 0 in 0.717s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e6a2e8bc-b9e1-4df2-8d1a-8d95c197cbdd tempest-ServerActionsTestOtherA-1944466382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a6ce31ba-b408-4a95-8d8b-143709c51ec0 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:33 devstack sudo[91853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a6ce31ba-b408-4a95-8d8b-143709c51ec0 Nov 03 07:31:33 devstack sudo[91853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:33 devstack sudo[91853]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e6a2e8bc-b9e1-4df2-8d1a-8d95c197cbdd tempest-ServerActionsTestOtherA-1944466382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a6ce31ba-b408-4a95-8d8b-143709c51ec0" returned: 0 in 0.421s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:33 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-e6a2e8bc-b9e1-4df2-8d1a-8d95c197cbdd tempest-ServerActionsTestOtherA-1944466382 None] <== create_volume: return (1223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:31:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e6a2e8bc-b9e1-4df2-8d1a-8d95c197cbdd tempest-ServerActionsTestOtherA-1944466382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.231s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:34 devstack cinder-volume[86875]: DEBUG cinder.volume.volume_utils [None req-e6a2e8bc-b9e1-4df2-8d1a-8d95c197cbdd tempest-ServerActionsTestOtherA-1944466382 None] Attempting download of eb68a148-0c9c-4237-9d8d-94a6a7cd87d9 ((None, [{'url': 'file:///opt/stack/data/glance/images/eb68a148-0c9c-4237-9d8d-94a6a7cd87d9', 'metadata': {}}])) to volume a6ce31ba-b408-4a95-8d8b-143709c51ec0. {{(pid=86875) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 07:31:34 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[8101b153-b5bd-4f3f-a788-f31917e542e6]: (4, 'raw') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:31:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e6a2e8bc-b9e1-4df2-8d1a-8d95c197cbdd tempest-ServerActionsTestOtherA-1944466382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_ekvya4e3 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:34 devstack sudo[91858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_ekvya4e3 Nov 03 07:31:34 devstack sudo[91858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:34 devstack sudo[91858]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e6a2e8bc-b9e1-4df2-8d1a-8d95c197cbdd tempest-ServerActionsTestOtherA-1944466382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_ekvya4e3" returned: 0 in 0.391s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e6a2e8bc-b9e1-4df2-8d1a-8d95c197cbdd tempest-ServerActionsTestOtherA-1944466382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_ekvya4e3 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:34 devstack sudo[91862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_ekvya4e3 Nov 03 07:31:34 devstack sudo[91862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:35 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c10b280-d358-4b67-94df-8a1c05287677 tempest-VolumesActionsTest-1562044613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:31:35 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-6c10b280-d358-4b67-94df-8a1c05287677 tempest-VolumesActionsTest-1562044613 None] Flow 'volume_create_manager' (af308664-dffb-443f-bfc2-7006ec575a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:31:35 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-6c10b280-d358-4b67-94df-8a1c05287677 tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82bd7f41-10de-4205-b6e9-df88d7fbb731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:35 devstack sudo[91862]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:35 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-6c10b280-d358-4b67-94df-8a1c05287677 tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82bd7f41-10de-4205-b6e9-df88d7fbb731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:31:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1096681252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93f5c443-73d9-437b-8493-6fa8cf31ad38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33fdd7b0bfb943bd87e5ddcdbd730b5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:31:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:31:35Z,use_quota=True,user_id='a96d47c1521a4560be32f33768324e83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:35 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-6c10b280-d358-4b67-94df-8a1c05287677 tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87efa182-1001-47da-8a5a-9c683ee20af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:35 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-6c10b280-d358-4b67-94df-8a1c05287677 tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87efa182-1001-47da-8a5a-9c683ee20af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:35 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-6c10b280-d358-4b67-94df-8a1c05287677 tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (045e781f-8de7-4764-8447-43954c54b5bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:35 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-6c10b280-d358-4b67-94df-8a1c05287677 tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (045e781f-8de7-4764-8447-43954c54b5bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93f5c443-73d9-437b-8493-6fa8cf31ad38', 'volume_name': 'volume-93f5c443-73d9-437b-8493-6fa8cf31ad38', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:35 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-6c10b280-d358-4b67-94df-8a1c05287677 tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4e0f71c-ceb0-49b0-8e85-bad585cdd962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:35 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-6c10b280-d358-4b67-94df-8a1c05287677 tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4e0f71c-ceb0-49b0-8e85-bad585cdd962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:35 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-6c10b280-d358-4b67-94df-8a1c05287677 tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74bb60e0-1580-4747-9c37-3288c75edde2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:35 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-6c10b280-d358-4b67-94df-8a1c05287677 tempest-VolumesActionsTest-1562044613 None] Volume 93f5c443-73d9-437b-8493-6fa8cf31ad38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93f5c443-73d9-437b-8493-6fa8cf31ad38', 'volume_size': 1} Nov 03 07:31:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-6c10b280-d358-4b67-94df-8a1c05287677 tempest-VolumesActionsTest-1562044613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-6c10b280-d358-4b67-94df-8a1c05287677 tempest-VolumesActionsTest-1562044613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:35 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-6c10b280-d358-4b67-94df-8a1c05287677 tempest-VolumesActionsTest-1562044613 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:31:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1096681252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93f5c443-73d9-437b-8493-6fa8cf31ad38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33fdd7b0bfb943bd87e5ddcdbd730b5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:31:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:31:35Z,use_quota=True,user_id='a96d47c1521a4560be32f33768324e83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:31:35 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-6c10b280-d358-4b67-94df-8a1c05287677 tempest-VolumesActionsTest-1562044613 None] Creating volume 93f5c443-73d9-437b-8493-6fa8cf31ad38 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:31:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-6c10b280-d358-4b67-94df-8a1c05287677 tempest-VolumesActionsTest-1562044613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-6c10b280-d358-4b67-94df-8a1c05287677 tempest-VolumesActionsTest-1562044613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:35 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-6c10b280-d358-4b67-94df-8a1c05287677 tempest-VolumesActionsTest-1562044613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:31:35 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-6c10b280-d358-4b67-94df-8a1c05287677 tempest-VolumesActionsTest-1562044613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:31:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-6c10b280-d358-4b67-94df-8a1c05287677 tempest-VolumesActionsTest-1562044613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:35 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-6c10b280-d358-4b67-94df-8a1c05287677 tempest-VolumesActionsTest-1562044613 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:31:35 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-6c10b280-d358-4b67-94df-8a1c05287677 tempest-VolumesActionsTest-1562044613 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:31:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6c10b280-d358-4b67-94df-8a1c05287677 tempest-VolumesActionsTest-1562044613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-93f5c443-73d9-437b-8493-6fa8cf31ad38 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e6a2e8bc-b9e1-4df2-8d1a-8d95c197cbdd tempest-ServerActionsTestOtherA-1944466382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_ekvya4e3" returned: 1 in 0.593s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e6a2e8bc-b9e1-4df2-8d1a-8d95c197cbdd tempest-ServerActionsTestOtherA-1944466382 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_ekvya4e3' failed. Not Retrying. {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:31:35 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b12259-cafa-4e73-8abd-df229eb28766]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:31:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e6a2e8bc-b9e1-4df2-8d1a-8d95c197cbdd tempest-ServerActionsTestOtherA-1944466382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_g05he0mcdevstack@QuobyteHD {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:35 devstack sudo[91866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-93f5c443-73d9-437b-8493-6fa8cf31ad38 1073741824 Nov 03 07:31:35 devstack sudo[91866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:35 devstack sudo[91867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_g05he0mcdevstack@QuobyteHD Nov 03 07:31:35 devstack sudo[91867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:35 devstack sudo[91867]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e6a2e8bc-b9e1-4df2-8d1a-8d95c197cbdd tempest-ServerActionsTestOtherA-1944466382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_g05he0mcdevstack@QuobyteHD" returned: 0 in 0.403s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:35 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-e6a2e8bc-b9e1-4df2-8d1a-8d95c197cbdd tempest-ServerActionsTestOtherA-1944466382 None] eb68a148-0c9c-4237-9d8d-94a6a7cd87d9 was qcow2, converting to qcow2 {{(pid=86875) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 07:31:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e6a2e8bc-b9e1-4df2-8d1a-8d95c197cbdd tempest-ServerActionsTestOtherA-1944466382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_g05he0mcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a6ce31ba-b408-4a95-8d8b-143709c51ec0 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:35 devstack sudo[91877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_g05he0mcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a6ce31ba-b408-4a95-8d8b-143709c51ec0 Nov 03 07:31:35 devstack sudo[91877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:35 devstack sudo[91866]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6c10b280-d358-4b67-94df-8a1c05287677 tempest-VolumesActionsTest-1562044613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-93f5c443-73d9-437b-8493-6fa8cf31ad38 1073741824" returned: 0 in 0.565s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:36 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6c10b280-d358-4b67-94df-8a1c05287677 tempest-VolumesActionsTest-1562044613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-93f5c443-73d9-437b-8493-6fa8cf31ad38 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:36 devstack sudo[91879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-93f5c443-73d9-437b-8493-6fa8cf31ad38 Nov 03 07:31:36 devstack sudo[91879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:36 devstack sudo[91879]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:36 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6c10b280-d358-4b67-94df-8a1c05287677 tempest-VolumesActionsTest-1562044613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-93f5c443-73d9-437b-8493-6fa8cf31ad38" returned: 0 in 0.417s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:36 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-6c10b280-d358-4b67-94df-8a1c05287677 tempest-VolumesActionsTest-1562044613 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:31:36 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-6c10b280-d358-4b67-94df-8a1c05287677 tempest-VolumesActionsTest-1562044613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:36 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-6c10b280-d358-4b67-94df-8a1c05287677 tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74bb60e0-1580-4747-9c37-3288c75edde2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93f5c443-73d9-437b-8493-6fa8cf31ad38', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:36 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-6c10b280-d358-4b67-94df-8a1c05287677 tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4daa704-cf6f-4b15-9209-76a2a3c3596b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:36 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-6c10b280-d358-4b67-94df-8a1c05287677 tempest-VolumesActionsTest-1562044613 None] Volume volume-93f5c443-73d9-437b-8493-6fa8cf31ad38 (93f5c443-73d9-437b-8493-6fa8cf31ad38): created successfully Nov 03 07:31:36 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-6c10b280-d358-4b67-94df-8a1c05287677 tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4daa704-cf6f-4b15-9209-76a2a3c3596b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:36 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-6c10b280-d358-4b67-94df-8a1c05287677 tempest-VolumesActionsTest-1562044613 None] Flow 'volume_create_manager' (af308664-dffb-443f-bfc2-7006ec575a38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:31:36 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-6c10b280-d358-4b67-94df-8a1c05287677 tempest-VolumesActionsTest-1562044613 None] Created volume successfully. Nov 03 07:31:37 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-e17e0914-5859-4837-accc-3c71d10ceff5 tempest-VolumesCloneTest-511126810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:31:37 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e17e0914-5859-4837-accc-3c71d10ceff5 tempest-VolumesCloneTest-511126810 None] Flow 'volume_create_manager' (a919e1e4-2d2d-4810-9e5e-5179f10f838c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:31:37 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e17e0914-5859-4837-accc-3c71d10ceff5 tempest-VolumesCloneTest-511126810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (471a312e-31d0-4319-9a97-31a47881e452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:37 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e17e0914-5859-4837-accc-3c71d10ceff5 tempest-VolumesCloneTest-511126810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (471a312e-31d0-4319-9a97-31a47881e452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-937203250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7153e62d-6fe8-4212-8311-3410e947b738,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d8bb3d69967462d98be448f1ddb5777',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:31:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:31:37Z,use_quota=True,user_id='91a1ac2d5d4d488ea542d96cd3c6c939',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:37 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e17e0914-5859-4837-accc-3c71d10ceff5 tempest-VolumesCloneTest-511126810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (982b1143-966b-45b6-9e82-d9dcdc2c93ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:37 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e17e0914-5859-4837-accc-3c71d10ceff5 tempest-VolumesCloneTest-511126810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (982b1143-966b-45b6-9e82-d9dcdc2c93ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:37 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e17e0914-5859-4837-accc-3c71d10ceff5 tempest-VolumesCloneTest-511126810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edb16cee-e909-41bc-8972-24919700fff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:37 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e17e0914-5859-4837-accc-3c71d10ceff5 tempest-VolumesCloneTest-511126810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edb16cee-e909-41bc-8972-24919700fff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7153e62d-6fe8-4212-8311-3410e947b738', 'volume_name': 'volume-7153e62d-6fe8-4212-8311-3410e947b738', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:37 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e17e0914-5859-4837-accc-3c71d10ceff5 tempest-VolumesCloneTest-511126810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (866e0063-49d6-434d-aa53-588c539d879c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:37 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e17e0914-5859-4837-accc-3c71d10ceff5 tempest-VolumesCloneTest-511126810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (866e0063-49d6-434d-aa53-588c539d879c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:37 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e17e0914-5859-4837-accc-3c71d10ceff5 tempest-VolumesCloneTest-511126810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eba2ecd-34ed-4eb3-9db7-5b929025e0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:37 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-e17e0914-5859-4837-accc-3c71d10ceff5 tempest-VolumesCloneTest-511126810 None] Volume 7153e62d-6fe8-4212-8311-3410e947b738: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7153e62d-6fe8-4212-8311-3410e947b738', 'volume_size': 1} Nov 03 07:31:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e17e0914-5859-4837-accc-3c71d10ceff5 tempest-VolumesCloneTest-511126810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e17e0914-5859-4837-accc-3c71d10ceff5 tempest-VolumesCloneTest-511126810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:37 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-e17e0914-5859-4837-accc-3c71d10ceff5 tempest-VolumesCloneTest-511126810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-937203250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7153e62d-6fe8-4212-8311-3410e947b738,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d8bb3d69967462d98be448f1ddb5777',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:31:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:31:37Z,use_quota=True,user_id='91a1ac2d5d4d488ea542d96cd3c6c939',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:31:37 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-e17e0914-5859-4837-accc-3c71d10ceff5 tempest-VolumesCloneTest-511126810 None] Creating volume 7153e62d-6fe8-4212-8311-3410e947b738 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:31:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e17e0914-5859-4837-accc-3c71d10ceff5 tempest-VolumesCloneTest-511126810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e17e0914-5859-4837-accc-3c71d10ceff5 tempest-VolumesCloneTest-511126810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:37 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-e17e0914-5859-4837-accc-3c71d10ceff5 tempest-VolumesCloneTest-511126810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:31:37 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-e17e0914-5859-4837-accc-3c71d10ceff5 tempest-VolumesCloneTest-511126810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:31:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e17e0914-5859-4837-accc-3c71d10ceff5 tempest-VolumesCloneTest-511126810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:37 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-e17e0914-5859-4837-accc-3c71d10ceff5 tempest-VolumesCloneTest-511126810 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:31:37 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-e17e0914-5859-4837-accc-3c71d10ceff5 tempest-VolumesCloneTest-511126810 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:31:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e17e0914-5859-4837-accc-3c71d10ceff5 tempest-VolumesCloneTest-511126810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7153e62d-6fe8-4212-8311-3410e947b738 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:37 devstack sudo[91898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7153e62d-6fe8-4212-8311-3410e947b738 1073741824 Nov 03 07:31:37 devstack sudo[91898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:37 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-59611e34-48a7-47ad-b82e-e74ffb462b0e tempest-VolumesActionsTest-629355249 None] Acquiring lock "cinder-93f5c443-73d9-437b-8493-6fa8cf31ad38-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:37 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-59611e34-48a7-47ad-b82e-e74ffb462b0e tempest-VolumesActionsTest-629355249 None] Lock "cinder-93f5c443-73d9-437b-8493-6fa8cf31ad38-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:37 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-59611e34-48a7-47ad-b82e-e74ffb462b0e tempest-VolumesActionsTest-629355249 None] Acquiring lock "cinder-quobyte-93f5c443-73d9-437b-8493-6fa8cf31ad38" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:37 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-59611e34-48a7-47ad-b82e-e74ffb462b0e tempest-VolumesActionsTest-629355249 None] Lock "cinder-quobyte-93f5c443-73d9-437b-8493-6fa8cf31ad38" acquired by "delete_volume" :: waited 0.025s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:37 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[356880d9-4e06-4f32-aef9-dd1c9e407a44]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:31:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-59611e34-48a7-47ad-b82e-e74ffb462b0e tempest-VolumesActionsTest-629355249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-93f5c443-73d9-437b-8493-6fa8cf31ad38 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:38 devstack sudo[91900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-93f5c443-73d9-437b-8493-6fa8cf31ad38 Nov 03 07:31:38 devstack sudo[91900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:38 devstack sudo[91900]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-59611e34-48a7-47ad-b82e-e74ffb462b0e tempest-VolumesActionsTest-629355249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-93f5c443-73d9-437b-8493-6fa8cf31ad38" returned: 0 in 0.559s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-59611e34-48a7-47ad-b82e-e74ffb462b0e tempest-VolumesActionsTest-629355249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-93f5c443-73d9-437b-8493-6fa8cf31ad38 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:38 devstack sudo[91898]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e17e0914-5859-4837-accc-3c71d10ceff5 tempest-VolumesCloneTest-511126810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7153e62d-6fe8-4212-8311-3410e947b738 1073741824" returned: 0 in 0.831s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:38 devstack sudo[91910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-93f5c443-73d9-437b-8493-6fa8cf31ad38 Nov 03 07:31:38 devstack sudo[91910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e17e0914-5859-4837-accc-3c71d10ceff5 tempest-VolumesCloneTest-511126810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7153e62d-6fe8-4212-8311-3410e947b738 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:38 devstack sudo[91912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7153e62d-6fe8-4212-8311-3410e947b738 Nov 03 07:31:38 devstack sudo[91912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:38 devstack sudo[91877]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e6a2e8bc-b9e1-4df2-8d1a-8d95c197cbdd tempest-ServerActionsTestOtherA-1944466382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_g05he0mcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a6ce31ba-b408-4a95-8d8b-143709c51ec0" returned: 0 in 2.988s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:38 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-e6a2e8bc-b9e1-4df2-8d1a-8d95c197cbdd tempest-ServerActionsTestOtherA-1944466382 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_g05he0mcdevstack@QuobyteHD, size 112.00 MB, duration 2.99 sec, destination /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a6ce31ba-b408-4a95-8d8b-143709c51ec0 {{(pid=86875) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:31:38 devstack cinder-volume[86875]: INFO cinder.image.image_utils [None req-e6a2e8bc-b9e1-4df2-8d1a-8d95c197cbdd tempest-ServerActionsTestOtherA-1944466382 None] Converted 112.00 MB image at 37.46 MB/s Nov 03 07:31:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e6a2e8bc-b9e1-4df2-8d1a-8d95c197cbdd tempest-ServerActionsTestOtherA-1944466382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a6ce31ba-b408-4a95-8d8b-143709c51ec0 1G {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:38 devstack sudo[91912]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e17e0914-5859-4837-accc-3c71d10ceff5 tempest-VolumesCloneTest-511126810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7153e62d-6fe8-4212-8311-3410e947b738" returned: 0 in 0.342s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:38 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-e17e0914-5859-4837-accc-3c71d10ceff5 tempest-VolumesCloneTest-511126810 None] <== create_volume: return (1236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:31:38 devstack sudo[91921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a6ce31ba-b408-4a95-8d8b-143709c51ec0 1G Nov 03 07:31:38 devstack sudo[91921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e17e0914-5859-4837-accc-3c71d10ceff5 tempest-VolumesCloneTest-511126810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.239s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:38 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e17e0914-5859-4837-accc-3c71d10ceff5 tempest-VolumesCloneTest-511126810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eba2ecd-34ed-4eb3-9db7-5b929025e0cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7153e62d-6fe8-4212-8311-3410e947b738', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:38 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e17e0914-5859-4837-accc-3c71d10ceff5 tempest-VolumesCloneTest-511126810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ede08cc-1364-48b0-a30f-e024fff728fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:38 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-e17e0914-5859-4837-accc-3c71d10ceff5 tempest-VolumesCloneTest-511126810 None] Volume volume-7153e62d-6fe8-4212-8311-3410e947b738 (7153e62d-6fe8-4212-8311-3410e947b738): created successfully Nov 03 07:31:38 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e17e0914-5859-4837-accc-3c71d10ceff5 tempest-VolumesCloneTest-511126810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ede08cc-1364-48b0-a30f-e024fff728fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:38 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e17e0914-5859-4837-accc-3c71d10ceff5 tempest-VolumesCloneTest-511126810 None] Flow 'volume_create_manager' (a919e1e4-2d2d-4810-9e5e-5179f10f838c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:31:38 devstack sudo[91910]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-59611e34-48a7-47ad-b82e-e74ffb462b0e tempest-VolumesActionsTest-629355249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-93f5c443-73d9-437b-8493-6fa8cf31ad38" returned: 0 in 0.500s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:38 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-e17e0914-5859-4837-accc-3c71d10ceff5 tempest-VolumesCloneTest-511126810 None] Created volume successfully. Nov 03 07:31:38 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-59611e34-48a7-47ad-b82e-e74ffb462b0e tempest-VolumesActionsTest-629355249 None] Lock "cinder-quobyte-93f5c443-73d9-437b-8493-6fa8cf31ad38" released by "delete_volume" :: held 1.131s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:31:39 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-59611e34-48a7-47ad-b82e-e74ffb462b0e tempest-VolumesActionsTest-629355249 None] Created reservations ['d224a401-d412-4c2d-8784-a8afb6b18fc6', '032b7acc-0001-44ce-8445-daf22fc44cdf', '2ac3b43a-d737-4e3f-af1c-a306dc80ebbf', 'da0f58eb-49eb-4026-9c8d-b8c416e0d716'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:31:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-59611e34-48a7-47ad-b82e-e74ffb462b0e tempest-VolumesActionsTest-629355249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-59611e34-48a7-47ad-b82e-e74ffb462b0e tempest-VolumesActionsTest-629355249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:39 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-59611e34-48a7-47ad-b82e-e74ffb462b0e tempest-VolumesActionsTest-629355249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:31:39 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-59611e34-48a7-47ad-b82e-e74ffb462b0e tempest-VolumesActionsTest-629355249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:31:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-59611e34-48a7-47ad-b82e-e74ffb462b0e tempest-VolumesActionsTest-629355249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-59611e34-48a7-47ad-b82e-e74ffb462b0e tempest-VolumesActionsTest-629355249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:39 devstack sudo[91940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:31:39 devstack sudo[91940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:39 devstack sudo[91921]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e6a2e8bc-b9e1-4df2-8d1a-8d95c197cbdd tempest-ServerActionsTestOtherA-1944466382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a6ce31ba-b408-4a95-8d8b-143709c51ec0 1G" returned: 0 in 0.507s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:39 devstack cinder-volume[86875]: DEBUG cinder.volume.volume_utils [None req-e6a2e8bc-b9e1-4df2-8d1a-8d95c197cbdd tempest-ServerActionsTestOtherA-1944466382 None] Downloaded image eb68a148-0c9c-4237-9d8d-94a6a7cd87d9 ((None, [{'url': 'file:///opt/stack/data/glance/images/eb68a148-0c9c-4237-9d8d-94a6a7cd87d9', 'metadata': {}}])) to volume a6ce31ba-b408-4a95-8d8b-143709c51ec0 successfully. {{(pid=86875) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 07:31:39 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-e6a2e8bc-b9e1-4df2-8d1a-8d95c197cbdd tempest-ServerActionsTestOtherA-1944466382 None] Temporary image eb68a148-0c9c-4237-9d8d-94a6a7cd87d9 for user 16ad853cf9a64a4fb504caee736c1fb5 is deleted. {{(pid=86875) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 07:31:39 devstack cinder-volume[86875]: DEBUG cinder.volume.volume_utils [None req-e6a2e8bc-b9e1-4df2-8d1a-8d95c197cbdd tempest-ServerActionsTestOtherA-1944466382 None] Marking volume a6ce31ba-b408-4a95-8d8b-143709c51ec0 as bootable. {{(pid=86875) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 07:31:39 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6a2e8bc-b9e1-4df2-8d1a-8d95c197cbdd tempest-ServerActionsTestOtherA-1944466382 None] Copying metadata from image eb68a148-0c9c-4237-9d8d-94a6a7cd87d9 to a6ce31ba-b408-4a95-8d8b-143709c51ec0. {{(pid=86875) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 07:31:39 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6a2e8bc-b9e1-4df2-8d1a-8d95c197cbdd tempest-ServerActionsTestOtherA-1944466382 None] Creating volume glance metadata for volume a6ce31ba-b408-4a95-8d8b-143709c51ec0 backed by image eb68a148-0c9c-4237-9d8d-94a6a7cd87d9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'eb68a148-0c9c-4237-9d8d-94a6a7cd87d9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86875) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 07:31:39 devstack sudo[91940]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-59611e34-48a7-47ad-b82e-e74ffb462b0e tempest-VolumesActionsTest-629355249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.333s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:39 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-59611e34-48a7-47ad-b82e-e74ffb462b0e tempest-VolumesActionsTest-629355249 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:31:39 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-59611e34-48a7-47ad-b82e-e74ffb462b0e tempest-VolumesActionsTest-629355249 None] Deleted volume successfully. Nov 03 07:31:39 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e6a2e8bc-b9e1-4df2-8d1a-8d95c197cbdd tempest-ServerActionsTestOtherA-1944466382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8c4b86a-8499-4aee-9f7a-862a29cb63ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6ce31ba-b408-4a95-8d8b-143709c51ec0', 'volume_size': 1, 'image_id': 'eb68a148-0c9c-4237-9d8d-94a6a7cd87d9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eb68a148-0c9c-4237-9d8d-94a6a7cd87d9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c9ace38ee46b42979b3d4c79532bd66e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eb68a148-0c9c-4237-9d8d-94a6a7cd87d9', 'created_at': datetime.datetime(2026, 11, 3, 6, 21, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 21, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eb68a148-0c9c-4237-9d8d-94a6a7cd87d9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:39 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e6a2e8bc-b9e1-4df2-8d1a-8d95c197cbdd tempest-ServerActionsTestOtherA-1944466382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bb70445-20cc-4de7-9a92-08e7dd8b39dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:39 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-59611e34-48a7-47ad-b82e-e74ffb462b0e tempest-VolumesActionsTest-629355249 None] Lock "cinder-93f5c443-73d9-437b-8493-6fa8cf31ad38-delete_volume" released by "delete_volume" :: held 1.822s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:31:39 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-e6a2e8bc-b9e1-4df2-8d1a-8d95c197cbdd tempest-ServerActionsTestOtherA-1944466382 None] Volume volume-a6ce31ba-b408-4a95-8d8b-143709c51ec0 (a6ce31ba-b408-4a95-8d8b-143709c51ec0): created successfully Nov 03 07:31:39 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e6a2e8bc-b9e1-4df2-8d1a-8d95c197cbdd tempest-ServerActionsTestOtherA-1944466382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bb70445-20cc-4de7-9a92-08e7dd8b39dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:39 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e6a2e8bc-b9e1-4df2-8d1a-8d95c197cbdd tempest-ServerActionsTestOtherA-1944466382 None] Flow 'volume_create_manager' (52e39b65-9baf-4971-b41d-9391f7b4dbd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:31:39 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-e6a2e8bc-b9e1-4df2-8d1a-8d95c197cbdd tempest-ServerActionsTestOtherA-1944466382 None] Created volume successfully. Nov 03 07:31:40 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:31:40 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] Flow 'volume_create_manager' (92be2c26-c5d2-41c2-8568-6e90f6fde75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:31:40 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (958bc31c-95e0-4c24-9e9c-e4b43b46c0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:40 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (958bc31c-95e0-4c24-9e9c-e4b43b46c0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:31:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-559288982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44d0f489-ecc8-48e8-b3a5-da5070cc1c9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d8bb3d69967462d98be448f1ddb5777',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:31:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=7153e62d-6fe8-4212-8311-3410e947b738,status='creating',terminated_at=None,updated_at=2026-11-03T06:31:40Z,use_quota=True,user_id='91a1ac2d5d4d488ea542d96cd3c6c939',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:40 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05373a8c-9ec5-4276-acf1-40b69e466006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:40 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05373a8c-9ec5-4276-acf1-40b69e466006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:40 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38fca2a1-da68-44d6-9bb2-6a4eafa9d0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:40 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38fca2a1-da68-44d6-9bb2-6a4eafa9d0d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '44d0f489-ecc8-48e8-b3a5-da5070cc1c9c', 'volume_name': 'volume-44d0f489-ecc8-48e8-b3a5-da5070cc1c9c', 'volume_size': 2, 'source_volid': '7153e62d-6fe8-4212-8311-3410e947b738', 'source_volstatus': 'available'}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:40 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25aaef21-43af-4b7d-b950-dbbcdbd73aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:40 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25aaef21-43af-4b7d-b950-dbbcdbd73aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:40 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de1ecea6-6565-465f-b284-5367e96959ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:40 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] Volume 44d0f489-ecc8-48e8-b3a5-da5070cc1c9c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-44d0f489-ecc8-48e8-b3a5-da5070cc1c9c', 'volume_size': 2, 'source_volid': '7153e62d-6fe8-4212-8311-3410e947b738', 'source_volstatus': 'available'} Nov 03 07:31:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:40 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] Cloning volume 7153e62d-6fe8-4212-8311-3410e947b738 to volume 44d0f489-ecc8-48e8-b3a5-da5070cc1c9c Nov 03 07:31:40 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] Creating offline snapshot 76a92750-60c2-4a73-946f-c67bee6f122d of volume 7153e62d-6fe8-4212-8311-3410e947b738 {{(pid=86875) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:31:40 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[de71c99a-5425-4d37-8064-66474095813a]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:31:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7153e62d-6fe8-4212-8311-3410e947b738 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:40 devstack sudo[91944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7153e62d-6fe8-4212-8311-3410e947b738 Nov 03 07:31:40 devstack sudo[91944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:40 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-0308673c-a470-44a4-924c-da74ce34ea3e tempest-VolumesActionsTest-1562044613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:31:40 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0308673c-a470-44a4-924c-da74ce34ea3e tempest-VolumesActionsTest-1562044613 None] Flow 'volume_create_manager' (0fef7888-bf32-4325-98f3-5a56785e9039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:31:40 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0308673c-a470-44a4-924c-da74ce34ea3e tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2864a00-763f-477d-9589-e781c9a2b04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:40 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0308673c-a470-44a4-924c-da74ce34ea3e tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2864a00-763f-477d-9589-e781c9a2b04e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:31:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1732008457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66bb9f81-a436-4d85-bdf2-efe9e486db90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33fdd7b0bfb943bd87e5ddcdbd730b5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:31:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:31:41Z,use_quota=True,user_id='a96d47c1521a4560be32f33768324e83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:40 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0308673c-a470-44a4-924c-da74ce34ea3e tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba36f59f-89b1-4d6f-97cf-7a772c9eeca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:40 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0308673c-a470-44a4-924c-da74ce34ea3e tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba36f59f-89b1-4d6f-97cf-7a772c9eeca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:40 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0308673c-a470-44a4-924c-da74ce34ea3e tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee6ce754-fd94-4135-81a6-9f2f3875586a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:40 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0308673c-a470-44a4-924c-da74ce34ea3e tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee6ce754-fd94-4135-81a6-9f2f3875586a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66bb9f81-a436-4d85-bdf2-efe9e486db90', 'volume_name': 'volume-66bb9f81-a436-4d85-bdf2-efe9e486db90', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:40 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0308673c-a470-44a4-924c-da74ce34ea3e tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2407fc0e-6438-4bb4-9b8f-eb473a528bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:40 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0308673c-a470-44a4-924c-da74ce34ea3e tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2407fc0e-6438-4bb4-9b8f-eb473a528bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:40 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0308673c-a470-44a4-924c-da74ce34ea3e tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (096edaac-66bc-474e-9a38-4db209daf9dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:40 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-0308673c-a470-44a4-924c-da74ce34ea3e tempest-VolumesActionsTest-1562044613 None] Volume 66bb9f81-a436-4d85-bdf2-efe9e486db90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66bb9f81-a436-4d85-bdf2-efe9e486db90', 'volume_size': 1} Nov 03 07:31:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0308673c-a470-44a4-924c-da74ce34ea3e tempest-VolumesActionsTest-1562044613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:41 devstack sudo[91944]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7153e62d-6fe8-4212-8311-3410e947b738" returned: 0 in 0.555s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7153e62d-6fe8-4212-8311-3410e947b738,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7153e62d-6fe8-4212-8311-3410e947b738.76a92750-60c2-4a73-946f-c67bee6f122d 1G {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:41 devstack sudo[91950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7153e62d-6fe8-4212-8311-3410e947b738,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7153e62d-6fe8-4212-8311-3410e947b738.76a92750-60c2-4a73-946f-c67bee6f122d 1G Nov 03 07:31:41 devstack sudo[91950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:41 devstack sudo[91950]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7153e62d-6fe8-4212-8311-3410e947b738,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7153e62d-6fe8-4212-8311-3410e947b738.76a92750-60c2-4a73-946f-c67bee6f122d 1G" returned: 0 in 0.669s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7153e62d-6fe8-4212-8311-3410e947b738 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7153e62d-6fe8-4212-8311-3410e947b738.76a92750-60c2-4a73-946f-c67bee6f122d {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:41 devstack sudo[91960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7153e62d-6fe8-4212-8311-3410e947b738 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7153e62d-6fe8-4212-8311-3410e947b738.76a92750-60c2-4a73-946f-c67bee6f122d Nov 03 07:31:41 devstack sudo[91960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:42 devstack sudo[91960]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7153e62d-6fe8-4212-8311-3410e947b738 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7153e62d-6fe8-4212-8311-3410e947b738.76a92750-60c2-4a73-946f-c67bee6f122d" returned: 0 in 0.480s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:42 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7153e62d-6fe8-4212-8311-3410e947b738.76a92750-60c2-4a73-946f-c67bee6f122d is being set with open permissions: ugo+rw Nov 03 07:31:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7153e62d-6fe8-4212-8311-3410e947b738.76a92750-60c2-4a73-946f-c67bee6f122d {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:42 devstack sudo[91969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7153e62d-6fe8-4212-8311-3410e947b738.76a92750-60c2-4a73-946f-c67bee6f122d Nov 03 07:31:42 devstack sudo[91969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:42 devstack sudo[91969]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7153e62d-6fe8-4212-8311-3410e947b738.76a92750-60c2-4a73-946f-c67bee6f122d" returned: 0 in 0.450s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7153e62d-6fe8-4212-8311-3410e947b738.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:42 devstack sudo[91972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7153e62d-6fe8-4212-8311-3410e947b738.info Nov 03 07:31:42 devstack sudo[91972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:43 devstack sudo[91972]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:43 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7153e62d-6fe8-4212-8311-3410e947b738.info" returned: 0 in 0.543s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:43 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7153e62d-6fe8-4212-8311-3410e947b738.info is being set with open permissions: ugo+rw Nov 03 07:31:43 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7153e62d-6fe8-4212-8311-3410e947b738.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:43 devstack sudo[92018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7153e62d-6fe8-4212-8311-3410e947b738.info Nov 03 07:31:43 devstack sudo[92018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:44 devstack sudo[92018]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7153e62d-6fe8-4212-8311-3410e947b738.info" returned: 0 in 0.563s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:44 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] Acquiring lock "cinder-quobyte-44d0f489-ecc8-48e8-b3a5-da5070cc1c9c" by "_copy_volume_from_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:44 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] Lock "cinder-quobyte-44d0f489-ecc8-48e8-b3a5-da5070cc1c9c" acquired by "_copy_volume_from_snapshot" :: waited 0.113s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:44 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] snapshot: 76a92750-60c2-4a73-946f-c67bee6f122d, volume: 44d0f489-ecc8-48e8-b3a5-da5070cc1c9c, {{(pid=86875) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 07:31:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:44 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:31:44 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:31:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:44 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b8174b-31bc-4389-97f4-db548dd54459]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:31:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7153e62d-6fe8-4212-8311-3410e947b738.76a92750-60c2-4a73-946f-c67bee6f122d {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-f88cf041-4a38-48bf-885c-cf547609b4bb req-2324236c-21ac-48b8-9a52-e3c211fe4051 tempest-ServerActionsTestOtherA-1944466382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:44 devstack sudo[92050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7153e62d-6fe8-4212-8311-3410e947b738.76a92750-60c2-4a73-946f-c67bee6f122d Nov 03 07:31:44 devstack sudo[92050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:45 devstack sudo[92050]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7153e62d-6fe8-4212-8311-3410e947b738.76a92750-60c2-4a73-946f-c67bee6f122d" returned: 0 in 0.936s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:45 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7153e62d-6fe8-4212-8311-3410e947b738(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:31:45 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed53e79-25ed-4498-b8fa-5c5ee62028a1]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:31:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7153e62d-6fe8-4212-8311-3410e947b738 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:45 devstack sudo[92061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7153e62d-6fe8-4212-8311-3410e947b738 Nov 03 07:31:45 devstack sudo[92061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:46 devstack sudo[92061]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7153e62d-6fe8-4212-8311-3410e947b738" returned: 0 in 0.696s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:46 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] will copy from snapshot at /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7153e62d-6fe8-4212-8311-3410e947b738 {{(pid=86875) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 07:31:46 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] Creating direct copy from snapshot {{(pid=86875) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 07:31:46 devstack cinder-volume[86875]: DEBUG cinder.utils [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] Path /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-44d0f489-ecc8-48e8-b3a5-da5070cc1c9c not found in is_blk_device check {{(pid=86875) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 07:31:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7153e62d-6fe8-4212-8311-3410e947b738 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-44d0f489-ecc8-48e8-b3a5-da5070cc1c9c {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:46 devstack sudo[92066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7153e62d-6fe8-4212-8311-3410e947b738 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-44d0f489-ecc8-48e8-b3a5-da5070cc1c9c Nov 03 07:31:46 devstack sudo[92066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:54 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:SELECT=45,cinder:UPDATE=48,cinder:DELETE=4,cinder:INSERT=17 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:31:54 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:SELECT=49,cinder:UPDATE=43,cinder:INSERT=17,cinder:DELETE=4 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:31:56 devstack sudo[92066]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7153e62d-6fe8-4212-8311-3410e947b738 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-44d0f489-ecc8-48e8-b3a5-da5070cc1c9c" returned: 0 in 10.390s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:56 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] Image conversion details: src /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7153e62d-6fe8-4212-8311-3410e947b738, size 1024.00 MB, duration 10.39 sec, destination /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-44d0f489-ecc8-48e8-b3a5-da5070cc1c9c {{(pid=86875) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:31:56 devstack cinder-volume[86875]: INFO cinder.image.image_utils [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] Converted 1024.00 MB image at 98.55 MB/s Nov 03 07:31:56 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-44d0f489-ecc8-48e8-b3a5-da5070cc1c9c is being set with open permissions: ugo+rw Nov 03 07:31:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-44d0f489-ecc8-48e8-b3a5-da5070cc1c9c {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:56 devstack sudo[92099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-44d0f489-ecc8-48e8-b3a5-da5070cc1c9c Nov 03 07:31:56 devstack sudo[92099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:56 devstack sudo[92099]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-44d0f489-ecc8-48e8-b3a5-da5070cc1c9c" returned: 0 in 0.243s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:56 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] Lock "cinder-quobyte-44d0f489-ecc8-48e8-b3a5-da5070cc1c9c" released by "_copy_volume_from_snapshot" :: held 12.461s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:31:56 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] Acquiring lock "cinder-quobyte-76a92750-60c2-4a73-946f-c67bee6f122d" by "_delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:56 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] Lock "cinder-quobyte-76a92750-60c2-4a73-946f-c67bee6f122d" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:56 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] Deleting offline snapshot 76a92750-60c2-4a73-946f-c67bee6f122d of volume 7153e62d-6fe8-4212-8311-3410e947b738 {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:31:56 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] snapshot_file for this snap is: volume-7153e62d-6fe8-4212-8311-3410e947b738.76a92750-60c2-4a73-946f-c67bee6f122d {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:31:56 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a6dd96-b89d-4a71-b5ef-0e59d8f8f290]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:31:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7153e62d-6fe8-4212-8311-3410e947b738.76a92750-60c2-4a73-946f-c67bee6f122d {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:56 devstack sudo[92102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7153e62d-6fe8-4212-8311-3410e947b738.76a92750-60c2-4a73-946f-c67bee6f122d Nov 03 07:31:56 devstack sudo[92102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:57 devstack sudo[92102]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7153e62d-6fe8-4212-8311-3410e947b738.76a92750-60c2-4a73-946f-c67bee6f122d" returned: 0 in 0.426s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:57 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7153e62d-6fe8-4212-8311-3410e947b738(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:31:57 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[923f5bbb-d863-4de7-8ec5-49eaafce4566]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:31:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7153e62d-6fe8-4212-8311-3410e947b738 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:57 devstack sudo[92108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7153e62d-6fe8-4212-8311-3410e947b738 Nov 03 07:31:57 devstack sudo[92108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:57 devstack sudo[92108]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7153e62d-6fe8-4212-8311-3410e947b738" returned: 0 in 0.542s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7153e62d-6fe8-4212-8311-3410e947b738.76a92750-60c2-4a73-946f-c67bee6f122d {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:57 devstack sudo[92113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7153e62d-6fe8-4212-8311-3410e947b738.76a92750-60c2-4a73-946f-c67bee6f122d Nov 03 07:31:57 devstack sudo[92113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:58 devstack sudo[92113]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7153e62d-6fe8-4212-8311-3410e947b738.76a92750-60c2-4a73-946f-c67bee6f122d" returned: 0 in 0.421s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7153e62d-6fe8-4212-8311-3410e947b738.76a92750-60c2-4a73-946f-c67bee6f122d {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:58 devstack sudo[92137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7153e62d-6fe8-4212-8311-3410e947b738.76a92750-60c2-4a73-946f-c67bee6f122d Nov 03 07:31:58 devstack sudo[92137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:58 devstack sudo[92137]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7153e62d-6fe8-4212-8311-3410e947b738.76a92750-60c2-4a73-946f-c67bee6f122d" returned: 0 in 0.274s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:58 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] Lock "cinder-quobyte-76a92750-60c2-4a73-946f-c67bee6f122d" released by "_delete_snapshot" :: held 1.805s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:31:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.017s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0308673c-a470-44a4-924c-da74ce34ea3e tempest-VolumesActionsTest-1562044613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.594s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:58 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-0308673c-a470-44a4-924c-da74ce34ea3e tempest-VolumesActionsTest-1562044613 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:31:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1732008457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66bb9f81-a436-4d85-bdf2-efe9e486db90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33fdd7b0bfb943bd87e5ddcdbd730b5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:31:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:31:41Z,use_quota=True,user_id='a96d47c1521a4560be32f33768324e83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:31:58 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-0308673c-a470-44a4-924c-da74ce34ea3e tempest-VolumesActionsTest-1562044613 None] Creating volume 66bb9f81-a436-4d85-bdf2-efe9e486db90 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:31:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0308673c-a470-44a4-924c-da74ce34ea3e tempest-VolumesActionsTest-1562044613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:31:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0308673c-a470-44a4-924c-da74ce34ea3e tempest-VolumesActionsTest-1562044613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:58 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-0308673c-a470-44a4-924c-da74ce34ea3e tempest-VolumesActionsTest-1562044613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:31:58 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-0308673c-a470-44a4-924c-da74ce34ea3e tempest-VolumesActionsTest-1562044613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:31:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0308673c-a470-44a4-924c-da74ce34ea3e tempest-VolumesActionsTest-1562044613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:58 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-0308673c-a470-44a4-924c-da74ce34ea3e tempest-VolumesActionsTest-1562044613 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:31:58 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-0308673c-a470-44a4-924c-da74ce34ea3e tempest-VolumesActionsTest-1562044613 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:31:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0308673c-a470-44a4-924c-da74ce34ea3e tempest-VolumesActionsTest-1562044613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-66bb9f81-a436-4d85-bdf2-efe9e486db90 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de1ecea6-6565-465f-b284-5367e96959ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44d0f489-ecc8-48e8-b3a5-da5070cc1c9c', 'volume_size': 2, 'source_volid': '7153e62d-6fe8-4212-8311-3410e947b738', 'source_volstatus': 'available'}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:58 devstack sudo[92142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-66bb9f81-a436-4d85-bdf2-efe9e486db90 1073741824 Nov 03 07:31:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0b3a0ca-ef5b-4d1e-ae9a-d02d913b0605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:58 devstack sudo[92142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:58 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] Volume volume-44d0f489-ecc8-48e8-b3a5-da5070cc1c9c (44d0f489-ecc8-48e8-b3a5-da5070cc1c9c): created successfully Nov 03 07:31:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0b3a0ca-ef5b-4d1e-ae9a-d02d913b0605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] Flow 'volume_create_manager' (92be2c26-c5d2-41c2-8568-6e90f6fde75d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:31:58 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-f2e3696b-eed7-49ea-b25b-65c5f445c6a4 tempest-VolumesCloneTest-511126810 None] Created volume successfully. Nov 03 07:31:59 devstack sudo[92142]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0308673c-a470-44a4-924c-da74ce34ea3e tempest-VolumesActionsTest-1562044613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-66bb9f81-a436-4d85-bdf2-efe9e486db90 1073741824" returned: 0 in 0.519s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0308673c-a470-44a4-924c-da74ce34ea3e tempest-VolumesActionsTest-1562044613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-66bb9f81-a436-4d85-bdf2-efe9e486db90 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:59 devstack sudo[92147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-66bb9f81-a436-4d85-bdf2-efe9e486db90 Nov 03 07:31:59 devstack sudo[92147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:59 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-0898acc8-e1bc-48ce-9e1d-9ade3b5178cd tempest-VolumesCloneTest-511126810 None] Acquiring lock "cinder-44d0f489-ecc8-48e8-b3a5-da5070cc1c9c-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:59 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-0898acc8-e1bc-48ce-9e1d-9ade3b5178cd tempest-VolumesCloneTest-511126810 None] Lock "cinder-44d0f489-ecc8-48e8-b3a5-da5070cc1c9c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:59 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-0898acc8-e1bc-48ce-9e1d-9ade3b5178cd tempest-VolumesCloneTest-511126810 None] Acquiring lock "cinder-quobyte-44d0f489-ecc8-48e8-b3a5-da5070cc1c9c" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:31:59 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-0898acc8-e1bc-48ce-9e1d-9ade3b5178cd tempest-VolumesCloneTest-511126810 None] Lock "cinder-quobyte-44d0f489-ecc8-48e8-b3a5-da5070cc1c9c" acquired by "delete_volume" :: waited 0.017s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:31:59 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[91415304-8fc8-4973-8b5d-b0c7bec93813]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:31:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0898acc8-e1bc-48ce-9e1d-9ade3b5178cd tempest-VolumesCloneTest-511126810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-44d0f489-ecc8-48e8-b3a5-da5070cc1c9c {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:59 devstack sudo[92147]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0308673c-a470-44a4-924c-da74ce34ea3e tempest-VolumesActionsTest-1562044613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-66bb9f81-a436-4d85-bdf2-efe9e486db90" returned: 0 in 0.291s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:59 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-0308673c-a470-44a4-924c-da74ce34ea3e tempest-VolumesActionsTest-1562044613 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:31:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0308673c-a470-44a4-924c-da74ce34ea3e tempest-VolumesActionsTest-1562044613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-f88cf041-4a38-48bf-885c-cf547609b4bb req-2324236c-21ac-48b8-9a52-e3c211fe4051 tempest-ServerActionsTestOtherA-1944466382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 15.090s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:31:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0308673c-a470-44a4-924c-da74ce34ea3e tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (096edaac-66bc-474e-9a38-4db209daf9dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66bb9f81-a436-4d85-bdf2-efe9e486db90', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0308673c-a470-44a4-924c-da74ce34ea3e tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3a981b8-7291-4d2e-9102-fb8a6c3fda0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:31:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-f88cf041-4a38-48bf-885c-cf547609b4bb req-2324236c-21ac-48b8-9a52-e3c211fe4051 tempest-ServerActionsTestOtherA-1944466382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:31:59 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-0308673c-a470-44a4-924c-da74ce34ea3e tempest-VolumesActionsTest-1562044613 None] Volume volume-66bb9f81-a436-4d85-bdf2-efe9e486db90 (66bb9f81-a436-4d85-bdf2-efe9e486db90): created successfully Nov 03 07:31:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0308673c-a470-44a4-924c-da74ce34ea3e tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3a981b8-7291-4d2e-9102-fb8a6c3fda0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:31:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0308673c-a470-44a4-924c-da74ce34ea3e tempest-VolumesActionsTest-1562044613 None] Flow 'volume_create_manager' (0fef7888-bf32-4325-98f3-5a56785e9039) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:31:59 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-0308673c-a470-44a4-924c-da74ce34ea3e tempest-VolumesActionsTest-1562044613 None] Created volume successfully. Nov 03 07:31:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-f88cf041-4a38-48bf-885c-cf547609b4bb req-2324236c-21ac-48b8-9a52-e3c211fe4051 tempest-ServerActionsTestOtherA-1944466382 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1', 'name': 'volume-a6ce31ba-b408-4a95-8d8b-143709c51ec0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c2413977-b4db-4aca-87fc-3523d6cdc72e', 'enforce_multipath': True} {{(pid=86875) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:31:59 devstack sudo[92150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-44d0f489-ecc8-48e8-b3a5-da5070cc1c9c Nov 03 07:31:59 devstack sudo[92150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:31:59 devstack cinder-volume[86875]: INFO cinder.volume.manager [req-f88cf041-4a38-48bf-885c-cf547609b4bb req-2324236c-21ac-48b8-9a52-e3c211fe4051 tempest-ServerActionsTestOtherA-1944466382 None] attachment_update completed successfully. Nov 03 07:31:59 devstack sudo[92150]: pam_unix(sudo:session): session closed for user root Nov 03 07:31:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0898acc8-e1bc-48ce-9e1d-9ade3b5178cd tempest-VolumesCloneTest-511126810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-44d0f489-ecc8-48e8-b3a5-da5070cc1c9c" returned: 0 in 0.479s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:31:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0898acc8-e1bc-48ce-9e1d-9ade3b5178cd tempest-VolumesCloneTest-511126810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-44d0f489-ecc8-48e8-b3a5-da5070cc1c9c {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:31:59 devstack sudo[92155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-44d0f489-ecc8-48e8-b3a5-da5070cc1c9c Nov 03 07:31:59 devstack sudo[92155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:00 devstack sudo[92155]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0898acc8-e1bc-48ce-9e1d-9ade3b5178cd tempest-VolumesCloneTest-511126810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-44d0f489-ecc8-48e8-b3a5-da5070cc1c9c" returned: 0 in 0.301s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:00 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-0898acc8-e1bc-48ce-9e1d-9ade3b5178cd tempest-VolumesCloneTest-511126810 None] Lock "cinder-quobyte-44d0f489-ecc8-48e8-b3a5-da5070cc1c9c" released by "delete_volume" :: held 0.832s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:00 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-0898acc8-e1bc-48ce-9e1d-9ade3b5178cd tempest-VolumesCloneTest-511126810 None] Created reservations ['145d564b-0729-4af5-8bc7-241d4d1eb3ae', '5abf5c15-a127-4a94-a42f-d38314973a7d', '26c64898-24f6-469c-b41e-6a852078be8c', '8deb4edb-a339-4a8a-8f2c-884999836f52'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:32:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0898acc8-e1bc-48ce-9e1d-9ade3b5178cd tempest-VolumesCloneTest-511126810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0898acc8-e1bc-48ce-9e1d-9ade3b5178cd tempest-VolumesCloneTest-511126810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:00 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-0898acc8-e1bc-48ce-9e1d-9ade3b5178cd tempest-VolumesCloneTest-511126810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:32:00 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-0898acc8-e1bc-48ce-9e1d-9ade3b5178cd tempest-VolumesCloneTest-511126810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:32:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0898acc8-e1bc-48ce-9e1d-9ade3b5178cd tempest-VolumesCloneTest-511126810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0898acc8-e1bc-48ce-9e1d-9ade3b5178cd tempest-VolumesCloneTest-511126810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:00 devstack sudo[92269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:32:00 devstack sudo[92269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:00 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-3ae61694-5707-4629-bbd2-b47b7eabcbee tempest-VolumesActionsTest-629355249 None] Acquiring lock "cinder-66bb9f81-a436-4d85-bdf2-efe9e486db90-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:32:00 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-3ae61694-5707-4629-bbd2-b47b7eabcbee tempest-VolumesActionsTest-629355249 None] Lock "cinder-66bb9f81-a436-4d85-bdf2-efe9e486db90-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:32:00 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-f4402115-1e90-4c4f-9790-9a653a0fadc6 tempest-VolumesCloneTest-511126810 None] Acquiring lock "cinder-7153e62d-6fe8-4212-8311-3410e947b738-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:32:00 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-f4402115-1e90-4c4f-9790-9a653a0fadc6 tempest-VolumesCloneTest-511126810 None] Lock "cinder-7153e62d-6fe8-4212-8311-3410e947b738-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:32:01 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-3ae61694-5707-4629-bbd2-b47b7eabcbee tempest-VolumesActionsTest-629355249 None] Acquiring lock "cinder-quobyte-66bb9f81-a436-4d85-bdf2-efe9e486db90" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:32:01 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-3ae61694-5707-4629-bbd2-b47b7eabcbee tempest-VolumesActionsTest-629355249 None] Lock "cinder-quobyte-66bb9f81-a436-4d85-bdf2-efe9e486db90" acquired by "delete_volume" :: waited 0.059s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:32:01 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-f4402115-1e90-4c4f-9790-9a653a0fadc6 tempest-VolumesCloneTest-511126810 None] Acquiring lock "cinder-quobyte-7153e62d-6fe8-4212-8311-3410e947b738" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:32:01 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[123fd246-ed3e-498b-8eed-6932b2165eba]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:32:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3ae61694-5707-4629-bbd2-b47b7eabcbee tempest-VolumesActionsTest-629355249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-66bb9f81-a436-4d85-bdf2-efe9e486db90 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:01 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-f4402115-1e90-4c4f-9790-9a653a0fadc6 tempest-VolumesCloneTest-511126810 None] Lock "cinder-quobyte-7153e62d-6fe8-4212-8311-3410e947b738" acquired by "delete_volume" :: waited 0.038s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:32:01 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1333bc-1aec-44d7-8715-ef5bf0498e9b]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:32:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f4402115-1e90-4c4f-9790-9a653a0fadc6 tempest-VolumesCloneTest-511126810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7153e62d-6fe8-4212-8311-3410e947b738 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:01 devstack sudo[92269]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0898acc8-e1bc-48ce-9e1d-9ade3b5178cd tempest-VolumesCloneTest-511126810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.734s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:01 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-0898acc8-e1bc-48ce-9e1d-9ade3b5178cd tempest-VolumesCloneTest-511126810 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:32:01 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-0898acc8-e1bc-48ce-9e1d-9ade3b5178cd tempest-VolumesCloneTest-511126810 None] Deleted volume successfully. Nov 03 07:32:01 devstack sudo[92604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-66bb9f81-a436-4d85-bdf2-efe9e486db90 Nov 03 07:32:01 devstack sudo[92604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:01 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-0898acc8-e1bc-48ce-9e1d-9ade3b5178cd tempest-VolumesCloneTest-511126810 None] Lock "cinder-44d0f489-ecc8-48e8-b3a5-da5070cc1c9c-delete_volume" released by "delete_volume" :: held 1.943s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:01 devstack sudo[92608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7153e62d-6fe8-4212-8311-3410e947b738 Nov 03 07:32:01 devstack sudo[92608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:01 devstack sudo[92604]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3ae61694-5707-4629-bbd2-b47b7eabcbee tempest-VolumesActionsTest-629355249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-66bb9f81-a436-4d85-bdf2-efe9e486db90" returned: 0 in 0.577s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3ae61694-5707-4629-bbd2-b47b7eabcbee tempest-VolumesActionsTest-629355249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-66bb9f81-a436-4d85-bdf2-efe9e486db90 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:01 devstack sudo[92621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-66bb9f81-a436-4d85-bdf2-efe9e486db90 Nov 03 07:32:01 devstack sudo[92621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:01 devstack sudo[92608]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f4402115-1e90-4c4f-9790-9a653a0fadc6 tempest-VolumesCloneTest-511126810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7153e62d-6fe8-4212-8311-3410e947b738" returned: 0 in 0.635s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f4402115-1e90-4c4f-9790-9a653a0fadc6 tempest-VolumesCloneTest-511126810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7153e62d-6fe8-4212-8311-3410e947b738 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:01 devstack sudo[92627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7153e62d-6fe8-4212-8311-3410e947b738 Nov 03 07:32:01 devstack sudo[92627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:02 devstack sudo[92621]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3ae61694-5707-4629-bbd2-b47b7eabcbee tempest-VolumesActionsTest-629355249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-66bb9f81-a436-4d85-bdf2-efe9e486db90" returned: 0 in 0.356s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:02 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-3ae61694-5707-4629-bbd2-b47b7eabcbee tempest-VolumesActionsTest-629355249 None] Lock "cinder-quobyte-66bb9f81-a436-4d85-bdf2-efe9e486db90" released by "delete_volume" :: held 1.007s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:02 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-3ae61694-5707-4629-bbd2-b47b7eabcbee tempest-VolumesActionsTest-629355249 None] Created reservations ['a41def39-4cc7-4bef-8690-f9d5fef54675', '4f502c34-1594-4a1e-938f-feb539a0ce05', '3218a14a-feee-4a4e-8f7b-705966459a61', 'a12f6c1a-6157-4dc8-a2bb-60182ee1446f'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:32:02 devstack sudo[92627]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f4402115-1e90-4c4f-9790-9a653a0fadc6 tempest-VolumesCloneTest-511126810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7153e62d-6fe8-4212-8311-3410e947b738" returned: 0 in 0.314s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:02 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-f4402115-1e90-4c4f-9790-9a653a0fadc6 tempest-VolumesCloneTest-511126810 None] Lock "cinder-quobyte-7153e62d-6fe8-4212-8311-3410e947b738" released by "delete_volume" :: held 1.054s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3ae61694-5707-4629-bbd2-b47b7eabcbee tempest-VolumesActionsTest-629355249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3ae61694-5707-4629-bbd2-b47b7eabcbee tempest-VolumesActionsTest-629355249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:02 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-3ae61694-5707-4629-bbd2-b47b7eabcbee tempest-VolumesActionsTest-629355249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:32:02 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-3ae61694-5707-4629-bbd2-b47b7eabcbee tempest-VolumesActionsTest-629355249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:32:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3ae61694-5707-4629-bbd2-b47b7eabcbee tempest-VolumesActionsTest-629355249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3ae61694-5707-4629-bbd2-b47b7eabcbee tempest-VolumesActionsTest-629355249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:02 devstack sudo[92631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:32:02 devstack sudo[92631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:02 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-f4402115-1e90-4c4f-9790-9a653a0fadc6 tempest-VolumesCloneTest-511126810 None] Created reservations ['554235df-163a-440d-ba51-1670872bc34c', '42d7f4e6-2df7-4eb3-9676-ea10da508c17', '0858cbdf-11e1-4400-8a51-2abd830ff9cf', '176e16b1-3480-4e14-a161-e1c3fae8483e'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:32:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-f4402115-1e90-4c4f-9790-9a653a0fadc6 tempest-VolumesCloneTest-511126810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-f4402115-1e90-4c4f-9790-9a653a0fadc6 tempest-VolumesCloneTest-511126810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:02 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-f4402115-1e90-4c4f-9790-9a653a0fadc6 tempest-VolumesCloneTest-511126810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:32:02 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-f4402115-1e90-4c4f-9790-9a653a0fadc6 tempest-VolumesCloneTest-511126810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:32:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-f4402115-1e90-4c4f-9790-9a653a0fadc6 tempest-VolumesCloneTest-511126810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f4402115-1e90-4c4f-9790-9a653a0fadc6 tempest-VolumesCloneTest-511126810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:02 devstack sudo[92635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:32:02 devstack sudo[92635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:02 devstack sudo[92631]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3ae61694-5707-4629-bbd2-b47b7eabcbee tempest-VolumesActionsTest-629355249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.358s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:02 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-3ae61694-5707-4629-bbd2-b47b7eabcbee tempest-VolumesActionsTest-629355249 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:32:02 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-3ae61694-5707-4629-bbd2-b47b7eabcbee tempest-VolumesActionsTest-629355249 None] Deleted volume successfully. Nov 03 07:32:02 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-3ae61694-5707-4629-bbd2-b47b7eabcbee tempest-VolumesActionsTest-629355249 None] Lock "cinder-66bb9f81-a436-4d85-bdf2-efe9e486db90-delete_volume" released by "delete_volume" :: held 1.863s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:02 devstack sudo[92635]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f4402115-1e90-4c4f-9790-9a653a0fadc6 tempest-VolumesCloneTest-511126810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.522s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:02 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-f4402115-1e90-4c4f-9790-9a653a0fadc6 tempest-VolumesCloneTest-511126810 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:32:02 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-f4402115-1e90-4c4f-9790-9a653a0fadc6 tempest-VolumesCloneTest-511126810 None] Deleted volume successfully. Nov 03 07:32:03 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-f4402115-1e90-4c4f-9790-9a653a0fadc6 tempest-VolumesCloneTest-511126810 None] Lock "cinder-7153e62d-6fe8-4212-8311-3410e947b738-delete_volume" released by "delete_volume" :: held 2.092s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:03 devstack cinder-volume[86875]: DEBUG oslo_service.periodic_task [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86875) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:32:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:32:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:32:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:03 devstack sudo[92640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:32:03 devstack sudo[92640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:03 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8bbc4b6-9e85-4b21-a9b4-e051c291fa76 tempest-VolumesActionsTest-1562044613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:32:03 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c8bbc4b6-9e85-4b21-a9b4-e051c291fa76 tempest-VolumesActionsTest-1562044613 None] Flow 'volume_create_manager' (15941b62-1fda-408a-a24d-3c9c1a32572c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:32:03 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c8bbc4b6-9e85-4b21-a9b4-e051c291fa76 tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fc2c850-aeec-46c9-83d9-49d7433ebd60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:03 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c8bbc4b6-9e85-4b21-a9b4-e051c291fa76 tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fc2c850-aeec-46c9-83d9-49d7433ebd60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:32:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1746300793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05c36bff-8006-49a8-8fbb-dec273ffc65a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33fdd7b0bfb943bd87e5ddcdbd730b5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:32:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:32:04Z,use_quota=True,user_id='a96d47c1521a4560be32f33768324e83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:03 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c8bbc4b6-9e85-4b21-a9b4-e051c291fa76 tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fefb5feb-d6b8-4236-9def-ec34b733511a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:03 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c8bbc4b6-9e85-4b21-a9b4-e051c291fa76 tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fefb5feb-d6b8-4236-9def-ec34b733511a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:03 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c8bbc4b6-9e85-4b21-a9b4-e051c291fa76 tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19ce7b2d-9057-4623-9291-ef1461c2fdd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:03 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c8bbc4b6-9e85-4b21-a9b4-e051c291fa76 tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19ce7b2d-9057-4623-9291-ef1461c2fdd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05c36bff-8006-49a8-8fbb-dec273ffc65a', 'volume_name': 'volume-05c36bff-8006-49a8-8fbb-dec273ffc65a', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:03 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c8bbc4b6-9e85-4b21-a9b4-e051c291fa76 tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87d563f1-46eb-43ed-b244-6812fb435d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:03 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c8bbc4b6-9e85-4b21-a9b4-e051c291fa76 tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87d563f1-46eb-43ed-b244-6812fb435d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:03 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c8bbc4b6-9e85-4b21-a9b4-e051c291fa76 tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9911f6b5-0365-4278-bd2d-c7f51e2205f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:03 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-c8bbc4b6-9e85-4b21-a9b4-e051c291fa76 tempest-VolumesActionsTest-1562044613 None] Volume 05c36bff-8006-49a8-8fbb-dec273ffc65a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05c36bff-8006-49a8-8fbb-dec273ffc65a', 'volume_size': 1} Nov 03 07:32:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-c8bbc4b6-9e85-4b21-a9b4-e051c291fa76 tempest-VolumesActionsTest-1562044613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-c8bbc4b6-9e85-4b21-a9b4-e051c291fa76 tempest-VolumesActionsTest-1562044613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-c8bbc4b6-9e85-4b21-a9b4-e051c291fa76 tempest-VolumesActionsTest-1562044613 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:32:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1746300793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05c36bff-8006-49a8-8fbb-dec273ffc65a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33fdd7b0bfb943bd87e5ddcdbd730b5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:32:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:32:04Z,use_quota=True,user_id='a96d47c1521a4560be32f33768324e83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:32:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-c8bbc4b6-9e85-4b21-a9b4-e051c291fa76 tempest-VolumesActionsTest-1562044613 None] Creating volume 05c36bff-8006-49a8-8fbb-dec273ffc65a {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:32:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-c8bbc4b6-9e85-4b21-a9b4-e051c291fa76 tempest-VolumesActionsTest-1562044613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-c8bbc4b6-9e85-4b21-a9b4-e051c291fa76 tempest-VolumesActionsTest-1562044613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-c8bbc4b6-9e85-4b21-a9b4-e051c291fa76 tempest-VolumesActionsTest-1562044613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:32:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-c8bbc4b6-9e85-4b21-a9b4-e051c291fa76 tempest-VolumesActionsTest-1562044613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:32:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-c8bbc4b6-9e85-4b21-a9b4-e051c291fa76 tempest-VolumesActionsTest-1562044613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-c8bbc4b6-9e85-4b21-a9b4-e051c291fa76 tempest-VolumesActionsTest-1562044613 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:32:03 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-c8bbc4b6-9e85-4b21-a9b4-e051c291fa76 tempest-VolumesActionsTest-1562044613 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:32:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c8bbc4b6-9e85-4b21-a9b4-e051c291fa76 tempest-VolumesActionsTest-1562044613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-05c36bff-8006-49a8-8fbb-dec273ffc65a 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:04 devstack sudo[92643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-05c36bff-8006-49a8-8fbb-dec273ffc65a 1073741824 Nov 03 07:32:04 devstack sudo[92643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:04 devstack sudo[92640]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.505s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:04 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:32:04 devstack sudo[92643]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c8bbc4b6-9e85-4b21-a9b4-e051c291fa76 tempest-VolumesActionsTest-1562044613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-05c36bff-8006-49a8-8fbb-dec273ffc65a 1073741824" returned: 0 in 0.693s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c8bbc4b6-9e85-4b21-a9b4-e051c291fa76 tempest-VolumesActionsTest-1562044613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-05c36bff-8006-49a8-8fbb-dec273ffc65a {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:04 devstack sudo[92649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-05c36bff-8006-49a8-8fbb-dec273ffc65a Nov 03 07:32:04 devstack sudo[92649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:05 devstack sudo[92649]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c8bbc4b6-9e85-4b21-a9b4-e051c291fa76 tempest-VolumesActionsTest-1562044613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-05c36bff-8006-49a8-8fbb-dec273ffc65a" returned: 0 in 0.502s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:05 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-c8bbc4b6-9e85-4b21-a9b4-e051c291fa76 tempest-VolumesActionsTest-1562044613 None] <== create_volume: return (1300ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:32:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-c8bbc4b6-9e85-4b21-a9b4-e051c291fa76 tempest-VolumesActionsTest-1562044613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.308s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:05 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c8bbc4b6-9e85-4b21-a9b4-e051c291fa76 tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9911f6b5-0365-4278-bd2d-c7f51e2205f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05c36bff-8006-49a8-8fbb-dec273ffc65a', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:05 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c8bbc4b6-9e85-4b21-a9b4-e051c291fa76 tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (599e9a41-abb4-446a-8959-9edc79ccd4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:05 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-c8bbc4b6-9e85-4b21-a9b4-e051c291fa76 tempest-VolumesActionsTest-1562044613 None] Volume volume-05c36bff-8006-49a8-8fbb-dec273ffc65a (05c36bff-8006-49a8-8fbb-dec273ffc65a): created successfully Nov 03 07:32:05 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c8bbc4b6-9e85-4b21-a9b4-e051c291fa76 tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (599e9a41-abb4-446a-8959-9edc79ccd4e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:05 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c8bbc4b6-9e85-4b21-a9b4-e051c291fa76 tempest-VolumesActionsTest-1562044613 None] Flow 'volume_create_manager' (15941b62-1fda-408a-a24d-3c9c1a32572c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:32:05 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-c8bbc4b6-9e85-4b21-a9b4-e051c291fa76 tempest-VolumesActionsTest-1562044613 None] Created volume successfully. Nov 03 07:32:06 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-6f21cab5-d09d-431c-ac00-98e7bc925257 tempest-VolumesActionsTest-629355249 None] Acquiring lock "cinder-05c36bff-8006-49a8-8fbb-dec273ffc65a-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:32:06 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-6f21cab5-d09d-431c-ac00-98e7bc925257 tempest-VolumesActionsTest-629355249 None] Lock "cinder-05c36bff-8006-49a8-8fbb-dec273ffc65a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:32:06 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-6f21cab5-d09d-431c-ac00-98e7bc925257 tempest-VolumesActionsTest-629355249 None] Acquiring lock "cinder-quobyte-05c36bff-8006-49a8-8fbb-dec273ffc65a" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:32:06 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-6f21cab5-d09d-431c-ac00-98e7bc925257 tempest-VolumesActionsTest-629355249 None] Lock "cinder-quobyte-05c36bff-8006-49a8-8fbb-dec273ffc65a" acquired by "delete_volume" :: waited 0.044s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:32:06 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[6539fe1e-301d-46da-9431-b114a1d74cfe]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:32:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6f21cab5-d09d-431c-ac00-98e7bc925257 tempest-VolumesActionsTest-629355249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-05c36bff-8006-49a8-8fbb-dec273ffc65a {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:06 devstack sudo[92654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-05c36bff-8006-49a8-8fbb-dec273ffc65a Nov 03 07:32:06 devstack sudo[92654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:07 devstack sudo[92654]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6f21cab5-d09d-431c-ac00-98e7bc925257 tempest-VolumesActionsTest-629355249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-05c36bff-8006-49a8-8fbb-dec273ffc65a" returned: 0 in 0.999s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6f21cab5-d09d-431c-ac00-98e7bc925257 tempest-VolumesActionsTest-629355249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-05c36bff-8006-49a8-8fbb-dec273ffc65a {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:07 devstack sudo[92663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-05c36bff-8006-49a8-8fbb-dec273ffc65a Nov 03 07:32:07 devstack sudo[92663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:08 devstack sudo[92663]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6f21cab5-d09d-431c-ac00-98e7bc925257 tempest-VolumesActionsTest-629355249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-05c36bff-8006-49a8-8fbb-dec273ffc65a" returned: 0 in 0.747s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:08 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-6f21cab5-d09d-431c-ac00-98e7bc925257 tempest-VolumesActionsTest-629355249 None] Lock "cinder-quobyte-05c36bff-8006-49a8-8fbb-dec273ffc65a" released by "delete_volume" :: held 1.862s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:08 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-6f21cab5-d09d-431c-ac00-98e7bc925257 tempest-VolumesActionsTest-629355249 None] Created reservations ['c2d19a96-3dea-47d0-bf3e-facee9bfa2f2', '87da30ab-102b-445c-b7ed-8b6b4cdbe749', '5a813d3d-37a1-4214-bf91-dde60c87dddd', '94f722a4-0772-4235-a3a7-953082d3388c'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:32:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-6f21cab5-d09d-431c-ac00-98e7bc925257 tempest-VolumesActionsTest-629355249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-6f21cab5-d09d-431c-ac00-98e7bc925257 tempest-VolumesActionsTest-629355249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:08 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-6f21cab5-d09d-431c-ac00-98e7bc925257 tempest-VolumesActionsTest-629355249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:32:08 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-6f21cab5-d09d-431c-ac00-98e7bc925257 tempest-VolumesActionsTest-629355249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:32:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-6f21cab5-d09d-431c-ac00-98e7bc925257 tempest-VolumesActionsTest-629355249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6f21cab5-d09d-431c-ac00-98e7bc925257 tempest-VolumesActionsTest-629355249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:08 devstack sudo[92666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:32:08 devstack sudo[92666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:09 devstack sudo[92666]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6f21cab5-d09d-431c-ac00-98e7bc925257 tempest-VolumesActionsTest-629355249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.755s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:09 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-6f21cab5-d09d-431c-ac00-98e7bc925257 tempest-VolumesActionsTest-629355249 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:32:09 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-6f21cab5-d09d-431c-ac00-98e7bc925257 tempest-VolumesActionsTest-629355249 None] Deleted volume successfully. Nov 03 07:32:09 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-6f21cab5-d09d-431c-ac00-98e7bc925257 tempest-VolumesActionsTest-629355249 None] Lock "cinder-05c36bff-8006-49a8-8fbb-dec273ffc65a-delete_volume" released by "delete_volume" :: held 3.034s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:10 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-8933fd98-dece-419a-b77d-a6ee2d8a091b tempest-VolumesActionsTest-1562044613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:32:10 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-8933fd98-dece-419a-b77d-a6ee2d8a091b tempest-VolumesActionsTest-1562044613 None] Flow 'volume_create_manager' (c26f9a0e-da11-4fbf-9e23-52ccfb97a982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:32:10 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-8933fd98-dece-419a-b77d-a6ee2d8a091b tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cb15aea-9dcf-41ae-a5c2-9abea7bd4096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:10 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-8933fd98-dece-419a-b77d-a6ee2d8a091b tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cb15aea-9dcf-41ae-a5c2-9abea7bd4096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:32:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1736405383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e111508e-a22b-4aea-90d8-be35cb4e4946,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33fdd7b0bfb943bd87e5ddcdbd730b5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:32:10Z,use_quota=True,user_id='a96d47c1521a4560be32f33768324e83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:10 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-8933fd98-dece-419a-b77d-a6ee2d8a091b tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8c26587-91f5-4440-aa5c-c7a1ab1c9e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:10 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-8933fd98-dece-419a-b77d-a6ee2d8a091b tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8c26587-91f5-4440-aa5c-c7a1ab1c9e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:10 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-8933fd98-dece-419a-b77d-a6ee2d8a091b tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b82933e-b657-4ffb-8f59-3f75477fa691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:10 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-8933fd98-dece-419a-b77d-a6ee2d8a091b tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b82933e-b657-4ffb-8f59-3f75477fa691) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e111508e-a22b-4aea-90d8-be35cb4e4946', 'volume_name': 'volume-e111508e-a22b-4aea-90d8-be35cb4e4946', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:10 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-8933fd98-dece-419a-b77d-a6ee2d8a091b tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f95cd46-fcea-4566-83f1-2ba8d0f5ae43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:10 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-8933fd98-dece-419a-b77d-a6ee2d8a091b tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f95cd46-fcea-4566-83f1-2ba8d0f5ae43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:10 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-8933fd98-dece-419a-b77d-a6ee2d8a091b tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bceb733-bb67-4648-8409-8a367e395143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:10 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-8933fd98-dece-419a-b77d-a6ee2d8a091b tempest-VolumesActionsTest-1562044613 None] Volume e111508e-a22b-4aea-90d8-be35cb4e4946: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e111508e-a22b-4aea-90d8-be35cb4e4946', 'volume_size': 1} Nov 03 07:32:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-8933fd98-dece-419a-b77d-a6ee2d8a091b tempest-VolumesActionsTest-1562044613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-8933fd98-dece-419a-b77d-a6ee2d8a091b tempest-VolumesActionsTest-1562044613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:10 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-8933fd98-dece-419a-b77d-a6ee2d8a091b tempest-VolumesActionsTest-1562044613 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:32:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1736405383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e111508e-a22b-4aea-90d8-be35cb4e4946,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33fdd7b0bfb943bd87e5ddcdbd730b5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:32:10Z,use_quota=True,user_id='a96d47c1521a4560be32f33768324e83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:32:10 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-8933fd98-dece-419a-b77d-a6ee2d8a091b tempest-VolumesActionsTest-1562044613 None] Creating volume e111508e-a22b-4aea-90d8-be35cb4e4946 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:32:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-8933fd98-dece-419a-b77d-a6ee2d8a091b tempest-VolumesActionsTest-1562044613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-8933fd98-dece-419a-b77d-a6ee2d8a091b tempest-VolumesActionsTest-1562044613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:10 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-8933fd98-dece-419a-b77d-a6ee2d8a091b tempest-VolumesActionsTest-1562044613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:32:10 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-8933fd98-dece-419a-b77d-a6ee2d8a091b tempest-VolumesActionsTest-1562044613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:32:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-8933fd98-dece-419a-b77d-a6ee2d8a091b tempest-VolumesActionsTest-1562044613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:10 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-8933fd98-dece-419a-b77d-a6ee2d8a091b tempest-VolumesActionsTest-1562044613 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:32:10 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-8933fd98-dece-419a-b77d-a6ee2d8a091b tempest-VolumesActionsTest-1562044613 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:32:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8933fd98-dece-419a-b77d-a6ee2d8a091b tempest-VolumesActionsTest-1562044613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e111508e-a22b-4aea-90d8-be35cb4e4946 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:10 devstack sudo[92671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e111508e-a22b-4aea-90d8-be35cb4e4946 1073741824 Nov 03 07:32:10 devstack sudo[92671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:11 devstack sudo[92671]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8933fd98-dece-419a-b77d-a6ee2d8a091b tempest-VolumesActionsTest-1562044613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e111508e-a22b-4aea-90d8-be35cb4e4946 1073741824" returned: 0 in 0.924s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8933fd98-dece-419a-b77d-a6ee2d8a091b tempest-VolumesActionsTest-1562044613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e111508e-a22b-4aea-90d8-be35cb4e4946 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:11 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-305d11b4-c73d-414c-9664-dfea8619dd5a tempest-VolumesCloneNegativeTest-460980793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:32:11 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-305d11b4-c73d-414c-9664-dfea8619dd5a tempest-VolumesCloneNegativeTest-460980793 None] Flow 'volume_create_manager' (7ed32d12-a384-4018-8956-eb85938a4e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:32:11 devstack sudo[92716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e111508e-a22b-4aea-90d8-be35cb4e4946 Nov 03 07:32:11 devstack sudo[92716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:11 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-305d11b4-c73d-414c-9664-dfea8619dd5a tempest-VolumesCloneNegativeTest-460980793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff912506-4e5f-47f8-b646-e1a6f9ec846a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:11 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-305d11b4-c73d-414c-9664-dfea8619dd5a tempest-VolumesCloneNegativeTest-460980793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff912506-4e5f-47f8-b646-e1a6f9ec846a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:32:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-663588004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=453a8fc1-ca8b-427b-8ff2-93239bb10eb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e46390f063d4e6981236abfff223db9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:32:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:32:12Z,use_quota=True,user_id='a5af694984394f628f47c4642c7472a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:11 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-305d11b4-c73d-414c-9664-dfea8619dd5a tempest-VolumesCloneNegativeTest-460980793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c11be05-5fb4-4083-8b81-58875b8d829a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:11 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-305d11b4-c73d-414c-9664-dfea8619dd5a tempest-VolumesCloneNegativeTest-460980793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c11be05-5fb4-4083-8b81-58875b8d829a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:11 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-305d11b4-c73d-414c-9664-dfea8619dd5a tempest-VolumesCloneNegativeTest-460980793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f16ee4e-52ee-48f4-a873-5e7ed1a1d838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:11 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-305d11b4-c73d-414c-9664-dfea8619dd5a tempest-VolumesCloneNegativeTest-460980793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f16ee4e-52ee-48f4-a873-5e7ed1a1d838) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '453a8fc1-ca8b-427b-8ff2-93239bb10eb7', 'volume_name': 'volume-453a8fc1-ca8b-427b-8ff2-93239bb10eb7', 'volume_size': 2}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:11 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-305d11b4-c73d-414c-9664-dfea8619dd5a tempest-VolumesCloneNegativeTest-460980793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe647fb1-e0ab-40a9-886f-cdba7e87a915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:11 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-305d11b4-c73d-414c-9664-dfea8619dd5a tempest-VolumesCloneNegativeTest-460980793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe647fb1-e0ab-40a9-886f-cdba7e87a915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:11 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-305d11b4-c73d-414c-9664-dfea8619dd5a tempest-VolumesCloneNegativeTest-460980793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fea4ca0-868c-4761-9565-2cfbe81b4f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:11 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-305d11b4-c73d-414c-9664-dfea8619dd5a tempest-VolumesCloneNegativeTest-460980793 None] Volume 453a8fc1-ca8b-427b-8ff2-93239bb10eb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-453a8fc1-ca8b-427b-8ff2-93239bb10eb7', 'volume_size': 2} Nov 03 07:32:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-305d11b4-c73d-414c-9664-dfea8619dd5a tempest-VolumesCloneNegativeTest-460980793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:12 devstack sudo[92716]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:12 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8933fd98-dece-419a-b77d-a6ee2d8a091b tempest-VolumesActionsTest-1562044613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e111508e-a22b-4aea-90d8-be35cb4e4946" returned: 0 in 0.458s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:12 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-8933fd98-dece-419a-b77d-a6ee2d8a091b tempest-VolumesActionsTest-1562044613 None] <== create_volume: return (1507ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:32:12 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-8933fd98-dece-419a-b77d-a6ee2d8a091b tempest-VolumesActionsTest-1562044613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.509s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:12 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-305d11b4-c73d-414c-9664-dfea8619dd5a tempest-VolumesCloneNegativeTest-460980793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.338s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:12 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-305d11b4-c73d-414c-9664-dfea8619dd5a tempest-VolumesCloneNegativeTest-460980793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:32:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-663588004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=453a8fc1-ca8b-427b-8ff2-93239bb10eb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e46390f063d4e6981236abfff223db9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:32:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:32:12Z,use_quota=True,user_id='a5af694984394f628f47c4642c7472a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:32:12 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-305d11b4-c73d-414c-9664-dfea8619dd5a tempest-VolumesCloneNegativeTest-460980793 None] Creating volume 453a8fc1-ca8b-427b-8ff2-93239bb10eb7 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:32:12 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-305d11b4-c73d-414c-9664-dfea8619dd5a tempest-VolumesCloneNegativeTest-460980793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:12 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-305d11b4-c73d-414c-9664-dfea8619dd5a tempest-VolumesCloneNegativeTest-460980793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:12 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-305d11b4-c73d-414c-9664-dfea8619dd5a tempest-VolumesCloneNegativeTest-460980793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:32:12 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-305d11b4-c73d-414c-9664-dfea8619dd5a tempest-VolumesCloneNegativeTest-460980793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:32:12 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-305d11b4-c73d-414c-9664-dfea8619dd5a tempest-VolumesCloneNegativeTest-460980793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:12 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-305d11b4-c73d-414c-9664-dfea8619dd5a tempest-VolumesCloneNegativeTest-460980793 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:32:12 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-305d11b4-c73d-414c-9664-dfea8619dd5a tempest-VolumesCloneNegativeTest-460980793 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:32:12 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-305d11b4-c73d-414c-9664-dfea8619dd5a tempest-VolumesCloneNegativeTest-460980793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-453a8fc1-ca8b-427b-8ff2-93239bb10eb7 2147483648 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:12 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-8933fd98-dece-419a-b77d-a6ee2d8a091b tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bceb733-bb67-4648-8409-8a367e395143) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e111508e-a22b-4aea-90d8-be35cb4e4946', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:12 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-8933fd98-dece-419a-b77d-a6ee2d8a091b tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78f88c47-edc5-4b23-b06a-40a456ae4b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:12 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-8933fd98-dece-419a-b77d-a6ee2d8a091b tempest-VolumesActionsTest-1562044613 None] Volume volume-e111508e-a22b-4aea-90d8-be35cb4e4946 (e111508e-a22b-4aea-90d8-be35cb4e4946): created successfully Nov 03 07:32:12 devstack sudo[92721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-453a8fc1-ca8b-427b-8ff2-93239bb10eb7 2147483648 Nov 03 07:32:12 devstack sudo[92721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:12 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-8933fd98-dece-419a-b77d-a6ee2d8a091b tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78f88c47-edc5-4b23-b06a-40a456ae4b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:12 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-8933fd98-dece-419a-b77d-a6ee2d8a091b tempest-VolumesActionsTest-1562044613 None] Flow 'volume_create_manager' (c26f9a0e-da11-4fbf-9e23-52ccfb97a982) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:32:12 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-8933fd98-dece-419a-b77d-a6ee2d8a091b tempest-VolumesActionsTest-1562044613 None] Created volume successfully. Nov 03 07:32:12 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3751a7f-4fa8-415c-bfc8-beb466956c74 tempest-AttachVolumeTestJSON-1835319745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:32:12 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d3751a7f-4fa8-415c-bfc8-beb466956c74 tempest-AttachVolumeTestJSON-1835319745 None] Flow 'volume_create_manager' (34d1758d-b9ef-424f-8d6e-6483506540e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:32:12 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d3751a7f-4fa8-415c-bfc8-beb466956c74 tempest-AttachVolumeTestJSON-1835319745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (670b6750-bdba-49aa-9d06-ba45aa20ae2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:12 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d3751a7f-4fa8-415c-bfc8-beb466956c74 tempest-AttachVolumeTestJSON-1835319745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (670b6750-bdba-49aa-9d06-ba45aa20ae2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:32:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1140020214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f198c03-e6e8-48db-ae39-c5ce20e9c605,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='015dfecb699d4b85825cce29cc4c1659',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:32:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:32:13Z,use_quota=True,user_id='14206b5c8c474d928fd7142bd4266779',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:12 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d3751a7f-4fa8-415c-bfc8-beb466956c74 tempest-AttachVolumeTestJSON-1835319745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ba37d8d-8877-41f4-a6ca-40c116110ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:12 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d3751a7f-4fa8-415c-bfc8-beb466956c74 tempest-AttachVolumeTestJSON-1835319745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ba37d8d-8877-41f4-a6ca-40c116110ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:12 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d3751a7f-4fa8-415c-bfc8-beb466956c74 tempest-AttachVolumeTestJSON-1835319745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abe1d1ef-2fae-4d4b-be87-f4c17983a59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:12 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d3751a7f-4fa8-415c-bfc8-beb466956c74 tempest-AttachVolumeTestJSON-1835319745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abe1d1ef-2fae-4d4b-be87-f4c17983a59f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f198c03-e6e8-48db-ae39-c5ce20e9c605', 'volume_name': 'volume-2f198c03-e6e8-48db-ae39-c5ce20e9c605', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:12 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d3751a7f-4fa8-415c-bfc8-beb466956c74 tempest-AttachVolumeTestJSON-1835319745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dc1cd50-1009-4a57-b4ac-77ce1a00b09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:12 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d3751a7f-4fa8-415c-bfc8-beb466956c74 tempest-AttachVolumeTestJSON-1835319745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dc1cd50-1009-4a57-b4ac-77ce1a00b09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:12 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d3751a7f-4fa8-415c-bfc8-beb466956c74 tempest-AttachVolumeTestJSON-1835319745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcb660df-a306-4c2a-a07f-3404d8f11d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:12 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-d3751a7f-4fa8-415c-bfc8-beb466956c74 tempest-AttachVolumeTestJSON-1835319745 None] Volume 2f198c03-e6e8-48db-ae39-c5ce20e9c605: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f198c03-e6e8-48db-ae39-c5ce20e9c605', 'volume_size': 1} Nov 03 07:32:12 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-d3751a7f-4fa8-415c-bfc8-beb466956c74 tempest-AttachVolumeTestJSON-1835319745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:12 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-1e1835ee-3293-4dcb-9a2f-49200752d50b tempest-VolumesActionsTest-629355249 None] Acquiring lock "cinder-e111508e-a22b-4aea-90d8-be35cb4e4946-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:32:12 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-1e1835ee-3293-4dcb-9a2f-49200752d50b tempest-VolumesActionsTest-629355249 None] Lock "cinder-e111508e-a22b-4aea-90d8-be35cb4e4946-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:32:13 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-1e1835ee-3293-4dcb-9a2f-49200752d50b tempest-VolumesActionsTest-629355249 None] Acquiring lock "cinder-quobyte-e111508e-a22b-4aea-90d8-be35cb4e4946" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:32:13 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-1e1835ee-3293-4dcb-9a2f-49200752d50b tempest-VolumesActionsTest-629355249 None] Lock "cinder-quobyte-e111508e-a22b-4aea-90d8-be35cb4e4946" acquired by "delete_volume" :: waited 0.020s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:32:13 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[66fdcff5-27e9-4143-ba79-f5beb02f135b]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:32:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1e1835ee-3293-4dcb-9a2f-49200752d50b tempest-VolumesActionsTest-629355249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e111508e-a22b-4aea-90d8-be35cb4e4946 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:13 devstack sudo[92727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e111508e-a22b-4aea-90d8-be35cb4e4946 Nov 03 07:32:13 devstack sudo[92727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:13 devstack sudo[92721]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-305d11b4-c73d-414c-9664-dfea8619dd5a tempest-VolumesCloneNegativeTest-460980793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-453a8fc1-ca8b-427b-8ff2-93239bb10eb7 2147483648" returned: 0 in 1.257s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-305d11b4-c73d-414c-9664-dfea8619dd5a tempest-VolumesCloneNegativeTest-460980793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-453a8fc1-ca8b-427b-8ff2-93239bb10eb7 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:13 devstack sudo[92730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-453a8fc1-ca8b-427b-8ff2-93239bb10eb7 Nov 03 07:32:13 devstack sudo[92730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:13 devstack sudo[92727]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1e1835ee-3293-4dcb-9a2f-49200752d50b tempest-VolumesActionsTest-629355249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e111508e-a22b-4aea-90d8-be35cb4e4946" returned: 0 in 0.581s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1e1835ee-3293-4dcb-9a2f-49200752d50b tempest-VolumesActionsTest-629355249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e111508e-a22b-4aea-90d8-be35cb4e4946 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:13 devstack sudo[92736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e111508e-a22b-4aea-90d8-be35cb4e4946 Nov 03 07:32:13 devstack sudo[92736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:13 devstack sudo[92730]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-305d11b4-c73d-414c-9664-dfea8619dd5a tempest-VolumesCloneNegativeTest-460980793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-453a8fc1-ca8b-427b-8ff2-93239bb10eb7" returned: 0 in 0.405s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:13 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-305d11b4-c73d-414c-9664-dfea8619dd5a tempest-VolumesCloneNegativeTest-460980793 None] <== create_volume: return (1757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:32:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-305d11b4-c73d-414c-9664-dfea8619dd5a tempest-VolumesCloneNegativeTest-460980793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.762s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-d3751a7f-4fa8-415c-bfc8-beb466956c74 tempest-AttachVolumeTestJSON-1835319745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.976s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:13 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-d3751a7f-4fa8-415c-bfc8-beb466956c74 tempest-AttachVolumeTestJSON-1835319745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:32:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1140020214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f198c03-e6e8-48db-ae39-c5ce20e9c605,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='015dfecb699d4b85825cce29cc4c1659',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:32:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:32:13Z,use_quota=True,user_id='14206b5c8c474d928fd7142bd4266779',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:32:13 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-d3751a7f-4fa8-415c-bfc8-beb466956c74 tempest-AttachVolumeTestJSON-1835319745 None] Creating volume 2f198c03-e6e8-48db-ae39-c5ce20e9c605 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:32:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-d3751a7f-4fa8-415c-bfc8-beb466956c74 tempest-AttachVolumeTestJSON-1835319745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-d3751a7f-4fa8-415c-bfc8-beb466956c74 tempest-AttachVolumeTestJSON-1835319745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:13 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-d3751a7f-4fa8-415c-bfc8-beb466956c74 tempest-AttachVolumeTestJSON-1835319745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:32:13 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-d3751a7f-4fa8-415c-bfc8-beb466956c74 tempest-AttachVolumeTestJSON-1835319745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:32:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-d3751a7f-4fa8-415c-bfc8-beb466956c74 tempest-AttachVolumeTestJSON-1835319745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:13 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-d3751a7f-4fa8-415c-bfc8-beb466956c74 tempest-AttachVolumeTestJSON-1835319745 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:32:13 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-d3751a7f-4fa8-415c-bfc8-beb466956c74 tempest-AttachVolumeTestJSON-1835319745 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:32:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d3751a7f-4fa8-415c-bfc8-beb466956c74 tempest-AttachVolumeTestJSON-1835319745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2f198c03-e6e8-48db-ae39-c5ce20e9c605 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:13 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-305d11b4-c73d-414c-9664-dfea8619dd5a tempest-VolumesCloneNegativeTest-460980793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fea4ca0-868c-4761-9565-2cfbe81b4f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-453a8fc1-ca8b-427b-8ff2-93239bb10eb7', 'volume_size': 2}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:13 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-305d11b4-c73d-414c-9664-dfea8619dd5a tempest-VolumesCloneNegativeTest-460980793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (094776fe-ce06-4f2b-aa0b-8d1f0fd7b719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:13 devstack sudo[92739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2f198c03-e6e8-48db-ae39-c5ce20e9c605 1073741824 Nov 03 07:32:13 devstack sudo[92739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:13 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-305d11b4-c73d-414c-9664-dfea8619dd5a tempest-VolumesCloneNegativeTest-460980793 None] Volume volume-453a8fc1-ca8b-427b-8ff2-93239bb10eb7 (453a8fc1-ca8b-427b-8ff2-93239bb10eb7): created successfully Nov 03 07:32:14 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-305d11b4-c73d-414c-9664-dfea8619dd5a tempest-VolumesCloneNegativeTest-460980793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (094776fe-ce06-4f2b-aa0b-8d1f0fd7b719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:14 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-305d11b4-c73d-414c-9664-dfea8619dd5a tempest-VolumesCloneNegativeTest-460980793 None] Flow 'volume_create_manager' (7ed32d12-a384-4018-8956-eb85938a4e17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:32:14 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-305d11b4-c73d-414c-9664-dfea8619dd5a tempest-VolumesCloneNegativeTest-460980793 None] Created volume successfully. Nov 03 07:32:14 devstack sudo[92736]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:14 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1e1835ee-3293-4dcb-9a2f-49200752d50b tempest-VolumesActionsTest-629355249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e111508e-a22b-4aea-90d8-be35cb4e4946" returned: 0 in 0.527s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:14 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-1e1835ee-3293-4dcb-9a2f-49200752d50b tempest-VolumesActionsTest-629355249 None] Lock "cinder-quobyte-e111508e-a22b-4aea-90d8-be35cb4e4946" released by "delete_volume" :: held 1.181s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:14 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-1e1835ee-3293-4dcb-9a2f-49200752d50b tempest-VolumesActionsTest-629355249 None] Created reservations ['64d7d365-eb40-4290-8e6a-0acd1534d884', '43c16d0f-725d-4079-88a4-8fde8c1403b9', '34396fe6-0001-45ec-9760-8bf7aee9ac9e', '9674aae2-329e-4df1-bfa3-71e9c41c2122'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:32:14 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-1e1835ee-3293-4dcb-9a2f-49200752d50b tempest-VolumesActionsTest-629355249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:14 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-1e1835ee-3293-4dcb-9a2f-49200752d50b tempest-VolumesActionsTest-629355249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:14 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-1e1835ee-3293-4dcb-9a2f-49200752d50b tempest-VolumesActionsTest-629355249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:32:14 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-1e1835ee-3293-4dcb-9a2f-49200752d50b tempest-VolumesActionsTest-629355249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:32:14 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-1e1835ee-3293-4dcb-9a2f-49200752d50b tempest-VolumesActionsTest-629355249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:14 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1e1835ee-3293-4dcb-9a2f-49200752d50b tempest-VolumesActionsTest-629355249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:14 devstack sudo[92745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:32:14 devstack sudo[92745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:14 devstack sudo[92739]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:14 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d3751a7f-4fa8-415c-bfc8-beb466956c74 tempest-AttachVolumeTestJSON-1835319745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2f198c03-e6e8-48db-ae39-c5ce20e9c605 1073741824" returned: 0 in 0.826s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:14 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d3751a7f-4fa8-415c-bfc8-beb466956c74 tempest-AttachVolumeTestJSON-1835319745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2f198c03-e6e8-48db-ae39-c5ce20e9c605 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:14 devstack sudo[92748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2f198c03-e6e8-48db-ae39-c5ce20e9c605 Nov 03 07:32:14 devstack sudo[92748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:14 devstack sudo[92745]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:14 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1e1835ee-3293-4dcb-9a2f-49200752d50b tempest-VolumesActionsTest-629355249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.478s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:14 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-1e1835ee-3293-4dcb-9a2f-49200752d50b tempest-VolumesActionsTest-629355249 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:32:15 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-1e1835ee-3293-4dcb-9a2f-49200752d50b tempest-VolumesActionsTest-629355249 None] Deleted volume successfully. Nov 03 07:32:15 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-1e1835ee-3293-4dcb-9a2f-49200752d50b tempest-VolumesActionsTest-629355249 None] Lock "cinder-e111508e-a22b-4aea-90d8-be35cb4e4946-delete_volume" released by "delete_volume" :: held 2.097s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:15 devstack sudo[92748]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d3751a7f-4fa8-415c-bfc8-beb466956c74 tempest-AttachVolumeTestJSON-1835319745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2f198c03-e6e8-48db-ae39-c5ce20e9c605" returned: 0 in 0.444s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:15 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-d3751a7f-4fa8-415c-bfc8-beb466956c74 tempest-AttachVolumeTestJSON-1835319745 None] <== create_volume: return (1339ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:32:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-d3751a7f-4fa8-415c-bfc8-beb466956c74 tempest-AttachVolumeTestJSON-1835319745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.348s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:15 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d3751a7f-4fa8-415c-bfc8-beb466956c74 tempest-AttachVolumeTestJSON-1835319745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcb660df-a306-4c2a-a07f-3404d8f11d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f198c03-e6e8-48db-ae39-c5ce20e9c605', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:15 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d3751a7f-4fa8-415c-bfc8-beb466956c74 tempest-AttachVolumeTestJSON-1835319745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (992da122-b880-4b5e-8d79-3c67324abb08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:15 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-d3751a7f-4fa8-415c-bfc8-beb466956c74 tempest-AttachVolumeTestJSON-1835319745 None] Volume volume-2f198c03-e6e8-48db-ae39-c5ce20e9c605 (2f198c03-e6e8-48db-ae39-c5ce20e9c605): created successfully Nov 03 07:32:15 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d3751a7f-4fa8-415c-bfc8-beb466956c74 tempest-AttachVolumeTestJSON-1835319745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (992da122-b880-4b5e-8d79-3c67324abb08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:15 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d3751a7f-4fa8-415c-bfc8-beb466956c74 tempest-AttachVolumeTestJSON-1835319745 None] Flow 'volume_create_manager' (34d1758d-b9ef-424f-8d6e-6483506540e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:32:15 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-d3751a7f-4fa8-415c-bfc8-beb466956c74 tempest-AttachVolumeTestJSON-1835319745 None] Created volume successfully. Nov 03 07:32:15 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-b43fc86e-b4bb-4917-a418-510c46d1b4cb tempest-VolumesCloneNegativeTest-460980793 None] Acquiring lock "cinder-453a8fc1-ca8b-427b-8ff2-93239bb10eb7-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:32:15 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-b43fc86e-b4bb-4917-a418-510c46d1b4cb tempest-VolumesCloneNegativeTest-460980793 None] Lock "cinder-453a8fc1-ca8b-427b-8ff2-93239bb10eb7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:32:15 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-b43fc86e-b4bb-4917-a418-510c46d1b4cb tempest-VolumesCloneNegativeTest-460980793 None] Acquiring lock "cinder-quobyte-453a8fc1-ca8b-427b-8ff2-93239bb10eb7" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:32:15 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-b43fc86e-b4bb-4917-a418-510c46d1b4cb tempest-VolumesCloneNegativeTest-460980793 None] Lock "cinder-quobyte-453a8fc1-ca8b-427b-8ff2-93239bb10eb7" acquired by "delete_volume" :: waited 0.017s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:32:15 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[b773b541-0e43-458f-bfe0-2bcaa6e32ca0]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:32:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b43fc86e-b4bb-4917-a418-510c46d1b4cb tempest-VolumesCloneNegativeTest-460980793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-453a8fc1-ca8b-427b-8ff2-93239bb10eb7 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:15 devstack sudo[92761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-453a8fc1-ca8b-427b-8ff2-93239bb10eb7 Nov 03 07:32:15 devstack sudo[92761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:15 devstack cinder-volume[86875]: INFO cinder.volume.manager [req-7c5a66df-7a84-4f79-bca2-83bf1d74c4ef req-ed038ff8-24c5-426c-8fa5-de2d87f55f5a tempest-ServerActionsTestOtherA-1944466382 None] Terminate volume connection completed successfully. Nov 03 07:32:15 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-7c5a66df-7a84-4f79-bca2-83bf1d74c4ef req-ed038ff8-24c5-426c-8fa5-de2d87f55f5a tempest-ServerActionsTestOtherA-1944466382 None] Deleting attachment c2413977-b4db-4aca-87fc-3523d6cdc72e. {{(pid=86875) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:32:16 devstack sudo[92761]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b43fc86e-b4bb-4917-a418-510c46d1b4cb tempest-VolumesCloneNegativeTest-460980793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-453a8fc1-ca8b-427b-8ff2-93239bb10eb7" returned: 0 in 0.908s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b43fc86e-b4bb-4917-a418-510c46d1b4cb tempest-VolumesCloneNegativeTest-460980793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-453a8fc1-ca8b-427b-8ff2-93239bb10eb7 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:16 devstack sudo[92814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-453a8fc1-ca8b-427b-8ff2-93239bb10eb7 Nov 03 07:32:16 devstack sudo[92814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:16 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b922403-4a43-4906-bdae-f6a09507c83a tempest-VolumesActionsTest-1562044613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:32:16 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3b922403-4a43-4906-bdae-f6a09507c83a tempest-VolumesActionsTest-1562044613 None] Flow 'volume_create_manager' (ddfb8b90-fafb-4ddb-8e49-ce5f0a721961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:32:16 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3b922403-4a43-4906-bdae-f6a09507c83a tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9358b570-944a-47f3-9990-19922d888080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:16 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3b922403-4a43-4906-bdae-f6a09507c83a tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9358b570-944a-47f3-9990-19922d888080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:32:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2003800565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d0709b1-7d82-4014-b8ce-ba9fcf167f6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33fdd7b0bfb943bd87e5ddcdbd730b5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:32:16Z,use_quota=True,user_id='a96d47c1521a4560be32f33768324e83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:16 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3b922403-4a43-4906-bdae-f6a09507c83a tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22410bce-ef8b-488a-9502-e7581b09a25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:16 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3b922403-4a43-4906-bdae-f6a09507c83a tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22410bce-ef8b-488a-9502-e7581b09a25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:16 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3b922403-4a43-4906-bdae-f6a09507c83a tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f38de5a-de5d-4941-85e0-17f1120e8127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:16 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3b922403-4a43-4906-bdae-f6a09507c83a tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f38de5a-de5d-4941-85e0-17f1120e8127) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d0709b1-7d82-4014-b8ce-ba9fcf167f6f', 'volume_name': 'volume-1d0709b1-7d82-4014-b8ce-ba9fcf167f6f', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:16 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3b922403-4a43-4906-bdae-f6a09507c83a tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e083d75-f027-4abb-ae3a-a4ffc3bab92b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:16 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3b922403-4a43-4906-bdae-f6a09507c83a tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e083d75-f027-4abb-ae3a-a4ffc3bab92b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:16 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3b922403-4a43-4906-bdae-f6a09507c83a tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97a2f4ef-3460-4b21-9340-1f83357ffc26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:16 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-3b922403-4a43-4906-bdae-f6a09507c83a tempest-VolumesActionsTest-1562044613 None] Volume 1d0709b1-7d82-4014-b8ce-ba9fcf167f6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d0709b1-7d82-4014-b8ce-ba9fcf167f6f', 'volume_size': 1} Nov 03 07:32:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3b922403-4a43-4906-bdae-f6a09507c83a tempest-VolumesActionsTest-1562044613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3b922403-4a43-4906-bdae-f6a09507c83a tempest-VolumesActionsTest-1562044613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:16 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-3b922403-4a43-4906-bdae-f6a09507c83a tempest-VolumesActionsTest-1562044613 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:32:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2003800565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d0709b1-7d82-4014-b8ce-ba9fcf167f6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33fdd7b0bfb943bd87e5ddcdbd730b5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:32:16Z,use_quota=True,user_id='a96d47c1521a4560be32f33768324e83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:32:16 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-3b922403-4a43-4906-bdae-f6a09507c83a tempest-VolumesActionsTest-1562044613 None] Creating volume 1d0709b1-7d82-4014-b8ce-ba9fcf167f6f {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:32:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3b922403-4a43-4906-bdae-f6a09507c83a tempest-VolumesActionsTest-1562044613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3b922403-4a43-4906-bdae-f6a09507c83a tempest-VolumesActionsTest-1562044613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:16 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-3b922403-4a43-4906-bdae-f6a09507c83a tempest-VolumesActionsTest-1562044613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:32:16 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-3b922403-4a43-4906-bdae-f6a09507c83a tempest-VolumesActionsTest-1562044613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:32:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3b922403-4a43-4906-bdae-f6a09507c83a tempest-VolumesActionsTest-1562044613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:16 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-3b922403-4a43-4906-bdae-f6a09507c83a tempest-VolumesActionsTest-1562044613 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:32:16 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-3b922403-4a43-4906-bdae-f6a09507c83a tempest-VolumesActionsTest-1562044613 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:32:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3b922403-4a43-4906-bdae-f6a09507c83a tempest-VolumesActionsTest-1562044613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1d0709b1-7d82-4014-b8ce-ba9fcf167f6f 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:16 devstack sudo[92818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1d0709b1-7d82-4014-b8ce-ba9fcf167f6f 1073741824 Nov 03 07:32:16 devstack sudo[92818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:16 devstack sudo[92814]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b43fc86e-b4bb-4917-a418-510c46d1b4cb tempest-VolumesCloneNegativeTest-460980793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-453a8fc1-ca8b-427b-8ff2-93239bb10eb7" returned: 0 in 0.375s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:16 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-b43fc86e-b4bb-4917-a418-510c46d1b4cb tempest-VolumesCloneNegativeTest-460980793 None] Lock "cinder-quobyte-453a8fc1-ca8b-427b-8ff2-93239bb10eb7" released by "delete_volume" :: held 1.391s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:16 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-b43fc86e-b4bb-4917-a418-510c46d1b4cb tempest-VolumesCloneNegativeTest-460980793 None] Created reservations ['22e7c99b-cb3c-4688-8cb0-f978a9b2e207', 'fad3c314-f6e2-47de-8a64-95b8ac0a2c76', 'c973501d-be3a-47fc-9b2a-d0d2553d96ca', 'c81a7bff-7e17-407d-9497-350c164fff62'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:32:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b43fc86e-b4bb-4917-a418-510c46d1b4cb tempest-VolumesCloneNegativeTest-460980793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b43fc86e-b4bb-4917-a418-510c46d1b4cb tempest-VolumesCloneNegativeTest-460980793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:17 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b43fc86e-b4bb-4917-a418-510c46d1b4cb tempest-VolumesCloneNegativeTest-460980793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:32:17 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b43fc86e-b4bb-4917-a418-510c46d1b4cb tempest-VolumesCloneNegativeTest-460980793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:32:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b43fc86e-b4bb-4917-a418-510c46d1b4cb tempest-VolumesCloneNegativeTest-460980793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b43fc86e-b4bb-4917-a418-510c46d1b4cb tempest-VolumesCloneNegativeTest-460980793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:17 devstack sudo[92832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:32:17 devstack sudo[92832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-e8043029-5a4d-4cc5-a74c-0baeffe09fd7 req-27cbd680-256b-4161-9d27-46b2e18c5b29 tempest-AttachVolumeTestJSON-1835319745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:17 devstack sudo[92832]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b43fc86e-b4bb-4917-a418-510c46d1b4cb tempest-VolumesCloneNegativeTest-460980793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.333s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:17 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-b43fc86e-b4bb-4917-a418-510c46d1b4cb tempest-VolumesCloneNegativeTest-460980793 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:32:17 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-b43fc86e-b4bb-4917-a418-510c46d1b4cb tempest-VolumesCloneNegativeTest-460980793 None] Deleted volume successfully. Nov 03 07:32:17 devstack sudo[92818]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3b922403-4a43-4906-bdae-f6a09507c83a tempest-VolumesActionsTest-1562044613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1d0709b1-7d82-4014-b8ce-ba9fcf167f6f 1073741824" returned: 0 in 0.713s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:17 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-b43fc86e-b4bb-4917-a418-510c46d1b4cb tempest-VolumesCloneNegativeTest-460980793 None] Lock "cinder-453a8fc1-ca8b-427b-8ff2-93239bb10eb7-delete_volume" released by "delete_volume" :: held 2.055s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3b922403-4a43-4906-bdae-f6a09507c83a tempest-VolumesActionsTest-1562044613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1d0709b1-7d82-4014-b8ce-ba9fcf167f6f {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:17 devstack sudo[92837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1d0709b1-7d82-4014-b8ce-ba9fcf167f6f Nov 03 07:32:17 devstack sudo[92837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:17 devstack sudo[92837]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3b922403-4a43-4906-bdae-f6a09507c83a tempest-VolumesActionsTest-1562044613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1d0709b1-7d82-4014-b8ce-ba9fcf167f6f" returned: 0 in 0.288s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:17 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-3b922403-4a43-4906-bdae-f6a09507c83a tempest-VolumesActionsTest-1562044613 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:32:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3b922403-4a43-4906-bdae-f6a09507c83a tempest-VolumesActionsTest-1562044613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-e8043029-5a4d-4cc5-a74c-0baeffe09fd7 req-27cbd680-256b-4161-9d27-46b2e18c5b29 tempest-AttachVolumeTestJSON-1835319745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.619s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-e8043029-5a4d-4cc5-a74c-0baeffe09fd7 req-27cbd680-256b-4161-9d27-46b2e18c5b29 tempest-AttachVolumeTestJSON-1835319745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:17 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3b922403-4a43-4906-bdae-f6a09507c83a tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97a2f4ef-3460-4b21-9340-1f83357ffc26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d0709b1-7d82-4014-b8ce-ba9fcf167f6f', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:17 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3b922403-4a43-4906-bdae-f6a09507c83a tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3939098-9ed2-4575-9fa2-3e91bad303f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:17 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-3b922403-4a43-4906-bdae-f6a09507c83a tempest-VolumesActionsTest-1562044613 None] Volume volume-1d0709b1-7d82-4014-b8ce-ba9fcf167f6f (1d0709b1-7d82-4014-b8ce-ba9fcf167f6f): created successfully Nov 03 07:32:17 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3b922403-4a43-4906-bdae-f6a09507c83a tempest-VolumesActionsTest-1562044613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3939098-9ed2-4575-9fa2-3e91bad303f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:17 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3b922403-4a43-4906-bdae-f6a09507c83a tempest-VolumesActionsTest-1562044613 None] Flow 'volume_create_manager' (ddfb8b90-fafb-4ddb-8e49-ce5f0a721961) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:32:17 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-3b922403-4a43-4906-bdae-f6a09507c83a tempest-VolumesActionsTest-1562044613 None] Created volume successfully. Nov 03 07:32:17 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-e8043029-5a4d-4cc5-a74c-0baeffe09fd7 req-27cbd680-256b-4161-9d27-46b2e18c5b29 tempest-AttachVolumeTestJSON-1835319745 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1', 'name': 'volume-2f198c03-e6e8-48db-ae39-c5ce20e9c605', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e76d407a-aa0f-4ba7-9663-a120effc86b6', 'enforce_multipath': True} {{(pid=86875) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:32:17 devstack cinder-volume[86875]: INFO cinder.volume.manager [req-e8043029-5a4d-4cc5-a74c-0baeffe09fd7 req-27cbd680-256b-4161-9d27-46b2e18c5b29 tempest-AttachVolumeTestJSON-1835319745 None] attachment_update completed successfully. Nov 03 07:32:18 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-7c5a66df-7a84-4f79-bca2-83bf1d74c4ef req-afd06e82-457b-401e-8afa-01ac017b7960 tempest-ServerActionsTestOtherA-1944466382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:18 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-7c5a66df-7a84-4f79-bca2-83bf1d74c4ef req-afd06e82-457b-401e-8afa-01ac017b7960 tempest-ServerActionsTestOtherA-1944466382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:18 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-7c5a66df-7a84-4f79-bca2-83bf1d74c4ef req-afd06e82-457b-401e-8afa-01ac017b7960 tempest-ServerActionsTestOtherA-1944466382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.055s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:18 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-7c5a66df-7a84-4f79-bca2-83bf1d74c4ef req-afd06e82-457b-401e-8afa-01ac017b7960 tempest-ServerActionsTestOtherA-1944466382 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1', 'name': 'volume-a6ce31ba-b408-4a95-8d8b-143709c51ec0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '049cc146-040a-4d3d-869c-ab9a69192bd2', 'enforce_multipath': True} {{(pid=86875) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:32:18 devstack cinder-volume[86875]: INFO cinder.volume.manager [req-7c5a66df-7a84-4f79-bca2-83bf1d74c4ef req-afd06e82-457b-401e-8afa-01ac017b7960 tempest-ServerActionsTestOtherA-1944466382 None] attachment_update completed successfully. Nov 03 07:32:19 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-35a42121-30d0-4e08-942c-d7b64ac43854 tempest-VolumesActionsTest-1562044613 None] Acquiring lock "cinder-1d0709b1-7d82-4014-b8ce-ba9fcf167f6f-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:32:19 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-35a42121-30d0-4e08-942c-d7b64ac43854 tempest-VolumesActionsTest-1562044613 None] Lock "cinder-1d0709b1-7d82-4014-b8ce-ba9fcf167f6f-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:32:19 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-35a42121-30d0-4e08-942c-d7b64ac43854 tempest-VolumesActionsTest-1562044613 None] Acquiring lock "cinder-quobyte-1d0709b1-7d82-4014-b8ce-ba9fcf167f6f" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:32:19 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-35a42121-30d0-4e08-942c-d7b64ac43854 tempest-VolumesActionsTest-1562044613 None] Lock "cinder-quobyte-1d0709b1-7d82-4014-b8ce-ba9fcf167f6f" acquired by "delete_volume" :: waited 0.031s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:32:20 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6189fee-9c32-4a89-9585-ffc13d2d78d4]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:32:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-35a42121-30d0-4e08-942c-d7b64ac43854 tempest-VolumesActionsTest-1562044613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1d0709b1-7d82-4014-b8ce-ba9fcf167f6f {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:20 devstack sudo[93290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1d0709b1-7d82-4014-b8ce-ba9fcf167f6f Nov 03 07:32:20 devstack sudo[93290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:20 devstack sudo[93290]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-35a42121-30d0-4e08-942c-d7b64ac43854 tempest-VolumesActionsTest-1562044613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1d0709b1-7d82-4014-b8ce-ba9fcf167f6f" returned: 0 in 0.619s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-35a42121-30d0-4e08-942c-d7b64ac43854 tempest-VolumesActionsTest-1562044613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1d0709b1-7d82-4014-b8ce-ba9fcf167f6f {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:20 devstack sudo[93305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1d0709b1-7d82-4014-b8ce-ba9fcf167f6f Nov 03 07:32:20 devstack sudo[93305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:21 devstack sudo[93305]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-35a42121-30d0-4e08-942c-d7b64ac43854 tempest-VolumesActionsTest-1562044613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1d0709b1-7d82-4014-b8ce-ba9fcf167f6f" returned: 0 in 0.438s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:21 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-35a42121-30d0-4e08-942c-d7b64ac43854 tempest-VolumesActionsTest-1562044613 None] Lock "cinder-quobyte-1d0709b1-7d82-4014-b8ce-ba9fcf167f6f" released by "delete_volume" :: held 1.155s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:21 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-35a42121-30d0-4e08-942c-d7b64ac43854 tempest-VolumesActionsTest-1562044613 None] Created reservations ['49e65416-3848-49ba-b4e4-c5e762df6428', 'b1fbc448-a9b2-4a2d-ae83-4a36cd74b192', 'c9b4b63e-a2df-43a4-b0c3-ba48aaddcf12', 'ba2219e4-c9b4-46d9-adc4-b7c676bd3631'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:32:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-35a42121-30d0-4e08-942c-d7b64ac43854 tempest-VolumesActionsTest-1562044613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-35a42121-30d0-4e08-942c-d7b64ac43854 tempest-VolumesActionsTest-1562044613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:21 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-35a42121-30d0-4e08-942c-d7b64ac43854 tempest-VolumesActionsTest-1562044613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:32:21 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-35a42121-30d0-4e08-942c-d7b64ac43854 tempest-VolumesActionsTest-1562044613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:32:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-35a42121-30d0-4e08-942c-d7b64ac43854 tempest-VolumesActionsTest-1562044613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-35a42121-30d0-4e08-942c-d7b64ac43854 tempest-VolumesActionsTest-1562044613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:21 devstack sudo[93308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:32:21 devstack sudo[93308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:21 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d2d36d1-0738-4b69-83b4-acf4f652bb02 tempest-AttachVolumeTestJSON-1835319745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:32:21 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7d2d36d1-0738-4b69-83b4-acf4f652bb02 tempest-AttachVolumeTestJSON-1835319745 None] Flow 'volume_create_manager' (45aae9af-563b-41a0-978b-504b363a1f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:32:21 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7d2d36d1-0738-4b69-83b4-acf4f652bb02 tempest-AttachVolumeTestJSON-1835319745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd030661-0cad-4cd1-9a5e-6af612afc8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:21 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7d2d36d1-0738-4b69-83b4-acf4f652bb02 tempest-AttachVolumeTestJSON-1835319745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd030661-0cad-4cd1-9a5e-6af612afc8c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1924522834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4282a1f2-abda-4443-8661-02bc45754db5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='015dfecb699d4b85825cce29cc4c1659',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:32:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:32:21Z,use_quota=True,user_id='14206b5c8c474d928fd7142bd4266779',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:21 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7d2d36d1-0738-4b69-83b4-acf4f652bb02 tempest-AttachVolumeTestJSON-1835319745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4535e4b5-8b45-4207-b770-0eca9fcf41a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:21 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7d2d36d1-0738-4b69-83b4-acf4f652bb02 tempest-AttachVolumeTestJSON-1835319745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4535e4b5-8b45-4207-b770-0eca9fcf41a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:21 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7d2d36d1-0738-4b69-83b4-acf4f652bb02 tempest-AttachVolumeTestJSON-1835319745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a73b10f2-ded4-4369-87c6-e6007fc4047a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:21 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7d2d36d1-0738-4b69-83b4-acf4f652bb02 tempest-AttachVolumeTestJSON-1835319745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a73b10f2-ded4-4369-87c6-e6007fc4047a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4282a1f2-abda-4443-8661-02bc45754db5', 'volume_name': 'volume-4282a1f2-abda-4443-8661-02bc45754db5', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:21 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7d2d36d1-0738-4b69-83b4-acf4f652bb02 tempest-AttachVolumeTestJSON-1835319745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbee333c-228d-48d2-8547-8c5e7e109f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:21 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7d2d36d1-0738-4b69-83b4-acf4f652bb02 tempest-AttachVolumeTestJSON-1835319745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbee333c-228d-48d2-8547-8c5e7e109f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:21 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7d2d36d1-0738-4b69-83b4-acf4f652bb02 tempest-AttachVolumeTestJSON-1835319745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05a94121-b7cd-4f2c-a35a-7bccebc789c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:21 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-7d2d36d1-0738-4b69-83b4-acf4f652bb02 tempest-AttachVolumeTestJSON-1835319745 None] Volume 4282a1f2-abda-4443-8661-02bc45754db5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4282a1f2-abda-4443-8661-02bc45754db5', 'volume_size': 1} Nov 03 07:32:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7d2d36d1-0738-4b69-83b4-acf4f652bb02 tempest-AttachVolumeTestJSON-1835319745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7d2d36d1-0738-4b69-83b4-acf4f652bb02 tempest-AttachVolumeTestJSON-1835319745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:21 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-7d2d36d1-0738-4b69-83b4-acf4f652bb02 tempest-AttachVolumeTestJSON-1835319745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1924522834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4282a1f2-abda-4443-8661-02bc45754db5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='015dfecb699d4b85825cce29cc4c1659',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:32:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:32:21Z,use_quota=True,user_id='14206b5c8c474d928fd7142bd4266779',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:32:21 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-7d2d36d1-0738-4b69-83b4-acf4f652bb02 tempest-AttachVolumeTestJSON-1835319745 None] Creating volume 4282a1f2-abda-4443-8661-02bc45754db5 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:32:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7d2d36d1-0738-4b69-83b4-acf4f652bb02 tempest-AttachVolumeTestJSON-1835319745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7d2d36d1-0738-4b69-83b4-acf4f652bb02 tempest-AttachVolumeTestJSON-1835319745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:21 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-7d2d36d1-0738-4b69-83b4-acf4f652bb02 tempest-AttachVolumeTestJSON-1835319745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:32:21 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-7d2d36d1-0738-4b69-83b4-acf4f652bb02 tempest-AttachVolumeTestJSON-1835319745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:32:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7d2d36d1-0738-4b69-83b4-acf4f652bb02 tempest-AttachVolumeTestJSON-1835319745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:21 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-7d2d36d1-0738-4b69-83b4-acf4f652bb02 tempest-AttachVolumeTestJSON-1835319745 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:32:21 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-7d2d36d1-0738-4b69-83b4-acf4f652bb02 tempest-AttachVolumeTestJSON-1835319745 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:32:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7d2d36d1-0738-4b69-83b4-acf4f652bb02 tempest-AttachVolumeTestJSON-1835319745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4282a1f2-abda-4443-8661-02bc45754db5 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:21 devstack sudo[93313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4282a1f2-abda-4443-8661-02bc45754db5 1073741824 Nov 03 07:32:21 devstack sudo[93313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:21 devstack sudo[93308]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-35a42121-30d0-4e08-942c-d7b64ac43854 tempest-VolumesActionsTest-1562044613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.495s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:21 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-35a42121-30d0-4e08-942c-d7b64ac43854 tempest-VolumesActionsTest-1562044613 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:32:21 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-35a42121-30d0-4e08-942c-d7b64ac43854 tempest-VolumesActionsTest-1562044613 None] Deleted volume successfully. Nov 03 07:32:22 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-35a42121-30d0-4e08-942c-d7b64ac43854 tempest-VolumesActionsTest-1562044613 None] Lock "cinder-1d0709b1-7d82-4014-b8ce-ba9fcf167f6f-delete_volume" released by "delete_volume" :: held 2.179s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:22 devstack sudo[93313]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7d2d36d1-0738-4b69-83b4-acf4f652bb02 tempest-AttachVolumeTestJSON-1835319745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4282a1f2-abda-4443-8661-02bc45754db5 1073741824" returned: 0 in 1.055s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7d2d36d1-0738-4b69-83b4-acf4f652bb02 tempest-AttachVolumeTestJSON-1835319745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4282a1f2-abda-4443-8661-02bc45754db5 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:22 devstack sudo[93320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4282a1f2-abda-4443-8661-02bc45754db5 Nov 03 07:32:22 devstack sudo[93320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:23 devstack sudo[93320]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7d2d36d1-0738-4b69-83b4-acf4f652bb02 tempest-AttachVolumeTestJSON-1835319745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4282a1f2-abda-4443-8661-02bc45754db5" returned: 0 in 0.569s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:23 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-7d2d36d1-0738-4b69-83b4-acf4f652bb02 tempest-AttachVolumeTestJSON-1835319745 None] <== create_volume: return (1759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:32:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7d2d36d1-0738-4b69-83b4-acf4f652bb02 tempest-AttachVolumeTestJSON-1835319745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.765s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:23 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7d2d36d1-0738-4b69-83b4-acf4f652bb02 tempest-AttachVolumeTestJSON-1835319745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05a94121-b7cd-4f2c-a35a-7bccebc789c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4282a1f2-abda-4443-8661-02bc45754db5', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:23 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7d2d36d1-0738-4b69-83b4-acf4f652bb02 tempest-AttachVolumeTestJSON-1835319745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f502a27c-7200-4ff8-b2e7-10c2cd03703a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:23 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-7d2d36d1-0738-4b69-83b4-acf4f652bb02 tempest-AttachVolumeTestJSON-1835319745 None] Volume volume-4282a1f2-abda-4443-8661-02bc45754db5 (4282a1f2-abda-4443-8661-02bc45754db5): created successfully Nov 03 07:32:23 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7d2d36d1-0738-4b69-83b4-acf4f652bb02 tempest-AttachVolumeTestJSON-1835319745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f502a27c-7200-4ff8-b2e7-10c2cd03703a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:23 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7d2d36d1-0738-4b69-83b4-acf4f652bb02 tempest-AttachVolumeTestJSON-1835319745 None] Flow 'volume_create_manager' (45aae9af-563b-41a0-978b-504b363a1f3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:32:23 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-7d2d36d1-0738-4b69-83b4-acf4f652bb02 tempest-AttachVolumeTestJSON-1835319745 None] Created volume successfully. Nov 03 07:32:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-fad28dc2-6674-4d8b-b0be-a185954d2f7d req-1d25ada6-cddd-48e8-b5ae-ff0bda35e7db tempest-AttachVolumeTestJSON-1835319745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-fad28dc2-6674-4d8b-b0be-a185954d2f7d req-1d25ada6-cddd-48e8-b5ae-ff0bda35e7db tempest-AttachVolumeTestJSON-1835319745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-fad28dc2-6674-4d8b-b0be-a185954d2f7d req-1d25ada6-cddd-48e8-b5ae-ff0bda35e7db tempest-AttachVolumeTestJSON-1835319745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:25 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-fad28dc2-6674-4d8b-b0be-a185954d2f7d req-1d25ada6-cddd-48e8-b5ae-ff0bda35e7db tempest-AttachVolumeTestJSON-1835319745 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1', 'name': 'volume-4282a1f2-abda-4443-8661-02bc45754db5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f91ccad3-9ee8-4964-a936-153b6e6c1285', 'enforce_multipath': True} {{(pid=86875) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:32:26 devstack cinder-volume[86875]: INFO cinder.volume.manager [req-fad28dc2-6674-4d8b-b0be-a185954d2f7d req-1d25ada6-cddd-48e8-b5ae-ff0bda35e7db tempest-AttachVolumeTestJSON-1835319745 None] attachment_update completed successfully. Nov 03 07:32:28 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-b38ef2ae-f4b4-4ee9-bb99-c903fa339b35 tempest-VolumesExtendTest-865095625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:32:28 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b38ef2ae-f4b4-4ee9-bb99-c903fa339b35 tempest-VolumesExtendTest-865095625 None] Flow 'volume_create_manager' (882b8e31-488c-4fb5-af96-2aa8ba2a0370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:32:28 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b38ef2ae-f4b4-4ee9-bb99-c903fa339b35 tempest-VolumesExtendTest-865095625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfca4dcb-cfc7-4639-bee4-b7f3d9bd9c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:28 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b38ef2ae-f4b4-4ee9-bb99-c903fa339b35 tempest-VolumesExtendTest-865095625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfca4dcb-cfc7-4639-bee4-b7f3d9bd9c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:32:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-667348549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d03592a-275d-4fc5-a318-0e76ada59ab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d17a687e9bc42858fc9be774e23af55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:32:28Z,use_quota=True,user_id='5af146e164164ff1a591dbe93b684302',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:28 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b38ef2ae-f4b4-4ee9-bb99-c903fa339b35 tempest-VolumesExtendTest-865095625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f24f2220-c956-41e6-a250-47c8ef8fbc8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:28 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b38ef2ae-f4b4-4ee9-bb99-c903fa339b35 tempest-VolumesExtendTest-865095625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f24f2220-c956-41e6-a250-47c8ef8fbc8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:28 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b38ef2ae-f4b4-4ee9-bb99-c903fa339b35 tempest-VolumesExtendTest-865095625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e506f975-31b5-4bac-ab7b-83ad6867ce28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:28 devstack cinder-volume[86875]: DEBUG cinder.image.glance [None req-b38ef2ae-f4b4-4ee9-bb99-c903fa339b35 tempest-VolumesExtendTest-865095625 None] Creating Keystone auth plugin from conf {{(pid=86875) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 07:32:29 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b38ef2ae-f4b4-4ee9-bb99-c903fa339b35 tempest-VolumesExtendTest-865095625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e506f975-31b5-4bac-ab7b-83ad6867ce28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3d03592a-275d-4fc5-a318-0e76ada59ab5', 'volume_name': 'volume-3d03592a-275d-4fc5-a318-0e76ada59ab5', 'volume_size': 1, 'image_id': 'eb68a148-0c9c-4237-9d8d-94a6a7cd87d9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eb68a148-0c9c-4237-9d8d-94a6a7cd87d9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c9ace38ee46b42979b3d4c79532bd66e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eb68a148-0c9c-4237-9d8d-94a6a7cd87d9', 'created_at': datetime.datetime(2026, 11, 3, 6, 21, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 21, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eb68a148-0c9c-4237-9d8d-94a6a7cd87d9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:29 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b38ef2ae-f4b4-4ee9-bb99-c903fa339b35 tempest-VolumesExtendTest-865095625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12b3b098-035f-4dad-8445-c1be5e71cd62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:29 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b38ef2ae-f4b4-4ee9-bb99-c903fa339b35 tempest-VolumesExtendTest-865095625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12b3b098-035f-4dad-8445-c1be5e71cd62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:29 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b38ef2ae-f4b4-4ee9-bb99-c903fa339b35 tempest-VolumesExtendTest-865095625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (662de895-23b9-4229-a5ae-a1980bd1ca4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:29 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-b38ef2ae-f4b4-4ee9-bb99-c903fa339b35 tempest-VolumesExtendTest-865095625 None] Volume 3d03592a-275d-4fc5-a318-0e76ada59ab5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3d03592a-275d-4fc5-a318-0e76ada59ab5', 'volume_size': 1, 'image_id': 'eb68a148-0c9c-4237-9d8d-94a6a7cd87d9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eb68a148-0c9c-4237-9d8d-94a6a7cd87d9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c9ace38ee46b42979b3d4c79532bd66e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eb68a148-0c9c-4237-9d8d-94a6a7cd87d9', 'created_at': datetime.datetime(2026, 11, 3, 6, 21, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 21, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eb68a148-0c9c-4237-9d8d-94a6a7cd87d9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 03 07:32:29 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-b38ef2ae-f4b4-4ee9-bb99-c903fa339b35 tempest-VolumesExtendTest-865095625 None] Trying to clone 3d03592a-275d-4fc5-a318-0e76ada59ab5 from image eb68a148-0c9c-4237-9d8d-94a6a7cd87d9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/eb68a148-0c9c-4237-9d8d-94a6a7cd87d9', 'metadata': {}}]). {{(pid=86875) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 07:32:29 devstack cinder-volume[86875]: INFO cinder.volume.manager [req-54bedcb3-07f2-4934-826f-1d9f183bb3c0 req-f9cbbf1f-8825-45d6-b800-7f0a96d9f201 tempest-AttachVolumeTestJSON-1835319745 None] Terminate volume connection completed successfully. Nov 03 07:32:29 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-54bedcb3-07f2-4934-826f-1d9f183bb3c0 req-f9cbbf1f-8825-45d6-b800-7f0a96d9f201 tempest-AttachVolumeTestJSON-1835319745 None] Deleting attachment e76d407a-aa0f-4ba7-9663-a120effc86b6. {{(pid=86875) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:32:30 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-b38ef2ae-f4b4-4ee9-bb99-c903fa339b35 tempest-VolumesExtendTest-865095625 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_l7pdc16bdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86875) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 07:32:30 devstack cinder-volume[86875]: INFO cinder.image.image_utils [None req-b38ef2ae-f4b4-4ee9-bb99-c903fa339b35 tempest-VolumesExtendTest-865095625 None] Image download 20.69 MB at 20.69 MB/s Nov 03 07:32:30 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed604d04-8cbc-4a51-992b-d067b32bfd58]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:32:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b38ef2ae-f4b4-4ee9-bb99-c903fa339b35 tempest-VolumesExtendTest-865095625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_l7pdc16bdevstack@QuobyteHD {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:30 devstack sudo[93363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_l7pdc16bdevstack@QuobyteHD Nov 03 07:32:30 devstack sudo[93363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:30 devstack sudo[93363]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b38ef2ae-f4b4-4ee9-bb99-c903fa339b35 tempest-VolumesExtendTest-865095625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_l7pdc16bdevstack@QuobyteHD" returned: 0 in 0.659s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:30 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-b38ef2ae-f4b4-4ee9-bb99-c903fa339b35 tempest-VolumesExtendTest-865095625 None] Temporary image eb68a148-0c9c-4237-9d8d-94a6a7cd87d9 is fetched for user 5af146e164164ff1a591dbe93b684302. {{(pid=86875) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 07:32:30 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e3dc65-a4ff-492a-9449-3a0e13b8a955]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:32:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b38ef2ae-f4b4-4ee9-bb99-c903fa339b35 tempest-VolumesExtendTest-865095625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_l7pdc16bdevstack@QuobyteHD {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:31 devstack sudo[93369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_l7pdc16bdevstack@QuobyteHD Nov 03 07:32:31 devstack sudo[93369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:31 devstack sudo[93369]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b38ef2ae-f4b4-4ee9-bb99-c903fa339b35 tempest-VolumesExtendTest-865095625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_l7pdc16bdevstack@QuobyteHD" returned: 0 in 0.735s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b38ef2ae-f4b4-4ee9-bb99-c903fa339b35 tempest-VolumesExtendTest-865095625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b38ef2ae-f4b4-4ee9-bb99-c903fa339b35 tempest-VolumesExtendTest-865095625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:31 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b38ef2ae-f4b4-4ee9-bb99-c903fa339b35 tempest-VolumesExtendTest-865095625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:32:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-667348549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d03592a-275d-4fc5-a318-0e76ada59ab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d17a687e9bc42858fc9be774e23af55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:32:28Z,use_quota=True,user_id='5af146e164164ff1a591dbe93b684302',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:32:31 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-b38ef2ae-f4b4-4ee9-bb99-c903fa339b35 tempest-VolumesExtendTest-865095625 None] Creating volume 3d03592a-275d-4fc5-a318-0e76ada59ab5 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:32:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b38ef2ae-f4b4-4ee9-bb99-c903fa339b35 tempest-VolumesExtendTest-865095625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b38ef2ae-f4b4-4ee9-bb99-c903fa339b35 tempest-VolumesExtendTest-865095625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:31 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b38ef2ae-f4b4-4ee9-bb99-c903fa339b35 tempest-VolumesExtendTest-865095625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:32:31 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b38ef2ae-f4b4-4ee9-bb99-c903fa339b35 tempest-VolumesExtendTest-865095625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:32:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b38ef2ae-f4b4-4ee9-bb99-c903fa339b35 tempest-VolumesExtendTest-865095625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:31 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b38ef2ae-f4b4-4ee9-bb99-c903fa339b35 tempest-VolumesExtendTest-865095625 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:32:31 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-b38ef2ae-f4b4-4ee9-bb99-c903fa339b35 tempest-VolumesExtendTest-865095625 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:32:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b38ef2ae-f4b4-4ee9-bb99-c903fa339b35 tempest-VolumesExtendTest-865095625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3d03592a-275d-4fc5-a318-0e76ada59ab5 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:31 devstack sudo[93376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3d03592a-275d-4fc5-a318-0e76ada59ab5 1073741824 Nov 03 07:32:31 devstack sudo[93376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:31 devstack cinder-volume[86875]: INFO cinder.volume.manager [req-2a2d6016-0c36-4817-8728-ee4dbc20a22e req-602d12ef-b7ca-4e3e-8c72-392b88db9b37 tempest-AttachVolumeTestJSON-1835319745 None] Terminate volume connection completed successfully. Nov 03 07:32:31 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-2a2d6016-0c36-4817-8728-ee4dbc20a22e req-602d12ef-b7ca-4e3e-8c72-392b88db9b37 tempest-AttachVolumeTestJSON-1835319745 None] Deleting attachment f91ccad3-9ee8-4964-a936-153b6e6c1285. {{(pid=86875) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:32:32 devstack sudo[93376]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:32 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b38ef2ae-f4b4-4ee9-bb99-c903fa339b35 tempest-VolumesExtendTest-865095625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3d03592a-275d-4fc5-a318-0e76ada59ab5 1073741824" returned: 0 in 1.035s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:32 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b38ef2ae-f4b4-4ee9-bb99-c903fa339b35 tempest-VolumesExtendTest-865095625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3d03592a-275d-4fc5-a318-0e76ada59ab5 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:32 devstack sudo[93382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3d03592a-275d-4fc5-a318-0e76ada59ab5 Nov 03 07:32:32 devstack sudo[93382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:33 devstack sudo[93382]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b38ef2ae-f4b4-4ee9-bb99-c903fa339b35 tempest-VolumesExtendTest-865095625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3d03592a-275d-4fc5-a318-0e76ada59ab5" returned: 0 in 0.491s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:33 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b38ef2ae-f4b4-4ee9-bb99-c903fa339b35 tempest-VolumesExtendTest-865095625 None] <== create_volume: return (1629ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:32:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b38ef2ae-f4b4-4ee9-bb99-c903fa339b35 tempest-VolumesExtendTest-865095625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.640s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:33 devstack cinder-volume[86875]: DEBUG cinder.volume.volume_utils [None req-b38ef2ae-f4b4-4ee9-bb99-c903fa339b35 tempest-VolumesExtendTest-865095625 None] Attempting download of eb68a148-0c9c-4237-9d8d-94a6a7cd87d9 ((None, [{'url': 'file:///opt/stack/data/glance/images/eb68a148-0c9c-4237-9d8d-94a6a7cd87d9', 'metadata': {}}])) to volume 3d03592a-275d-4fc5-a318-0e76ada59ab5. {{(pid=86875) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 07:32:33 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1adcbb7-dbff-48ef-b824-37152b5a52e6]: (4, 'raw') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:32:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b38ef2ae-f4b4-4ee9-bb99-c903fa339b35 tempest-VolumesExtendTest-865095625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_o38vsi3q {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:33 devstack sudo[93388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_o38vsi3q Nov 03 07:32:33 devstack sudo[93388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:34 devstack sudo[93388]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b38ef2ae-f4b4-4ee9-bb99-c903fa339b35 tempest-VolumesExtendTest-865095625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_o38vsi3q" returned: 0 in 0.975s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b38ef2ae-f4b4-4ee9-bb99-c903fa339b35 tempest-VolumesExtendTest-865095625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_o38vsi3q {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:34 devstack sudo[93413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_o38vsi3q Nov 03 07:32:34 devstack sudo[93413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:35 devstack sudo[93413]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b38ef2ae-f4b4-4ee9-bb99-c903fa339b35 tempest-VolumesExtendTest-865095625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_o38vsi3q" returned: 1 in 0.555s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b38ef2ae-f4b4-4ee9-bb99-c903fa339b35 tempest-VolumesExtendTest-865095625 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_o38vsi3q' failed. Not Retrying. {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:32:35 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[820f5992-5774-407b-85f9-7d0a96c11a2c]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:32:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b38ef2ae-f4b4-4ee9-bb99-c903fa339b35 tempest-VolumesExtendTest-865095625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_l7pdc16bdevstack@QuobyteHD {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:35 devstack sudo[93418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_l7pdc16bdevstack@QuobyteHD Nov 03 07:32:35 devstack sudo[93418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:35 devstack sudo[93418]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b38ef2ae-f4b4-4ee9-bb99-c903fa339b35 tempest-VolumesExtendTest-865095625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_l7pdc16bdevstack@QuobyteHD" returned: 0 in 0.646s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:35 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-b38ef2ae-f4b4-4ee9-bb99-c903fa339b35 tempest-VolumesExtendTest-865095625 None] eb68a148-0c9c-4237-9d8d-94a6a7cd87d9 was qcow2, converting to qcow2 {{(pid=86875) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 07:32:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b38ef2ae-f4b4-4ee9-bb99-c903fa339b35 tempest-VolumesExtendTest-865095625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_l7pdc16bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3d03592a-275d-4fc5-a318-0e76ada59ab5 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:35 devstack sudo[93424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_l7pdc16bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3d03592a-275d-4fc5-a318-0e76ada59ab5 Nov 03 07:32:35 devstack sudo[93424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:38 devstack sudo[93424]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b38ef2ae-f4b4-4ee9-bb99-c903fa339b35 tempest-VolumesExtendTest-865095625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_l7pdc16bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3d03592a-275d-4fc5-a318-0e76ada59ab5" returned: 0 in 3.049s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:38 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-b38ef2ae-f4b4-4ee9-bb99-c903fa339b35 tempest-VolumesExtendTest-865095625 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_l7pdc16bdevstack@QuobyteHD, size 112.00 MB, duration 3.05 sec, destination /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3d03592a-275d-4fc5-a318-0e76ada59ab5 {{(pid=86875) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:32:38 devstack cinder-volume[86875]: INFO cinder.image.image_utils [None req-b38ef2ae-f4b4-4ee9-bb99-c903fa339b35 tempest-VolumesExtendTest-865095625 None] Converted 112.00 MB image at 36.71 MB/s Nov 03 07:32:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b38ef2ae-f4b4-4ee9-bb99-c903fa339b35 tempest-VolumesExtendTest-865095625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3d03592a-275d-4fc5-a318-0e76ada59ab5 1G {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:38 devstack sudo[93463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3d03592a-275d-4fc5-a318-0e76ada59ab5 1G Nov 03 07:32:38 devstack sudo[93463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:39 devstack sudo[93463]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b38ef2ae-f4b4-4ee9-bb99-c903fa339b35 tempest-VolumesExtendTest-865095625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3d03592a-275d-4fc5-a318-0e76ada59ab5 1G" returned: 0 in 0.411s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:39 devstack cinder-volume[86875]: DEBUG cinder.volume.volume_utils [None req-b38ef2ae-f4b4-4ee9-bb99-c903fa339b35 tempest-VolumesExtendTest-865095625 None] Downloaded image eb68a148-0c9c-4237-9d8d-94a6a7cd87d9 ((None, [{'url': 'file:///opt/stack/data/glance/images/eb68a148-0c9c-4237-9d8d-94a6a7cd87d9', 'metadata': {}}])) to volume 3d03592a-275d-4fc5-a318-0e76ada59ab5 successfully. {{(pid=86875) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 07:32:39 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-b38ef2ae-f4b4-4ee9-bb99-c903fa339b35 tempest-VolumesExtendTest-865095625 None] Temporary image eb68a148-0c9c-4237-9d8d-94a6a7cd87d9 for user 5af146e164164ff1a591dbe93b684302 is deleted. {{(pid=86875) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 07:32:39 devstack cinder-volume[86875]: DEBUG cinder.volume.volume_utils [None req-b38ef2ae-f4b4-4ee9-bb99-c903fa339b35 tempest-VolumesExtendTest-865095625 None] Marking volume 3d03592a-275d-4fc5-a318-0e76ada59ab5 as bootable. {{(pid=86875) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 07:32:39 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-b38ef2ae-f4b4-4ee9-bb99-c903fa339b35 tempest-VolumesExtendTest-865095625 None] Copying metadata from image eb68a148-0c9c-4237-9d8d-94a6a7cd87d9 to 3d03592a-275d-4fc5-a318-0e76ada59ab5. {{(pid=86875) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 07:32:39 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-b38ef2ae-f4b4-4ee9-bb99-c903fa339b35 tempest-VolumesExtendTest-865095625 None] Creating volume glance metadata for volume 3d03592a-275d-4fc5-a318-0e76ada59ab5 backed by image eb68a148-0c9c-4237-9d8d-94a6a7cd87d9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'eb68a148-0c9c-4237-9d8d-94a6a7cd87d9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86875) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 07:32:39 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b38ef2ae-f4b4-4ee9-bb99-c903fa339b35 tempest-VolumesExtendTest-865095625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (662de895-23b9-4229-a5ae-a1980bd1ca4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d03592a-275d-4fc5-a318-0e76ada59ab5', 'volume_size': 1, 'image_id': 'eb68a148-0c9c-4237-9d8d-94a6a7cd87d9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eb68a148-0c9c-4237-9d8d-94a6a7cd87d9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c9ace38ee46b42979b3d4c79532bd66e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eb68a148-0c9c-4237-9d8d-94a6a7cd87d9', 'created_at': datetime.datetime(2026, 11, 3, 6, 21, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 21, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eb68a148-0c9c-4237-9d8d-94a6a7cd87d9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:39 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b38ef2ae-f4b4-4ee9-bb99-c903fa339b35 tempest-VolumesExtendTest-865095625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e78a9c3a-a1cc-4eeb-a4ac-ac5b3f971ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:39 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-b38ef2ae-f4b4-4ee9-bb99-c903fa339b35 tempest-VolumesExtendTest-865095625 None] Volume volume-3d03592a-275d-4fc5-a318-0e76ada59ab5 (3d03592a-275d-4fc5-a318-0e76ada59ab5): created successfully Nov 03 07:32:39 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b38ef2ae-f4b4-4ee9-bb99-c903fa339b35 tempest-VolumesExtendTest-865095625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e78a9c3a-a1cc-4eeb-a4ac-ac5b3f971ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:39 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b38ef2ae-f4b4-4ee9-bb99-c903fa339b35 tempest-VolumesExtendTest-865095625 None] Flow 'volume_create_manager' (882b8e31-488c-4fb5-af96-2aa8ba2a0370) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:32:39 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-b38ef2ae-f4b4-4ee9-bb99-c903fa339b35 tempest-VolumesExtendTest-865095625 None] Created volume successfully. Nov 03 07:32:40 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-98db5098-f6db-4eb2-8a0d-42f625b09b76 tempest-AttachVolumeTestJSON-1835319745 None] Acquiring lock "cinder-4282a1f2-abda-4443-8661-02bc45754db5-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:32:40 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-98db5098-f6db-4eb2-8a0d-42f625b09b76 tempest-AttachVolumeTestJSON-1835319745 None] Lock "cinder-4282a1f2-abda-4443-8661-02bc45754db5-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:32:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-4d2c6bfc-e88b-4407-9064-b0d3b2cc488a tempest-VolumesExtendTest-865095625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-4d2c6bfc-e88b-4407-9064-b0d3b2cc488a tempest-VolumesExtendTest-865095625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:40 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b0f0c6-db70-46b2-b7ba-06b36deb8c88]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:32:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4d2c6bfc-e88b-4407-9064-b0d3b2cc488a tempest-VolumesExtendTest-865095625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3d03592a-275d-4fc5-a318-0e76ada59ab5 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:40 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-98db5098-f6db-4eb2-8a0d-42f625b09b76 tempest-AttachVolumeTestJSON-1835319745 None] Acquiring lock "cinder-quobyte-4282a1f2-abda-4443-8661-02bc45754db5" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:32:40 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-98db5098-f6db-4eb2-8a0d-42f625b09b76 tempest-AttachVolumeTestJSON-1835319745 None] Lock "cinder-quobyte-4282a1f2-abda-4443-8661-02bc45754db5" acquired by "delete_volume" :: waited 0.024s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:32:41 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0edce50-3ae2-4683-b470-2fd994bb20dc]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:32:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-98db5098-f6db-4eb2-8a0d-42f625b09b76 tempest-AttachVolumeTestJSON-1835319745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4282a1f2-abda-4443-8661-02bc45754db5 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:41 devstack sudo[93469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3d03592a-275d-4fc5-a318-0e76ada59ab5 Nov 03 07:32:41 devstack sudo[93469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:41 devstack sudo[93470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4282a1f2-abda-4443-8661-02bc45754db5 Nov 03 07:32:41 devstack sudo[93470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:41 devstack sudo[93469]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4d2c6bfc-e88b-4407-9064-b0d3b2cc488a tempest-VolumesExtendTest-865095625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3d03592a-275d-4fc5-a318-0e76ada59ab5" returned: 0 in 0.721s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4d2c6bfc-e88b-4407-9064-b0d3b2cc488a tempest-VolumesExtendTest-865095625 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3d03592a-275d-4fc5-a318-0e76ada59ab5 2G {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:41 devstack sudo[93470]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-98db5098-f6db-4eb2-8a0d-42f625b09b76 tempest-AttachVolumeTestJSON-1835319745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4282a1f2-abda-4443-8661-02bc45754db5" returned: 0 in 0.647s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-98db5098-f6db-4eb2-8a0d-42f625b09b76 tempest-AttachVolumeTestJSON-1835319745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4282a1f2-abda-4443-8661-02bc45754db5 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:41 devstack sudo[93484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4282a1f2-abda-4443-8661-02bc45754db5 Nov 03 07:32:41 devstack sudo[93484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4d2c6bfc-e88b-4407-9064-b0d3b2cc488a tempest-VolumesExtendTest-865095625 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3d03592a-275d-4fc5-a318-0e76ada59ab5 2G" returned: 0 in 0.159s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-4d2c6bfc-e88b-4407-9064-b0d3b2cc488a tempest-VolumesExtendTest-865095625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.932s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:41 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-4d2c6bfc-e88b-4407-9064-b0d3b2cc488a tempest-VolumesExtendTest-865095625 None] Extend volume completed successfully. Nov 03 07:32:42 devstack sudo[93484]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-98db5098-f6db-4eb2-8a0d-42f625b09b76 tempest-AttachVolumeTestJSON-1835319745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4282a1f2-abda-4443-8661-02bc45754db5" returned: 0 in 0.483s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:42 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-98db5098-f6db-4eb2-8a0d-42f625b09b76 tempest-AttachVolumeTestJSON-1835319745 None] Lock "cinder-quobyte-4282a1f2-abda-4443-8661-02bc45754db5" released by "delete_volume" :: held 1.216s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:42 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-98db5098-f6db-4eb2-8a0d-42f625b09b76 tempest-AttachVolumeTestJSON-1835319745 None] Created reservations ['c61b7507-faf3-42bd-bfa0-b06bdf7f7f9f', 'fd1ec56d-c911-44d8-926c-b106aa7aea90', '5f3c3d08-7214-4d17-800c-2b728ca04dbf', '80720094-fb16-4d45-bcdb-53c73e190199'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:32:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-98db5098-f6db-4eb2-8a0d-42f625b09b76 tempest-AttachVolumeTestJSON-1835319745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-98db5098-f6db-4eb2-8a0d-42f625b09b76 tempest-AttachVolumeTestJSON-1835319745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:42 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-98db5098-f6db-4eb2-8a0d-42f625b09b76 tempest-AttachVolumeTestJSON-1835319745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:32:42 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-98db5098-f6db-4eb2-8a0d-42f625b09b76 tempest-AttachVolumeTestJSON-1835319745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:32:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-98db5098-f6db-4eb2-8a0d-42f625b09b76 tempest-AttachVolumeTestJSON-1835319745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-98db5098-f6db-4eb2-8a0d-42f625b09b76 tempest-AttachVolumeTestJSON-1835319745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:42 devstack sudo[93492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:32:42 devstack sudo[93492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:42 devstack sudo[93492]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-98db5098-f6db-4eb2-8a0d-42f625b09b76 tempest-AttachVolumeTestJSON-1835319745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.347s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:42 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-98db5098-f6db-4eb2-8a0d-42f625b09b76 tempest-AttachVolumeTestJSON-1835319745 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:32:42 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-98db5098-f6db-4eb2-8a0d-42f625b09b76 tempest-AttachVolumeTestJSON-1835319745 None] Deleted volume successfully. Nov 03 07:32:42 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-98db5098-f6db-4eb2-8a0d-42f625b09b76 tempest-AttachVolumeTestJSON-1835319745 None] Lock "cinder-4282a1f2-abda-4443-8661-02bc45754db5-delete_volume" released by "delete_volume" :: held 1.992s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:42 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-e7be4369-cd27-4c8b-bfec-711aa2fc9322 tempest-VolumesExtendTest-865095625 None] Acquiring lock "cinder-3d03592a-275d-4fc5-a318-0e76ada59ab5-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:32:42 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-e7be4369-cd27-4c8b-bfec-711aa2fc9322 tempest-VolumesExtendTest-865095625 None] Lock "cinder-3d03592a-275d-4fc5-a318-0e76ada59ab5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:32:42 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-e7be4369-cd27-4c8b-bfec-711aa2fc9322 tempest-VolumesExtendTest-865095625 None] Acquiring lock "cinder-quobyte-3d03592a-275d-4fc5-a318-0e76ada59ab5" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:32:42 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-e7be4369-cd27-4c8b-bfec-711aa2fc9322 tempest-VolumesExtendTest-865095625 None] Lock "cinder-quobyte-3d03592a-275d-4fc5-a318-0e76ada59ab5" acquired by "delete_volume" :: waited 0.023s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:32:43 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[8077bae6-edb8-4dd0-be8b-c224ff9e9c4a]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:32:43 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e7be4369-cd27-4c8b-bfec-711aa2fc9322 tempest-VolumesExtendTest-865095625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3d03592a-275d-4fc5-a318-0e76ada59ab5 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:43 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-90a8563e-44a3-4c0d-a7bb-1a3cc48ecaff tempest-AttachVolumeTestJSON-1835319745 None] Acquiring lock "cinder-2f198c03-e6e8-48db-ae39-c5ce20e9c605-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:32:43 devstack sudo[93495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3d03592a-275d-4fc5-a318-0e76ada59ab5 Nov 03 07:32:43 devstack sudo[93495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:43 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-90a8563e-44a3-4c0d-a7bb-1a3cc48ecaff tempest-AttachVolumeTestJSON-1835319745 None] Lock "cinder-2f198c03-e6e8-48db-ae39-c5ce20e9c605-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:32:43 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-90a8563e-44a3-4c0d-a7bb-1a3cc48ecaff tempest-AttachVolumeTestJSON-1835319745 None] Acquiring lock "cinder-quobyte-2f198c03-e6e8-48db-ae39-c5ce20e9c605" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:32:43 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-90a8563e-44a3-4c0d-a7bb-1a3cc48ecaff tempest-AttachVolumeTestJSON-1835319745 None] Lock "cinder-quobyte-2f198c03-e6e8-48db-ae39-c5ce20e9c605" acquired by "delete_volume" :: waited 0.022s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:32:43 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e2776e-5c20-4a83-bffa-4792823e920c]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:32:43 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-90a8563e-44a3-4c0d-a7bb-1a3cc48ecaff tempest-AttachVolumeTestJSON-1835319745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2f198c03-e6e8-48db-ae39-c5ce20e9c605 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:43 devstack sudo[93504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2f198c03-e6e8-48db-ae39-c5ce20e9c605 Nov 03 07:32:43 devstack sudo[93504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:43 devstack sudo[93495]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:43 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e7be4369-cd27-4c8b-bfec-711aa2fc9322 tempest-VolumesExtendTest-865095625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3d03592a-275d-4fc5-a318-0e76ada59ab5" returned: 0 in 0.568s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:43 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e7be4369-cd27-4c8b-bfec-711aa2fc9322 tempest-VolumesExtendTest-865095625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3d03592a-275d-4fc5-a318-0e76ada59ab5 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:43 devstack sudo[93509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3d03592a-275d-4fc5-a318-0e76ada59ab5 Nov 03 07:32:43 devstack sudo[93509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:43 devstack sudo[93504]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:43 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-90a8563e-44a3-4c0d-a7bb-1a3cc48ecaff tempest-AttachVolumeTestJSON-1835319745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2f198c03-e6e8-48db-ae39-c5ce20e9c605" returned: 0 in 0.500s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:43 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-90a8563e-44a3-4c0d-a7bb-1a3cc48ecaff tempest-AttachVolumeTestJSON-1835319745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2f198c03-e6e8-48db-ae39-c5ce20e9c605 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:43 devstack sudo[93514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2f198c03-e6e8-48db-ae39-c5ce20e9c605 Nov 03 07:32:43 devstack sudo[93514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:44 devstack sudo[93509]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e7be4369-cd27-4c8b-bfec-711aa2fc9322 tempest-VolumesExtendTest-865095625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3d03592a-275d-4fc5-a318-0e76ada59ab5" returned: 0 in 0.421s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:44 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-e7be4369-cd27-4c8b-bfec-711aa2fc9322 tempest-VolumesExtendTest-865095625 None] Lock "cinder-quobyte-3d03592a-275d-4fc5-a318-0e76ada59ab5" released by "delete_volume" :: held 1.050s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:44 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-e7be4369-cd27-4c8b-bfec-711aa2fc9322 tempest-VolumesExtendTest-865095625 None] Created reservations ['e34272c0-f96c-4dd2-b88a-eb3f2cb781fa', '995250ca-4b54-4ef6-b612-054ad50d4e3f', 'bb8c3100-07c3-4b90-a680-2125d683d840', '389930dd-be45-4282-9360-f88286e6d264'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:32:44 devstack sudo[93514]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-90a8563e-44a3-4c0d-a7bb-1a3cc48ecaff tempest-AttachVolumeTestJSON-1835319745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2f198c03-e6e8-48db-ae39-c5ce20e9c605" returned: 0 in 0.336s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:44 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-90a8563e-44a3-4c0d-a7bb-1a3cc48ecaff tempest-AttachVolumeTestJSON-1835319745 None] Lock "cinder-quobyte-2f198c03-e6e8-48db-ae39-c5ce20e9c605" released by "delete_volume" :: held 0.900s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e7be4369-cd27-4c8b-bfec-711aa2fc9322 tempest-VolumesExtendTest-865095625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e7be4369-cd27-4c8b-bfec-711aa2fc9322 tempest-VolumesExtendTest-865095625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:44 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-e7be4369-cd27-4c8b-bfec-711aa2fc9322 tempest-VolumesExtendTest-865095625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:32:44 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-e7be4369-cd27-4c8b-bfec-711aa2fc9322 tempest-VolumesExtendTest-865095625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:32:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e7be4369-cd27-4c8b-bfec-711aa2fc9322 tempest-VolumesExtendTest-865095625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e7be4369-cd27-4c8b-bfec-711aa2fc9322 tempest-VolumesExtendTest-865095625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:44 devstack sudo[93518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:32:44 devstack sudo[93518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:44 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-90a8563e-44a3-4c0d-a7bb-1a3cc48ecaff tempest-AttachVolumeTestJSON-1835319745 None] Created reservations ['071ebfd4-1ec9-4c3a-8c87-e5ef4d8c0717', '34b1baf9-f2e9-450e-b046-babb0c6e0884', '715a08a1-d17a-43f7-8a4a-b2f61a428c75', '2544639b-e632-4020-a21d-43ac6cc45e23'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:32:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-90a8563e-44a3-4c0d-a7bb-1a3cc48ecaff tempest-AttachVolumeTestJSON-1835319745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-90a8563e-44a3-4c0d-a7bb-1a3cc48ecaff tempest-AttachVolumeTestJSON-1835319745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:44 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-90a8563e-44a3-4c0d-a7bb-1a3cc48ecaff tempest-AttachVolumeTestJSON-1835319745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:32:44 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-90a8563e-44a3-4c0d-a7bb-1a3cc48ecaff tempest-AttachVolumeTestJSON-1835319745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:32:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-90a8563e-44a3-4c0d-a7bb-1a3cc48ecaff tempest-AttachVolumeTestJSON-1835319745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-90a8563e-44a3-4c0d-a7bb-1a3cc48ecaff tempest-AttachVolumeTestJSON-1835319745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:44 devstack sudo[93520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:32:44 devstack sudo[93520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:44 devstack sudo[93518]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e7be4369-cd27-4c8b-bfec-711aa2fc9322 tempest-VolumesExtendTest-865095625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.313s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:44 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-e7be4369-cd27-4c8b-bfec-711aa2fc9322 tempest-VolumesExtendTest-865095625 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:32:44 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-e7be4369-cd27-4c8b-bfec-711aa2fc9322 tempest-VolumesExtendTest-865095625 None] Deleted volume successfully. Nov 03 07:32:44 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-e7be4369-cd27-4c8b-bfec-711aa2fc9322 tempest-VolumesExtendTest-865095625 None] Lock "cinder-3d03592a-275d-4fc5-a318-0e76ada59ab5-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:44 devstack sudo[93520]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-90a8563e-44a3-4c0d-a7bb-1a3cc48ecaff tempest-AttachVolumeTestJSON-1835319745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.284s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:44 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-90a8563e-44a3-4c0d-a7bb-1a3cc48ecaff tempest-AttachVolumeTestJSON-1835319745 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:32:44 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-90a8563e-44a3-4c0d-a7bb-1a3cc48ecaff tempest-AttachVolumeTestJSON-1835319745 None] Deleted volume successfully. Nov 03 07:32:44 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-90a8563e-44a3-4c0d-a7bb-1a3cc48ecaff tempest-AttachVolumeTestJSON-1835319745 None] Lock "cinder-2f198c03-e6e8-48db-ae39-c5ce20e9c605-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:45 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-be00f0d8-0901-45f9-ac38-69756bd05ff4 tempest-AttachVolumeTestJSON-1835319745 None] Acquiring lock "cinder-597d424e-ee46-4837-90ac-6c2a00a6e84d-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:32:45 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-be00f0d8-0901-45f9-ac38-69756bd05ff4 tempest-AttachVolumeTestJSON-1835319745 None] Lock "cinder-597d424e-ee46-4837-90ac-6c2a00a6e84d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:32:45 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-be00f0d8-0901-45f9-ac38-69756bd05ff4 tempest-AttachVolumeTestJSON-1835319745 None] Acquiring lock "cinder-quobyte-597d424e-ee46-4837-90ac-6c2a00a6e84d" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:32:45 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-be00f0d8-0901-45f9-ac38-69756bd05ff4 tempest-AttachVolumeTestJSON-1835319745 None] Lock "cinder-quobyte-597d424e-ee46-4837-90ac-6c2a00a6e84d" acquired by "delete_volume" :: waited 0.025s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:32:45 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[c253be1a-d8a7-4c41-b284-2e2043a5c666]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:32:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-be00f0d8-0901-45f9-ac38-69756bd05ff4 tempest-AttachVolumeTestJSON-1835319745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-597d424e-ee46-4837-90ac-6c2a00a6e84d {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:45 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e8d8fce-58cc-42f6-a320-39cf0aadd7af tempest-VolumesExtendTest-865095625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:32:45 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5e8d8fce-58cc-42f6-a320-39cf0aadd7af tempest-VolumesExtendTest-865095625 None] Flow 'volume_create_manager' (ed8d24bb-6346-4e69-829b-6c8dcf5f83b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:32:45 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5e8d8fce-58cc-42f6-a320-39cf0aadd7af tempest-VolumesExtendTest-865095625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b177701f-ada8-4278-9cc8-5dcd7a1fcc81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:45 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5e8d8fce-58cc-42f6-a320-39cf0aadd7af tempest-VolumesExtendTest-865095625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b177701f-ada8-4278-9cc8-5dcd7a1fcc81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:32:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-77173483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9112504-d11f-48f9-8433-90b0c0d1c4cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d17a687e9bc42858fc9be774e23af55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:32:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:32:46Z,use_quota=True,user_id='5af146e164164ff1a591dbe93b684302',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:45 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5e8d8fce-58cc-42f6-a320-39cf0aadd7af tempest-VolumesExtendTest-865095625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b10ec888-5b58-47f8-89d8-a043807e1830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:45 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5e8d8fce-58cc-42f6-a320-39cf0aadd7af tempest-VolumesExtendTest-865095625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b10ec888-5b58-47f8-89d8-a043807e1830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:45 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5e8d8fce-58cc-42f6-a320-39cf0aadd7af tempest-VolumesExtendTest-865095625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (092df0d9-55ea-434c-b108-ae7b5d3c0d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:45 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5e8d8fce-58cc-42f6-a320-39cf0aadd7af tempest-VolumesExtendTest-865095625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (092df0d9-55ea-434c-b108-ae7b5d3c0d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9112504-d11f-48f9-8433-90b0c0d1c4cc', 'volume_name': 'volume-f9112504-d11f-48f9-8433-90b0c0d1c4cc', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:45 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5e8d8fce-58cc-42f6-a320-39cf0aadd7af tempest-VolumesExtendTest-865095625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5874fbfa-1ab1-4cec-a7e7-ecba75c315ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:45 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5e8d8fce-58cc-42f6-a320-39cf0aadd7af tempest-VolumesExtendTest-865095625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5874fbfa-1ab1-4cec-a7e7-ecba75c315ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:45 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5e8d8fce-58cc-42f6-a320-39cf0aadd7af tempest-VolumesExtendTest-865095625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ca26855-c957-49a9-8817-3301950ad5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:45 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-5e8d8fce-58cc-42f6-a320-39cf0aadd7af tempest-VolumesExtendTest-865095625 None] Volume f9112504-d11f-48f9-8433-90b0c0d1c4cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9112504-d11f-48f9-8433-90b0c0d1c4cc', 'volume_size': 1} Nov 03 07:32:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-5e8d8fce-58cc-42f6-a320-39cf0aadd7af tempest-VolumesExtendTest-865095625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-5e8d8fce-58cc-42f6-a320-39cf0aadd7af tempest-VolumesExtendTest-865095625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:45 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-5e8d8fce-58cc-42f6-a320-39cf0aadd7af tempest-VolumesExtendTest-865095625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:32:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-77173483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9112504-d11f-48f9-8433-90b0c0d1c4cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d17a687e9bc42858fc9be774e23af55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:32:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:32:46Z,use_quota=True,user_id='5af146e164164ff1a591dbe93b684302',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:32:45 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-5e8d8fce-58cc-42f6-a320-39cf0aadd7af tempest-VolumesExtendTest-865095625 None] Creating volume f9112504-d11f-48f9-8433-90b0c0d1c4cc {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:32:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-5e8d8fce-58cc-42f6-a320-39cf0aadd7af tempest-VolumesExtendTest-865095625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-5e8d8fce-58cc-42f6-a320-39cf0aadd7af tempest-VolumesExtendTest-865095625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:45 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-5e8d8fce-58cc-42f6-a320-39cf0aadd7af tempest-VolumesExtendTest-865095625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:32:45 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-5e8d8fce-58cc-42f6-a320-39cf0aadd7af tempest-VolumesExtendTest-865095625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:32:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-5e8d8fce-58cc-42f6-a320-39cf0aadd7af tempest-VolumesExtendTest-865095625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:45 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-5e8d8fce-58cc-42f6-a320-39cf0aadd7af tempest-VolumesExtendTest-865095625 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:32:45 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-5e8d8fce-58cc-42f6-a320-39cf0aadd7af tempest-VolumesExtendTest-865095625 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:32:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5e8d8fce-58cc-42f6-a320-39cf0aadd7af tempest-VolumesExtendTest-865095625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9112504-d11f-48f9-8433-90b0c0d1c4cc 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:45 devstack sudo[93524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-597d424e-ee46-4837-90ac-6c2a00a6e84d Nov 03 07:32:45 devstack sudo[93524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:45 devstack sudo[93525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9112504-d11f-48f9-8433-90b0c0d1c4cc 1073741824 Nov 03 07:32:45 devstack sudo[93525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:46 devstack sudo[93524]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-be00f0d8-0901-45f9-ac38-69756bd05ff4 tempest-AttachVolumeTestJSON-1835319745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-597d424e-ee46-4837-90ac-6c2a00a6e84d" returned: 0 in 0.457s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-be00f0d8-0901-45f9-ac38-69756bd05ff4 tempest-AttachVolumeTestJSON-1835319745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-597d424e-ee46-4837-90ac-6c2a00a6e84d {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:46 devstack sudo[93534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-597d424e-ee46-4837-90ac-6c2a00a6e84d Nov 03 07:32:46 devstack sudo[93534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:46 devstack sudo[93525]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5e8d8fce-58cc-42f6-a320-39cf0aadd7af tempest-VolumesExtendTest-865095625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9112504-d11f-48f9-8433-90b0c0d1c4cc 1073741824" returned: 0 in 0.600s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:46 devstack sudo[93534]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-be00f0d8-0901-45f9-ac38-69756bd05ff4 tempest-AttachVolumeTestJSON-1835319745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-597d424e-ee46-4837-90ac-6c2a00a6e84d" returned: 0 in 0.315s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5e8d8fce-58cc-42f6-a320-39cf0aadd7af tempest-VolumesExtendTest-865095625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9112504-d11f-48f9-8433-90b0c0d1c4cc {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:46 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-be00f0d8-0901-45f9-ac38-69756bd05ff4 tempest-AttachVolumeTestJSON-1835319745 None] Lock "cinder-quobyte-597d424e-ee46-4837-90ac-6c2a00a6e84d" released by "delete_volume" :: held 0.841s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:46 devstack sudo[93537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9112504-d11f-48f9-8433-90b0c0d1c4cc Nov 03 07:32:46 devstack sudo[93537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:46 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-be00f0d8-0901-45f9-ac38-69756bd05ff4 tempest-AttachVolumeTestJSON-1835319745 None] Created reservations ['386e4e92-4bf0-4271-b39f-0ef719c484f5', '80ee5ca9-782b-403c-ac98-089f48872d53', '0340a554-e5aa-4f4b-9ce4-a78758d9d663', '7cd83dbe-9374-4a48-99fc-24577dd7037e'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:32:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-be00f0d8-0901-45f9-ac38-69756bd05ff4 tempest-AttachVolumeTestJSON-1835319745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-be00f0d8-0901-45f9-ac38-69756bd05ff4 tempest-AttachVolumeTestJSON-1835319745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:46 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-be00f0d8-0901-45f9-ac38-69756bd05ff4 tempest-AttachVolumeTestJSON-1835319745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:32:46 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-be00f0d8-0901-45f9-ac38-69756bd05ff4 tempest-AttachVolumeTestJSON-1835319745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:32:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-be00f0d8-0901-45f9-ac38-69756bd05ff4 tempest-AttachVolumeTestJSON-1835319745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-be00f0d8-0901-45f9-ac38-69756bd05ff4 tempest-AttachVolumeTestJSON-1835319745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:46 devstack sudo[93539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:32:46 devstack sudo[93539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:46 devstack sudo[93537]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5e8d8fce-58cc-42f6-a320-39cf0aadd7af tempest-VolumesExtendTest-865095625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9112504-d11f-48f9-8433-90b0c0d1c4cc" returned: 0 in 0.354s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:46 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-5e8d8fce-58cc-42f6-a320-39cf0aadd7af tempest-VolumesExtendTest-865095625 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:32:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-5e8d8fce-58cc-42f6-a320-39cf0aadd7af tempest-VolumesExtendTest-865095625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:46 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5e8d8fce-58cc-42f6-a320-39cf0aadd7af tempest-VolumesExtendTest-865095625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ca26855-c957-49a9-8817-3301950ad5aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9112504-d11f-48f9-8433-90b0c0d1c4cc', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:46 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5e8d8fce-58cc-42f6-a320-39cf0aadd7af tempest-VolumesExtendTest-865095625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (239bd3a7-d81e-439c-b91e-ba718f9de716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:46 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-5e8d8fce-58cc-42f6-a320-39cf0aadd7af tempest-VolumesExtendTest-865095625 None] Volume volume-f9112504-d11f-48f9-8433-90b0c0d1c4cc (f9112504-d11f-48f9-8433-90b0c0d1c4cc): created successfully Nov 03 07:32:46 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5e8d8fce-58cc-42f6-a320-39cf0aadd7af tempest-VolumesExtendTest-865095625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (239bd3a7-d81e-439c-b91e-ba718f9de716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:46 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5e8d8fce-58cc-42f6-a320-39cf0aadd7af tempest-VolumesExtendTest-865095625 None] Flow 'volume_create_manager' (ed8d24bb-6346-4e69-829b-6c8dcf5f83b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:32:47 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-5e8d8fce-58cc-42f6-a320-39cf0aadd7af tempest-VolumesExtendTest-865095625 None] Created volume successfully. Nov 03 07:32:47 devstack sudo[93539]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:47 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-be00f0d8-0901-45f9-ac38-69756bd05ff4 tempest-AttachVolumeTestJSON-1835319745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.327s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:47 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-be00f0d8-0901-45f9-ac38-69756bd05ff4 tempest-AttachVolumeTestJSON-1835319745 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:32:47 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-be00f0d8-0901-45f9-ac38-69756bd05ff4 tempest-AttachVolumeTestJSON-1835319745 None] Deleted volume successfully. Nov 03 07:32:47 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-be00f0d8-0901-45f9-ac38-69756bd05ff4 tempest-AttachVolumeTestJSON-1835319745 None] Lock "cinder-597d424e-ee46-4837-90ac-6c2a00a6e84d-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-1b1e21c4-c0ba-491f-8fd9-9ba5061b9044 tempest-VolumesExtendTest-865095625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-1b1e21c4-c0ba-491f-8fd9-9ba5061b9044 tempest-VolumesExtendTest-865095625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:48 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-1b1e21c4-c0ba-491f-8fd9-9ba5061b9044 tempest-VolumesExtendTest-865095625 None] Creating offline snapshot daf8355e-0f4e-4fbf-888b-f1bc2dedf42b of volume f9112504-d11f-48f9-8433-90b0c0d1c4cc {{(pid=86875) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:32:48 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1110f0-123a-4ebd-9fdd-860e5e45ce4a]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:32:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1b1e21c4-c0ba-491f-8fd9-9ba5061b9044 tempest-VolumesExtendTest-865095625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9112504-d11f-48f9-8433-90b0c0d1c4cc {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:48 devstack sudo[93544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9112504-d11f-48f9-8433-90b0c0d1c4cc Nov 03 07:32:48 devstack sudo[93544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:48 devstack sudo[93544]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1b1e21c4-c0ba-491f-8fd9-9ba5061b9044 tempest-VolumesExtendTest-865095625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9112504-d11f-48f9-8433-90b0c0d1c4cc" returned: 0 in 0.535s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1b1e21c4-c0ba-491f-8fd9-9ba5061b9044 tempest-VolumesExtendTest-865095625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9112504-d11f-48f9-8433-90b0c0d1c4cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9112504-d11f-48f9-8433-90b0c0d1c4cc.daf8355e-0f4e-4fbf-888b-f1bc2dedf42b 1G {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:48 devstack sudo[93551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9112504-d11f-48f9-8433-90b0c0d1c4cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9112504-d11f-48f9-8433-90b0c0d1c4cc.daf8355e-0f4e-4fbf-888b-f1bc2dedf42b 1G Nov 03 07:32:48 devstack sudo[93551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:48 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9c55158-7743-46f2-8312-8347a18960b3 tempest-VolumesListAdminTestJSON-1469008318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:32:48 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d9c55158-7743-46f2-8312-8347a18960b3 tempest-VolumesListAdminTestJSON-1469008318 None] Flow 'volume_create_manager' (aa44946e-59cf-472d-a6dc-18aa08a0165d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:32:48 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d9c55158-7743-46f2-8312-8347a18960b3 tempest-VolumesListAdminTestJSON-1469008318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (299ba141-cc67-4778-ab04-64c86ea8d869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:48 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d9c55158-7743-46f2-8312-8347a18960b3 tempest-VolumesListAdminTestJSON-1469008318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (299ba141-cc67-4778-ab04-64c86ea8d869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:32:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-272976891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f49626a-5079-4d38-8e7f-a2cca926318e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13ddb2d42756482697593c4d5b277e85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:32:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:32:49Z,use_quota=True,user_id='73cf360f546c43b5b7f3fe456f6f0dad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:48 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d9c55158-7743-46f2-8312-8347a18960b3 tempest-VolumesListAdminTestJSON-1469008318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56fd9776-f53d-4279-bbc5-6bb420df0844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:48 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d9c55158-7743-46f2-8312-8347a18960b3 tempest-VolumesListAdminTestJSON-1469008318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56fd9776-f53d-4279-bbc5-6bb420df0844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:48 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d9c55158-7743-46f2-8312-8347a18960b3 tempest-VolumesListAdminTestJSON-1469008318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a19a821a-f73a-4510-bb1d-1cea0e4c50b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:49 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d9c55158-7743-46f2-8312-8347a18960b3 tempest-VolumesListAdminTestJSON-1469008318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a19a821a-f73a-4510-bb1d-1cea0e4c50b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f49626a-5079-4d38-8e7f-a2cca926318e', 'volume_name': 'volume-9f49626a-5079-4d38-8e7f-a2cca926318e', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:49 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d9c55158-7743-46f2-8312-8347a18960b3 tempest-VolumesListAdminTestJSON-1469008318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36f0ad5d-41f5-45f4-8a4d-9faabacf4003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:49 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d9c55158-7743-46f2-8312-8347a18960b3 tempest-VolumesListAdminTestJSON-1469008318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36f0ad5d-41f5-45f4-8a4d-9faabacf4003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:49 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d9c55158-7743-46f2-8312-8347a18960b3 tempest-VolumesListAdminTestJSON-1469008318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5e9cdec-79c9-4ef4-adfc-233b4f7afaca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:49 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-d9c55158-7743-46f2-8312-8347a18960b3 tempest-VolumesListAdminTestJSON-1469008318 None] Volume 9f49626a-5079-4d38-8e7f-a2cca926318e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f49626a-5079-4d38-8e7f-a2cca926318e', 'volume_size': 1} Nov 03 07:32:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-d9c55158-7743-46f2-8312-8347a18960b3 tempest-VolumesListAdminTestJSON-1469008318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:49 devstack sudo[93551]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1b1e21c4-c0ba-491f-8fd9-9ba5061b9044 tempest-VolumesExtendTest-865095625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9112504-d11f-48f9-8433-90b0c0d1c4cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9112504-d11f-48f9-8433-90b0c0d1c4cc.daf8355e-0f4e-4fbf-888b-f1bc2dedf42b 1G" returned: 0 in 0.521s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1b1e21c4-c0ba-491f-8fd9-9ba5061b9044 tempest-VolumesExtendTest-865095625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9112504-d11f-48f9-8433-90b0c0d1c4cc -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9112504-d11f-48f9-8433-90b0c0d1c4cc.daf8355e-0f4e-4fbf-888b-f1bc2dedf42b {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:49 devstack sudo[93557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9112504-d11f-48f9-8433-90b0c0d1c4cc -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9112504-d11f-48f9-8433-90b0c0d1c4cc.daf8355e-0f4e-4fbf-888b-f1bc2dedf42b Nov 03 07:32:49 devstack sudo[93557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:49 devstack sudo[93557]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1b1e21c4-c0ba-491f-8fd9-9ba5061b9044 tempest-VolumesExtendTest-865095625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9112504-d11f-48f9-8433-90b0c0d1c4cc -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9112504-d11f-48f9-8433-90b0c0d1c4cc.daf8355e-0f4e-4fbf-888b-f1bc2dedf42b" returned: 0 in 0.341s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:49 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-1b1e21c4-c0ba-491f-8fd9-9ba5061b9044 tempest-VolumesExtendTest-865095625 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9112504-d11f-48f9-8433-90b0c0d1c4cc.daf8355e-0f4e-4fbf-888b-f1bc2dedf42b is being set with open permissions: ugo+rw Nov 03 07:32:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1b1e21c4-c0ba-491f-8fd9-9ba5061b9044 tempest-VolumesExtendTest-865095625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9112504-d11f-48f9-8433-90b0c0d1c4cc.daf8355e-0f4e-4fbf-888b-f1bc2dedf42b {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:49 devstack sudo[93563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9112504-d11f-48f9-8433-90b0c0d1c4cc.daf8355e-0f4e-4fbf-888b-f1bc2dedf42b Nov 03 07:32:49 devstack sudo[93563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:49 devstack sudo[93563]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1b1e21c4-c0ba-491f-8fd9-9ba5061b9044 tempest-VolumesExtendTest-865095625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9112504-d11f-48f9-8433-90b0c0d1c4cc.daf8355e-0f4e-4fbf-888b-f1bc2dedf42b" returned: 0 in 0.293s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1b1e21c4-c0ba-491f-8fd9-9ba5061b9044 tempest-VolumesExtendTest-865095625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9112504-d11f-48f9-8433-90b0c0d1c4cc.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:50 devstack sudo[93566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9112504-d11f-48f9-8433-90b0c0d1c4cc.info Nov 03 07:32:50 devstack sudo[93566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:50 devstack sudo[93566]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1b1e21c4-c0ba-491f-8fd9-9ba5061b9044 tempest-VolumesExtendTest-865095625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9112504-d11f-48f9-8433-90b0c0d1c4cc.info" returned: 0 in 0.302s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:50 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-1b1e21c4-c0ba-491f-8fd9-9ba5061b9044 tempest-VolumesExtendTest-865095625 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9112504-d11f-48f9-8433-90b0c0d1c4cc.info is being set with open permissions: ugo+rw Nov 03 07:32:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1b1e21c4-c0ba-491f-8fd9-9ba5061b9044 tempest-VolumesExtendTest-865095625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9112504-d11f-48f9-8433-90b0c0d1c4cc.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:50 devstack sudo[93570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9112504-d11f-48f9-8433-90b0c0d1c4cc.info Nov 03 07:32:50 devstack sudo[93570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:50 devstack sudo[93570]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1b1e21c4-c0ba-491f-8fd9-9ba5061b9044 tempest-VolumesExtendTest-865095625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9112504-d11f-48f9-8433-90b0c0d1c4cc.info" returned: 0 in 0.267s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-1b1e21c4-c0ba-491f-8fd9-9ba5061b9044 tempest-VolumesExtendTest-865095625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.420s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-d9c55158-7743-46f2-8312-8347a18960b3 tempest-VolumesListAdminTestJSON-1469008318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.573s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:50 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-d9c55158-7743-46f2-8312-8347a18960b3 tempest-VolumesListAdminTestJSON-1469008318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:32:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-272976891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f49626a-5079-4d38-8e7f-a2cca926318e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13ddb2d42756482697593c4d5b277e85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:32:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:32:49Z,use_quota=True,user_id='73cf360f546c43b5b7f3fe456f6f0dad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:32:50 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-d9c55158-7743-46f2-8312-8347a18960b3 tempest-VolumesListAdminTestJSON-1469008318 None] Creating volume 9f49626a-5079-4d38-8e7f-a2cca926318e {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:32:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-d9c55158-7743-46f2-8312-8347a18960b3 tempest-VolumesListAdminTestJSON-1469008318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-d9c55158-7743-46f2-8312-8347a18960b3 tempest-VolumesListAdminTestJSON-1469008318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:50 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-d9c55158-7743-46f2-8312-8347a18960b3 tempest-VolumesListAdminTestJSON-1469008318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:32:50 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-d9c55158-7743-46f2-8312-8347a18960b3 tempest-VolumesListAdminTestJSON-1469008318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:32:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-d9c55158-7743-46f2-8312-8347a18960b3 tempest-VolumesListAdminTestJSON-1469008318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:50 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-d9c55158-7743-46f2-8312-8347a18960b3 tempest-VolumesListAdminTestJSON-1469008318 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:32:50 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-d9c55158-7743-46f2-8312-8347a18960b3 tempest-VolumesListAdminTestJSON-1469008318 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:32:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d9c55158-7743-46f2-8312-8347a18960b3 tempest-VolumesListAdminTestJSON-1469008318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f49626a-5079-4d38-8e7f-a2cca926318e 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:50 devstack sudo[93573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f49626a-5079-4d38-8e7f-a2cca926318e 1073741824 Nov 03 07:32:50 devstack sudo[93573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:50 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-1b1e21c4-c0ba-491f-8fd9-9ba5061b9044 tempest-VolumesExtendTest-865095625 None] Create snapshot completed successfully Nov 03 07:32:51 devstack sudo[93573]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d9c55158-7743-46f2-8312-8347a18960b3 tempest-VolumesListAdminTestJSON-1469008318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f49626a-5079-4d38-8e7f-a2cca926318e 1073741824" returned: 0 in 0.658s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d9c55158-7743-46f2-8312-8347a18960b3 tempest-VolumesListAdminTestJSON-1469008318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f49626a-5079-4d38-8e7f-a2cca926318e {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:51 devstack sudo[93579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f49626a-5079-4d38-8e7f-a2cca926318e Nov 03 07:32:51 devstack sudo[93579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-70572a4d-2602-4c89-9370-f5bca1fa44aa tempest-VolumesExtendTest-865095625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:51 devstack sudo[93579]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d9c55158-7743-46f2-8312-8347a18960b3 tempest-VolumesListAdminTestJSON-1469008318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f49626a-5079-4d38-8e7f-a2cca926318e" returned: 0 in 0.388s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:51 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-d9c55158-7743-46f2-8312-8347a18960b3 tempest-VolumesListAdminTestJSON-1469008318 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:32:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-d9c55158-7743-46f2-8312-8347a18960b3 tempest-VolumesListAdminTestJSON-1469008318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-70572a4d-2602-4c89-9370-f5bca1fa44aa tempest-VolumesExtendTest-865095625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.131s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:51 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[436fdf81-b296-48aa-b6de-db881f345ba2]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:32:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-70572a4d-2602-4c89-9370-f5bca1fa44aa tempest-VolumesExtendTest-865095625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9112504-d11f-48f9-8433-90b0c0d1c4cc {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:51 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d9c55158-7743-46f2-8312-8347a18960b3 tempest-VolumesListAdminTestJSON-1469008318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5e9cdec-79c9-4ef4-adfc-233b4f7afaca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f49626a-5079-4d38-8e7f-a2cca926318e', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:51 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d9c55158-7743-46f2-8312-8347a18960b3 tempest-VolumesListAdminTestJSON-1469008318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d18c61f5-21c4-455c-81aa-5c0d197c66f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:51 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-d9c55158-7743-46f2-8312-8347a18960b3 tempest-VolumesListAdminTestJSON-1469008318 None] Volume volume-9f49626a-5079-4d38-8e7f-a2cca926318e (9f49626a-5079-4d38-8e7f-a2cca926318e): created successfully Nov 03 07:32:51 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d9c55158-7743-46f2-8312-8347a18960b3 tempest-VolumesListAdminTestJSON-1469008318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d18c61f5-21c4-455c-81aa-5c0d197c66f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:51 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d9c55158-7743-46f2-8312-8347a18960b3 tempest-VolumesListAdminTestJSON-1469008318 None] Flow 'volume_create_manager' (aa44946e-59cf-472d-a6dc-18aa08a0165d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:32:51 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-d9c55158-7743-46f2-8312-8347a18960b3 tempest-VolumesListAdminTestJSON-1469008318 None] Created volume successfully. Nov 03 07:32:51 devstack sudo[93582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9112504-d11f-48f9-8433-90b0c0d1c4cc Nov 03 07:32:51 devstack sudo[93582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:52 devstack sudo[93582]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-70572a4d-2602-4c89-9370-f5bca1fa44aa tempest-VolumesExtendTest-865095625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9112504-d11f-48f9-8433-90b0c0d1c4cc" returned: 0 in 0.733s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-70572a4d-2602-4c89-9370-f5bca1fa44aa tempest-VolumesExtendTest-865095625 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9112504-d11f-48f9-8433-90b0c0d1c4cc.daf8355e-0f4e-4fbf-888b-f1bc2dedf42b 2G {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-70572a4d-2602-4c89-9370-f5bca1fa44aa tempest-VolumesExtendTest-865095625 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9112504-d11f-48f9-8433-90b0c0d1c4cc.daf8355e-0f4e-4fbf-888b-f1bc2dedf42b 2G" returned: 0 in 0.253s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-70572a4d-2602-4c89-9370-f5bca1fa44aa tempest-VolumesExtendTest-865095625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.049s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:52 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-70572a4d-2602-4c89-9370-f5bca1fa44aa tempest-VolumesExtendTest-865095625 None] Extend volume completed successfully. Nov 03 07:32:52 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-4537a3cb-a2ee-450b-9873-035f4b15a377 tempest-VolumesListAdminTestJSON-1469008318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:32:52 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4537a3cb-a2ee-450b-9873-035f4b15a377 tempest-VolumesListAdminTestJSON-1469008318 None] Flow 'volume_create_manager' (7aeedb65-ef55-48ba-af20-8f05990f4fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:32:52 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4537a3cb-a2ee-450b-9873-035f4b15a377 tempest-VolumesListAdminTestJSON-1469008318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e8c9dde-2ace-4dba-a05b-438ada764c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:52 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4537a3cb-a2ee-450b-9873-035f4b15a377 tempest-VolumesListAdminTestJSON-1469008318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e8c9dde-2ace-4dba-a05b-438ada764c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:32:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-91127005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b29a943a-6de2-4bc9-b30c-5b261ca62aad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13ddb2d42756482697593c4d5b277e85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:32:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:32:53Z,use_quota=True,user_id='73cf360f546c43b5b7f3fe456f6f0dad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:52 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4537a3cb-a2ee-450b-9873-035f4b15a377 tempest-VolumesListAdminTestJSON-1469008318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2a2a32f-48c4-464e-957a-f2b6f9ca59f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:52 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4537a3cb-a2ee-450b-9873-035f4b15a377 tempest-VolumesListAdminTestJSON-1469008318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2a2a32f-48c4-464e-957a-f2b6f9ca59f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:52 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4537a3cb-a2ee-450b-9873-035f4b15a377 tempest-VolumesListAdminTestJSON-1469008318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04d57dca-da5a-42b3-b2e0-9ff79cf3ad0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4537a3cb-a2ee-450b-9873-035f4b15a377 tempest-VolumesListAdminTestJSON-1469008318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04d57dca-da5a-42b3-b2e0-9ff79cf3ad0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b29a943a-6de2-4bc9-b30c-5b261ca62aad', 'volume_name': 'volume-b29a943a-6de2-4bc9-b30c-5b261ca62aad', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4537a3cb-a2ee-450b-9873-035f4b15a377 tempest-VolumesListAdminTestJSON-1469008318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5885446-6e94-4526-a4ed-e090590b242d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4537a3cb-a2ee-450b-9873-035f4b15a377 tempest-VolumesListAdminTestJSON-1469008318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5885446-6e94-4526-a4ed-e090590b242d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4537a3cb-a2ee-450b-9873-035f4b15a377 tempest-VolumesListAdminTestJSON-1469008318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33072724-d09f-4292-950f-d870d610633b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:53 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-4537a3cb-a2ee-450b-9873-035f4b15a377 tempest-VolumesListAdminTestJSON-1469008318 None] Volume b29a943a-6de2-4bc9-b30c-5b261ca62aad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b29a943a-6de2-4bc9-b30c-5b261ca62aad', 'volume_size': 1} Nov 03 07:32:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-4537a3cb-a2ee-450b-9873-035f4b15a377 tempest-VolumesListAdminTestJSON-1469008318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-4537a3cb-a2ee-450b-9873-035f4b15a377 tempest-VolumesListAdminTestJSON-1469008318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:53 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-4537a3cb-a2ee-450b-9873-035f4b15a377 tempest-VolumesListAdminTestJSON-1469008318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:32:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-91127005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b29a943a-6de2-4bc9-b30c-5b261ca62aad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13ddb2d42756482697593c4d5b277e85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:32:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:32:53Z,use_quota=True,user_id='73cf360f546c43b5b7f3fe456f6f0dad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:32:53 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-4537a3cb-a2ee-450b-9873-035f4b15a377 tempest-VolumesListAdminTestJSON-1469008318 None] Creating volume b29a943a-6de2-4bc9-b30c-5b261ca62aad {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:32:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-4537a3cb-a2ee-450b-9873-035f4b15a377 tempest-VolumesListAdminTestJSON-1469008318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-4537a3cb-a2ee-450b-9873-035f4b15a377 tempest-VolumesListAdminTestJSON-1469008318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:53 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-4537a3cb-a2ee-450b-9873-035f4b15a377 tempest-VolumesListAdminTestJSON-1469008318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:32:53 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-4537a3cb-a2ee-450b-9873-035f4b15a377 tempest-VolumesListAdminTestJSON-1469008318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:32:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-4537a3cb-a2ee-450b-9873-035f4b15a377 tempest-VolumesListAdminTestJSON-1469008318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:53 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-4537a3cb-a2ee-450b-9873-035f4b15a377 tempest-VolumesListAdminTestJSON-1469008318 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:32:53 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-4537a3cb-a2ee-450b-9873-035f4b15a377 tempest-VolumesListAdminTestJSON-1469008318 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:32:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4537a3cb-a2ee-450b-9873-035f4b15a377 tempest-VolumesListAdminTestJSON-1469008318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b29a943a-6de2-4bc9-b30c-5b261ca62aad 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:53 devstack sudo[93594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b29a943a-6de2-4bc9-b30c-5b261ca62aad 1073741824 Nov 03 07:32:53 devstack sudo[93594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:53 devstack sudo[93594]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4537a3cb-a2ee-450b-9873-035f4b15a377 tempest-VolumesListAdminTestJSON-1469008318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b29a943a-6de2-4bc9-b30c-5b261ca62aad 1073741824" returned: 0 in 0.564s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4537a3cb-a2ee-450b-9873-035f4b15a377 tempest-VolumesListAdminTestJSON-1469008318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b29a943a-6de2-4bc9-b30c-5b261ca62aad {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:53 devstack sudo[93600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b29a943a-6de2-4bc9-b30c-5b261ca62aad Nov 03 07:32:53 devstack sudo[93600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:54 devstack sudo[93600]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4537a3cb-a2ee-450b-9873-035f4b15a377 tempest-VolumesListAdminTestJSON-1469008318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b29a943a-6de2-4bc9-b30c-5b261ca62aad" returned: 0 in 0.374s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:54 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-4537a3cb-a2ee-450b-9873-035f4b15a377 tempest-VolumesListAdminTestJSON-1469008318 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:32:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-4537a3cb-a2ee-450b-9873-035f4b15a377 tempest-VolumesListAdminTestJSON-1469008318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:54 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4537a3cb-a2ee-450b-9873-035f4b15a377 tempest-VolumesListAdminTestJSON-1469008318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33072724-d09f-4292-950f-d870d610633b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b29a943a-6de2-4bc9-b30c-5b261ca62aad', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:54 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4537a3cb-a2ee-450b-9873-035f4b15a377 tempest-VolumesListAdminTestJSON-1469008318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f922987-07ad-48f8-87e8-fa0e13a2977c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:54 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ec73a8c6-ce50-4eb3-ba7b-52fbca401d51 tempest-VolumesExtendTest-865095625 None] Acquiring lock "cinder-daf8355e-0f4e-4fbf-888b-f1bc2dedf42b-delete_snapshot" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:32:54 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-4537a3cb-a2ee-450b-9873-035f4b15a377 tempest-VolumesListAdminTestJSON-1469008318 None] Volume volume-b29a943a-6de2-4bc9-b30c-5b261ca62aad (b29a943a-6de2-4bc9-b30c-5b261ca62aad): created successfully Nov 03 07:32:54 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4537a3cb-a2ee-450b-9873-035f4b15a377 tempest-VolumesListAdminTestJSON-1469008318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f922987-07ad-48f8-87e8-fa0e13a2977c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:54 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4537a3cb-a2ee-450b-9873-035f4b15a377 tempest-VolumesListAdminTestJSON-1469008318 None] Flow 'volume_create_manager' (7aeedb65-ef55-48ba-af20-8f05990f4fee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:32:54 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ec73a8c6-ce50-4eb3-ba7b-52fbca401d51 tempest-VolumesExtendTest-865095625 None] Lock "cinder-daf8355e-0f4e-4fbf-888b-f1bc2dedf42b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:32:54 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ec73a8c6-ce50-4eb3-ba7b-52fbca401d51 tempest-VolumesExtendTest-865095625 None] Acquiring lock "cinder-quobyte-f9112504-d11f-48f9-8433-90b0c0d1c4cc" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:32:54 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-4537a3cb-a2ee-450b-9873-035f4b15a377 tempest-VolumesListAdminTestJSON-1469008318 None] Created volume successfully. Nov 03 07:32:54 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ec73a8c6-ce50-4eb3-ba7b-52fbca401d51 tempest-VolumesExtendTest-865095625 None] Lock "cinder-quobyte-f9112504-d11f-48f9-8433-90b0c0d1c4cc" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:32:54 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ec73a8c6-ce50-4eb3-ba7b-52fbca401d51 tempest-VolumesExtendTest-865095625 None] Acquiring lock "cinder-quobyte-daf8355e-0f4e-4fbf-888b-f1bc2dedf42b" by "_delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:32:54 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ec73a8c6-ce50-4eb3-ba7b-52fbca401d51 tempest-VolumesExtendTest-865095625 None] Lock "cinder-quobyte-daf8355e-0f4e-4fbf-888b-f1bc2dedf42b" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:32:54 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-ec73a8c6-ce50-4eb3-ba7b-52fbca401d51 tempest-VolumesExtendTest-865095625 None] Deleting offline snapshot daf8355e-0f4e-4fbf-888b-f1bc2dedf42b of volume f9112504-d11f-48f9-8433-90b0c0d1c4cc {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:32:54 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-ec73a8c6-ce50-4eb3-ba7b-52fbca401d51 tempest-VolumesExtendTest-865095625 None] snapshot_file for this snap is: volume-f9112504-d11f-48f9-8433-90b0c0d1c4cc.daf8355e-0f4e-4fbf-888b-f1bc2dedf42b {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:32:54 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b676fb-3c10-4d30-a638-fd22d6f59db8]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:32:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ec73a8c6-ce50-4eb3-ba7b-52fbca401d51 tempest-VolumesExtendTest-865095625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9112504-d11f-48f9-8433-90b0c0d1c4cc.daf8355e-0f4e-4fbf-888b-f1bc2dedf42b {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:54 devstack sudo[93603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9112504-d11f-48f9-8433-90b0c0d1c4cc.daf8355e-0f4e-4fbf-888b-f1bc2dedf42b Nov 03 07:32:54 devstack sudo[93603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:54 devstack sudo[93603]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ec73a8c6-ce50-4eb3-ba7b-52fbca401d51 tempest-VolumesExtendTest-865095625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9112504-d11f-48f9-8433-90b0c0d1c4cc.daf8355e-0f4e-4fbf-888b-f1bc2dedf42b" returned: 0 in 0.497s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:54 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-ec73a8c6-ce50-4eb3-ba7b-52fbca401d51 tempest-VolumesExtendTest-865095625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9112504-d11f-48f9-8433-90b0c0d1c4cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:32:54 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[113c0eab-1993-4369-a5b9-c008881df607]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:32:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ec73a8c6-ce50-4eb3-ba7b-52fbca401d51 tempest-VolumesExtendTest-865095625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9112504-d11f-48f9-8433-90b0c0d1c4cc {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:54 devstack sudo[93618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9112504-d11f-48f9-8433-90b0c0d1c4cc Nov 03 07:32:54 devstack sudo[93618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:55 devstack sudo[93618]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ec73a8c6-ce50-4eb3-ba7b-52fbca401d51 tempest-VolumesExtendTest-865095625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9112504-d11f-48f9-8433-90b0c0d1c4cc" returned: 0 in 0.590s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ec73a8c6-ce50-4eb3-ba7b-52fbca401d51 tempest-VolumesExtendTest-865095625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9112504-d11f-48f9-8433-90b0c0d1c4cc.daf8355e-0f4e-4fbf-888b-f1bc2dedf42b {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:55 devstack sudo[93625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9112504-d11f-48f9-8433-90b0c0d1c4cc.daf8355e-0f4e-4fbf-888b-f1bc2dedf42b Nov 03 07:32:55 devstack sudo[93625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:55 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:UPDATE=143,cinder:SELECT=107,cinder:DELETE=15,cinder:INSERT=34 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:32:55 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:UPDATE=135,cinder:SELECT=133,cinder:INSERT=36,cinder:DELETE=9 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:32:55 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-12f18077-6e56-4f0b-b48c-a0d8d6f20479 tempest-VolumesListAdminTestJSON-1469008318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:32:55 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-12f18077-6e56-4f0b-b48c-a0d8d6f20479 tempest-VolumesListAdminTestJSON-1469008318 None] Flow 'volume_create_manager' (740031e7-ab08-4972-a534-5e4c5257af84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:32:55 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-12f18077-6e56-4f0b-b48c-a0d8d6f20479 tempest-VolumesListAdminTestJSON-1469008318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd6671c1-21fa-42e3-990c-fae3323dbcc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:55 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-12f18077-6e56-4f0b-b48c-a0d8d6f20479 tempest-VolumesListAdminTestJSON-1469008318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd6671c1-21fa-42e3-990c-fae3323dbcc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:32:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-431851874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=145fc931-915a-4598-95ee-8225ee96019b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13ddb2d42756482697593c4d5b277e85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:32:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:32:56Z,use_quota=True,user_id='73cf360f546c43b5b7f3fe456f6f0dad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:55 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-12f18077-6e56-4f0b-b48c-a0d8d6f20479 tempest-VolumesListAdminTestJSON-1469008318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c42417b1-3794-4844-993e-4b0ab28a59c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:55 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-12f18077-6e56-4f0b-b48c-a0d8d6f20479 tempest-VolumesListAdminTestJSON-1469008318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c42417b1-3794-4844-993e-4b0ab28a59c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:55 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-12f18077-6e56-4f0b-b48c-a0d8d6f20479 tempest-VolumesListAdminTestJSON-1469008318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53e7c086-123c-44db-b30e-b0f9a813d06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:55 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-12f18077-6e56-4f0b-b48c-a0d8d6f20479 tempest-VolumesListAdminTestJSON-1469008318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53e7c086-123c-44db-b30e-b0f9a813d06a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '145fc931-915a-4598-95ee-8225ee96019b', 'volume_name': 'volume-145fc931-915a-4598-95ee-8225ee96019b', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:55 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-12f18077-6e56-4f0b-b48c-a0d8d6f20479 tempest-VolumesListAdminTestJSON-1469008318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf310ab7-f7ff-4e30-bbb8-5b105645a639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:55 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-12f18077-6e56-4f0b-b48c-a0d8d6f20479 tempest-VolumesListAdminTestJSON-1469008318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf310ab7-f7ff-4e30-bbb8-5b105645a639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:55 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-12f18077-6e56-4f0b-b48c-a0d8d6f20479 tempest-VolumesListAdminTestJSON-1469008318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5533125-7eaa-406f-bfd9-bd17b6d86ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:55 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-12f18077-6e56-4f0b-b48c-a0d8d6f20479 tempest-VolumesListAdminTestJSON-1469008318 None] Volume 145fc931-915a-4598-95ee-8225ee96019b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-145fc931-915a-4598-95ee-8225ee96019b', 'volume_size': 1} Nov 03 07:32:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-12f18077-6e56-4f0b-b48c-a0d8d6f20479 tempest-VolumesListAdminTestJSON-1469008318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-12f18077-6e56-4f0b-b48c-a0d8d6f20479 tempest-VolumesListAdminTestJSON-1469008318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:55 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-12f18077-6e56-4f0b-b48c-a0d8d6f20479 tempest-VolumesListAdminTestJSON-1469008318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:32:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-431851874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=145fc931-915a-4598-95ee-8225ee96019b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13ddb2d42756482697593c4d5b277e85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:32:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:32:56Z,use_quota=True,user_id='73cf360f546c43b5b7f3fe456f6f0dad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:32:55 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-12f18077-6e56-4f0b-b48c-a0d8d6f20479 tempest-VolumesListAdminTestJSON-1469008318 None] Creating volume 145fc931-915a-4598-95ee-8225ee96019b {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:32:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-12f18077-6e56-4f0b-b48c-a0d8d6f20479 tempest-VolumesListAdminTestJSON-1469008318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-12f18077-6e56-4f0b-b48c-a0d8d6f20479 tempest-VolumesListAdminTestJSON-1469008318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:55 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-12f18077-6e56-4f0b-b48c-a0d8d6f20479 tempest-VolumesListAdminTestJSON-1469008318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:32:55 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-12f18077-6e56-4f0b-b48c-a0d8d6f20479 tempest-VolumesListAdminTestJSON-1469008318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:32:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-12f18077-6e56-4f0b-b48c-a0d8d6f20479 tempest-VolumesListAdminTestJSON-1469008318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:55 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-12f18077-6e56-4f0b-b48c-a0d8d6f20479 tempest-VolumesListAdminTestJSON-1469008318 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:32:55 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-12f18077-6e56-4f0b-b48c-a0d8d6f20479 tempest-VolumesListAdminTestJSON-1469008318 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:32:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-12f18077-6e56-4f0b-b48c-a0d8d6f20479 tempest-VolumesListAdminTestJSON-1469008318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-145fc931-915a-4598-95ee-8225ee96019b 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:55 devstack sudo[93630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-145fc931-915a-4598-95ee-8225ee96019b 1073741824 Nov 03 07:32:55 devstack sudo[93630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:55 devstack sudo[93625]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ec73a8c6-ce50-4eb3-ba7b-52fbca401d51 tempest-VolumesExtendTest-865095625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9112504-d11f-48f9-8433-90b0c0d1c4cc.daf8355e-0f4e-4fbf-888b-f1bc2dedf42b" returned: 0 in 0.524s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ec73a8c6-ce50-4eb3-ba7b-52fbca401d51 tempest-VolumesExtendTest-865095625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9112504-d11f-48f9-8433-90b0c0d1c4cc.daf8355e-0f4e-4fbf-888b-f1bc2dedf42b {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:55 devstack sudo[93632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9112504-d11f-48f9-8433-90b0c0d1c4cc.daf8355e-0f4e-4fbf-888b-f1bc2dedf42b Nov 03 07:32:55 devstack sudo[93632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:56 devstack sudo[93632]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ec73a8c6-ce50-4eb3-ba7b-52fbca401d51 tempest-VolumesExtendTest-865095625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9112504-d11f-48f9-8433-90b0c0d1c4cc.daf8355e-0f4e-4fbf-888b-f1bc2dedf42b" returned: 0 in 0.377s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:56 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ec73a8c6-ce50-4eb3-ba7b-52fbca401d51 tempest-VolumesExtendTest-865095625 None] Lock "cinder-quobyte-daf8355e-0f4e-4fbf-888b-f1bc2dedf42b" released by "_delete_snapshot" :: held 2.181s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:56 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ec73a8c6-ce50-4eb3-ba7b-52fbca401d51 tempest-VolumesExtendTest-865095625 None] Lock "cinder-quobyte-f9112504-d11f-48f9-8433-90b0c0d1c4cc" released by "delete_snapshot" :: held 2.217s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:56 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-ec73a8c6-ce50-4eb3-ba7b-52fbca401d51 tempest-VolumesExtendTest-865095625 None] Created reservations ['00d5fa8f-6a3e-43fc-b9c6-422b776c0805', '6f71d294-69c6-4c33-9c67-44fd72675f47', 'b18b45ee-53a9-4a8c-a456-ffa7d7bc95f0', 'c71d3334-a023-4299-aeec-f578ed649068'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:32:56 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-ec73a8c6-ce50-4eb3-ba7b-52fbca401d51 tempest-VolumesExtendTest-865095625 None] Delete snapshot completed successfully. Nov 03 07:32:56 devstack sudo[93630]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-12f18077-6e56-4f0b-b48c-a0d8d6f20479 tempest-VolumesListAdminTestJSON-1469008318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-145fc931-915a-4598-95ee-8225ee96019b 1073741824" returned: 0 in 0.958s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:56 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ec73a8c6-ce50-4eb3-ba7b-52fbca401d51 tempest-VolumesExtendTest-865095625 None] Lock "cinder-daf8355e-0f4e-4fbf-888b-f1bc2dedf42b-delete_snapshot" released by "delete_snapshot" :: held 2.664s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-12f18077-6e56-4f0b-b48c-a0d8d6f20479 tempest-VolumesListAdminTestJSON-1469008318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-145fc931-915a-4598-95ee-8225ee96019b {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:56 devstack sudo[93658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-145fc931-915a-4598-95ee-8225ee96019b Nov 03 07:32:56 devstack sudo[93658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:57 devstack sudo[93658]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-12f18077-6e56-4f0b-b48c-a0d8d6f20479 tempest-VolumesListAdminTestJSON-1469008318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-145fc931-915a-4598-95ee-8225ee96019b" returned: 0 in 0.340s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:57 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-12f18077-6e56-4f0b-b48c-a0d8d6f20479 tempest-VolumesListAdminTestJSON-1469008318 None] <== create_volume: return (1390ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:32:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-12f18077-6e56-4f0b-b48c-a0d8d6f20479 tempest-VolumesListAdminTestJSON-1469008318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.393s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:57 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-12f18077-6e56-4f0b-b48c-a0d8d6f20479 tempest-VolumesListAdminTestJSON-1469008318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5533125-7eaa-406f-bfd9-bd17b6d86ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-145fc931-915a-4598-95ee-8225ee96019b', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:57 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-12f18077-6e56-4f0b-b48c-a0d8d6f20479 tempest-VolumesListAdminTestJSON-1469008318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (913d8ac2-f44c-477e-8d1f-74f700229237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:57 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-12f18077-6e56-4f0b-b48c-a0d8d6f20479 tempest-VolumesListAdminTestJSON-1469008318 None] Volume volume-145fc931-915a-4598-95ee-8225ee96019b (145fc931-915a-4598-95ee-8225ee96019b): created successfully Nov 03 07:32:57 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-12f18077-6e56-4f0b-b48c-a0d8d6f20479 tempest-VolumesListAdminTestJSON-1469008318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (913d8ac2-f44c-477e-8d1f-74f700229237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:57 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-12f18077-6e56-4f0b-b48c-a0d8d6f20479 tempest-VolumesListAdminTestJSON-1469008318 None] Flow 'volume_create_manager' (740031e7-ab08-4972-a534-5e4c5257af84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:32:57 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-12f18077-6e56-4f0b-b48c-a0d8d6f20479 tempest-VolumesListAdminTestJSON-1469008318 None] Created volume successfully. Nov 03 07:32:57 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-677a080f-e5c7-49ab-bc5e-9fc39b7649cd tempest-VolumesExtendTest-865095625 None] Acquiring lock "cinder-f9112504-d11f-48f9-8433-90b0c0d1c4cc-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:32:57 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-677a080f-e5c7-49ab-bc5e-9fc39b7649cd tempest-VolumesExtendTest-865095625 None] Lock "cinder-f9112504-d11f-48f9-8433-90b0c0d1c4cc-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:32:57 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-677a080f-e5c7-49ab-bc5e-9fc39b7649cd tempest-VolumesExtendTest-865095625 None] Acquiring lock "cinder-quobyte-f9112504-d11f-48f9-8433-90b0c0d1c4cc" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:32:57 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-677a080f-e5c7-49ab-bc5e-9fc39b7649cd tempest-VolumesExtendTest-865095625 None] Lock "cinder-quobyte-f9112504-d11f-48f9-8433-90b0c0d1c4cc" acquired by "delete_volume" :: waited 0.044s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:32:57 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3ec4d6-4da6-4a10-914a-a8e4b81ff22e]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:32:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-677a080f-e5c7-49ab-bc5e-9fc39b7649cd tempest-VolumesExtendTest-865095625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9112504-d11f-48f9-8433-90b0c0d1c4cc {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:58 devstack sudo[93667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9112504-d11f-48f9-8433-90b0c0d1c4cc Nov 03 07:32:58 devstack sudo[93667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:58 devstack sudo[93667]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-677a080f-e5c7-49ab-bc5e-9fc39b7649cd tempest-VolumesExtendTest-865095625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9112504-d11f-48f9-8433-90b0c0d1c4cc" returned: 0 in 0.629s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-677a080f-e5c7-49ab-bc5e-9fc39b7649cd tempest-VolumesExtendTest-865095625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9112504-d11f-48f9-8433-90b0c0d1c4cc {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:58 devstack sudo[93674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9112504-d11f-48f9-8433-90b0c0d1c4cc Nov 03 07:32:58 devstack sudo[93674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:58 devstack sudo[93674]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-677a080f-e5c7-49ab-bc5e-9fc39b7649cd tempest-VolumesExtendTest-865095625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9112504-d11f-48f9-8433-90b0c0d1c4cc" returned: 0 in 0.378s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:58 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-677a080f-e5c7-49ab-bc5e-9fc39b7649cd tempest-VolumesExtendTest-865095625 None] Lock "cinder-quobyte-f9112504-d11f-48f9-8433-90b0c0d1c4cc" released by "delete_volume" :: held 1.188s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:58 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-677a080f-e5c7-49ab-bc5e-9fc39b7649cd tempest-VolumesExtendTest-865095625 None] Created reservations ['543153b9-8c68-4dd4-84f1-755e683d102a', '2a607216-e832-4953-b425-592c519781b6', '734de79a-8238-4787-b674-2265f5ff8289', '80cca11b-403a-4799-9f9b-b677d0edd1d7'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:32:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-677a080f-e5c7-49ab-bc5e-9fc39b7649cd tempest-VolumesExtendTest-865095625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-677a080f-e5c7-49ab-bc5e-9fc39b7649cd tempest-VolumesExtendTest-865095625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:59 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-677a080f-e5c7-49ab-bc5e-9fc39b7649cd tempest-VolumesExtendTest-865095625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:32:59 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-677a080f-e5c7-49ab-bc5e-9fc39b7649cd tempest-VolumesExtendTest-865095625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:32:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-677a080f-e5c7-49ab-bc5e-9fc39b7649cd tempest-VolumesExtendTest-865095625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-677a080f-e5c7-49ab-bc5e-9fc39b7649cd tempest-VolumesExtendTest-865095625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:59 devstack sudo[93677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:32:59 devstack sudo[93677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:59 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-637ab055-0e80-43a9-b675-b69193311df3 tempest-VolumesListAdminTestJSON-726284880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:32:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-637ab055-0e80-43a9-b675-b69193311df3 tempest-VolumesListAdminTestJSON-726284880 None] Flow 'volume_create_manager' (949ad691-fd2c-46c8-b8ae-e15da8e0904d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:32:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-637ab055-0e80-43a9-b675-b69193311df3 tempest-VolumesListAdminTestJSON-726284880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1678baf-9633-49d5-9b76-8b115471880f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-637ab055-0e80-43a9-b675-b69193311df3 tempest-VolumesListAdminTestJSON-726284880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1678baf-9633-49d5-9b76-8b115471880f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:32:59Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f158b31-721b-4fdb-bef8-e8bf3e36adf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e57b0852435945b391904ac60c9add3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:32:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:32:59Z,use_quota=True,user_id='45b9a4f21041406c870e44df8f0d35fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-637ab055-0e80-43a9-b675-b69193311df3 tempest-VolumesListAdminTestJSON-726284880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bfe78dc-85c7-4ec5-be64-c1b04544f518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-637ab055-0e80-43a9-b675-b69193311df3 tempest-VolumesListAdminTestJSON-726284880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bfe78dc-85c7-4ec5-be64-c1b04544f518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-637ab055-0e80-43a9-b675-b69193311df3 tempest-VolumesListAdminTestJSON-726284880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e7bfb2b-191b-41fd-aab3-b432f7d69f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-637ab055-0e80-43a9-b675-b69193311df3 tempest-VolumesListAdminTestJSON-726284880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e7bfb2b-191b-41fd-aab3-b432f7d69f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f158b31-721b-4fdb-bef8-e8bf3e36adf2', 'volume_name': 'volume-7f158b31-721b-4fdb-bef8-e8bf3e36adf2', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-637ab055-0e80-43a9-b675-b69193311df3 tempest-VolumesListAdminTestJSON-726284880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce39e903-cd04-4f02-be94-c58562f5bc9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-637ab055-0e80-43a9-b675-b69193311df3 tempest-VolumesListAdminTestJSON-726284880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce39e903-cd04-4f02-be94-c58562f5bc9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:32:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-637ab055-0e80-43a9-b675-b69193311df3 tempest-VolumesListAdminTestJSON-726284880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abe38041-8076-4fd2-8a31-ff8281b42d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:32:59 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-637ab055-0e80-43a9-b675-b69193311df3 tempest-VolumesListAdminTestJSON-726284880 None] Volume 7f158b31-721b-4fdb-bef8-e8bf3e36adf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f158b31-721b-4fdb-bef8-e8bf3e36adf2', 'volume_size': 1} Nov 03 07:32:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-637ab055-0e80-43a9-b675-b69193311df3 tempest-VolumesListAdminTestJSON-726284880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-637ab055-0e80-43a9-b675-b69193311df3 tempest-VolumesListAdminTestJSON-726284880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:59 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-637ab055-0e80-43a9-b675-b69193311df3 tempest-VolumesListAdminTestJSON-726284880 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:32:59Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f158b31-721b-4fdb-bef8-e8bf3e36adf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e57b0852435945b391904ac60c9add3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:32:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:32:59Z,use_quota=True,user_id='45b9a4f21041406c870e44df8f0d35fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:32:59 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-637ab055-0e80-43a9-b675-b69193311df3 tempest-VolumesListAdminTestJSON-726284880 None] Creating volume 7f158b31-721b-4fdb-bef8-e8bf3e36adf2 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:32:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-637ab055-0e80-43a9-b675-b69193311df3 tempest-VolumesListAdminTestJSON-726284880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:32:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-637ab055-0e80-43a9-b675-b69193311df3 tempest-VolumesListAdminTestJSON-726284880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:32:59 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-637ab055-0e80-43a9-b675-b69193311df3 tempest-VolumesListAdminTestJSON-726284880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:32:59 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-637ab055-0e80-43a9-b675-b69193311df3 tempest-VolumesListAdminTestJSON-726284880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:32:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-637ab055-0e80-43a9-b675-b69193311df3 tempest-VolumesListAdminTestJSON-726284880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:32:59 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-637ab055-0e80-43a9-b675-b69193311df3 tempest-VolumesListAdminTestJSON-726284880 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:32:59 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-637ab055-0e80-43a9-b675-b69193311df3 tempest-VolumesListAdminTestJSON-726284880 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:32:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-637ab055-0e80-43a9-b675-b69193311df3 tempest-VolumesListAdminTestJSON-726284880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7f158b31-721b-4fdb-bef8-e8bf3e36adf2 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:32:59 devstack sudo[93679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7f158b31-721b-4fdb-bef8-e8bf3e36adf2 1073741824 Nov 03 07:32:59 devstack sudo[93679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:32:59 devstack sudo[93677]: pam_unix(sudo:session): session closed for user root Nov 03 07:32:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-677a080f-e5c7-49ab-bc5e-9fc39b7649cd tempest-VolumesExtendTest-865095625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.348s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:59 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-677a080f-e5c7-49ab-bc5e-9fc39b7649cd tempest-VolumesExtendTest-865095625 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:32:59 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-677a080f-e5c7-49ab-bc5e-9fc39b7649cd tempest-VolumesExtendTest-865095625 None] Deleted volume successfully. Nov 03 07:32:59 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-677a080f-e5c7-49ab-bc5e-9fc39b7649cd tempest-VolumesExtendTest-865095625 None] Lock "cinder-f9112504-d11f-48f9-8433-90b0c0d1c4cc-delete_volume" released by "delete_volume" :: held 1.936s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:32:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-637ab055-0e80-43a9-b675-b69193311df3 tempest-VolumesListAdminTestJSON-726284880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7f158b31-721b-4fdb-bef8-e8bf3e36adf2 1073741824" returned: 0 in 0.644s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:32:59 devstack sudo[93679]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:00 devstack cinder-volume[86875]: INFO cinder.volume.manager [req-b6146fee-6852-44c8-ab11-87aa0d7daeb2 req-cf97139f-2064-47bb-b101-6df1d56d3369 tempest-ServerActionsTestOtherA-1944466382 None] Terminate volume connection completed successfully. Nov 03 07:33:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-b6146fee-6852-44c8-ab11-87aa0d7daeb2 req-cf97139f-2064-47bb-b101-6df1d56d3369 tempest-ServerActionsTestOtherA-1944466382 None] Deleting attachment 049cc146-040a-4d3d-869c-ab9a69192bd2. {{(pid=86875) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:33:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-637ab055-0e80-43a9-b675-b69193311df3 tempest-VolumesListAdminTestJSON-726284880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7f158b31-721b-4fdb-bef8-e8bf3e36adf2 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:00 devstack sudo[93687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7f158b31-721b-4fdb-bef8-e8bf3e36adf2 Nov 03 07:33:00 devstack sudo[93687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:00 devstack cinder-volume[86875]: DEBUG cinder.coordination [req-b6146fee-6852-44c8-ab11-87aa0d7daeb2 req-f5fa9da4-5b43-4bdb-a422-7940a281bcd2 tempest-ServerActionsTestOtherA-1944466382 None] Acquiring lock "cinder-a6ce31ba-b408-4a95-8d8b-143709c51ec0-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:33:00 devstack cinder-volume[86875]: DEBUG cinder.coordination [req-b6146fee-6852-44c8-ab11-87aa0d7daeb2 req-f5fa9da4-5b43-4bdb-a422-7940a281bcd2 tempest-ServerActionsTestOtherA-1944466382 None] Lock "cinder-a6ce31ba-b408-4a95-8d8b-143709c51ec0-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:33:00 devstack sudo[93687]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-637ab055-0e80-43a9-b675-b69193311df3 tempest-VolumesListAdminTestJSON-726284880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7f158b31-721b-4fdb-bef8-e8bf3e36adf2" returned: 0 in 0.392s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:00 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-637ab055-0e80-43a9-b675-b69193311df3 tempest-VolumesListAdminTestJSON-726284880 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:33:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-637ab055-0e80-43a9-b675-b69193311df3 tempest-VolumesListAdminTestJSON-726284880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-637ab055-0e80-43a9-b675-b69193311df3 tempest-VolumesListAdminTestJSON-726284880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abe38041-8076-4fd2-8a31-ff8281b42d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f158b31-721b-4fdb-bef8-e8bf3e36adf2', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-637ab055-0e80-43a9-b675-b69193311df3 tempest-VolumesListAdminTestJSON-726284880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b47e97d-ae85-4555-9696-ac85be4b7fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:00 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-637ab055-0e80-43a9-b675-b69193311df3 tempest-VolumesListAdminTestJSON-726284880 None] Volume volume-7f158b31-721b-4fdb-bef8-e8bf3e36adf2 (7f158b31-721b-4fdb-bef8-e8bf3e36adf2): created successfully Nov 03 07:33:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-637ab055-0e80-43a9-b675-b69193311df3 tempest-VolumesListAdminTestJSON-726284880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b47e97d-ae85-4555-9696-ac85be4b7fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-637ab055-0e80-43a9-b675-b69193311df3 tempest-VolumesListAdminTestJSON-726284880 None] Flow 'volume_create_manager' (949ad691-fd2c-46c8-b8ae-e15da8e0904d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:33:00 devstack cinder-volume[86875]: DEBUG cinder.coordination [req-b6146fee-6852-44c8-ab11-87aa0d7daeb2 req-f5fa9da4-5b43-4bdb-a422-7940a281bcd2 tempest-ServerActionsTestOtherA-1944466382 None] Acquiring lock "cinder-quobyte-a6ce31ba-b408-4a95-8d8b-143709c51ec0" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:33:00 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-637ab055-0e80-43a9-b675-b69193311df3 tempest-VolumesListAdminTestJSON-726284880 None] Created volume successfully. Nov 03 07:33:00 devstack cinder-volume[86875]: DEBUG cinder.coordination [req-b6146fee-6852-44c8-ab11-87aa0d7daeb2 req-f5fa9da4-5b43-4bdb-a422-7940a281bcd2 tempest-ServerActionsTestOtherA-1944466382 None] Lock "cinder-quobyte-a6ce31ba-b408-4a95-8d8b-143709c51ec0" acquired by "delete_volume" :: waited 0.030s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:33:00 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[96fbcf4a-ef01-411b-a18b-f88babf4461c]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:33:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [req-b6146fee-6852-44c8-ab11-87aa0d7daeb2 req-f5fa9da4-5b43-4bdb-a422-7940a281bcd2 tempest-ServerActionsTestOtherA-1944466382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a6ce31ba-b408-4a95-8d8b-143709c51ec0 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:00 devstack sudo[93690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a6ce31ba-b408-4a95-8d8b-143709c51ec0 Nov 03 07:33:00 devstack sudo[93690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:01 devstack sudo[93690]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [req-b6146fee-6852-44c8-ab11-87aa0d7daeb2 req-f5fa9da4-5b43-4bdb-a422-7940a281bcd2 tempest-ServerActionsTestOtherA-1944466382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a6ce31ba-b408-4a95-8d8b-143709c51ec0" returned: 0 in 0.457s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [req-b6146fee-6852-44c8-ab11-87aa0d7daeb2 req-f5fa9da4-5b43-4bdb-a422-7940a281bcd2 tempest-ServerActionsTestOtherA-1944466382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a6ce31ba-b408-4a95-8d8b-143709c51ec0 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:01 devstack sudo[93695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a6ce31ba-b408-4a95-8d8b-143709c51ec0 Nov 03 07:33:01 devstack sudo[93695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:01 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a2a06646-a876-400d-a033-34796077e421 tempest-ServerActionsTestOtherA-1944466382 None] Acquiring lock "cinder-2cedef2e-36c7-41b1-b810-af924a9eb4ec-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:33:01 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a2a06646-a876-400d-a033-34796077e421 tempest-ServerActionsTestOtherA-1944466382 None] Lock "cinder-2cedef2e-36c7-41b1-b810-af924a9eb4ec-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:33:01 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-62939779-a32d-4be8-aaf2-219e75781cd7 tempest-VolumesListAdminTestJSON-726284880 None] Acquiring lock "cinder-7f158b31-721b-4fdb-bef8-e8bf3e36adf2-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:33:01 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-62939779-a32d-4be8-aaf2-219e75781cd7 tempest-VolumesListAdminTestJSON-726284880 None] Lock "cinder-7f158b31-721b-4fdb-bef8-e8bf3e36adf2-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:33:01 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a2a06646-a876-400d-a033-34796077e421 tempest-ServerActionsTestOtherA-1944466382 None] Acquiring lock "cinder-quobyte-2cedef2e-36c7-41b1-b810-af924a9eb4ec" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:33:01 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a2a06646-a876-400d-a033-34796077e421 tempest-ServerActionsTestOtherA-1944466382 None] Lock "cinder-quobyte-2cedef2e-36c7-41b1-b810-af924a9eb4ec" acquired by "delete_volume" :: waited 0.035s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:33:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [req-b6146fee-6852-44c8-ab11-87aa0d7daeb2 req-f5fa9da4-5b43-4bdb-a422-7940a281bcd2 tempest-ServerActionsTestOtherA-1944466382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a6ce31ba-b408-4a95-8d8b-143709c51ec0" returned: 0 in 0.531s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:01 devstack sudo[93695]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:01 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[e039410d-455d-46eb-b654-947d5561ed27]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:33:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a2a06646-a876-400d-a033-34796077e421 tempest-ServerActionsTestOtherA-1944466382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2cedef2e-36c7-41b1-b810-af924a9eb4ec {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:01 devstack cinder-volume[86875]: DEBUG cinder.coordination [req-b6146fee-6852-44c8-ab11-87aa0d7daeb2 req-f5fa9da4-5b43-4bdb-a422-7940a281bcd2 tempest-ServerActionsTestOtherA-1944466382 None] Lock "cinder-quobyte-a6ce31ba-b408-4a95-8d8b-143709c51ec0" released by "delete_volume" :: held 1.108s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:33:01 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-62939779-a32d-4be8-aaf2-219e75781cd7 tempest-VolumesListAdminTestJSON-726284880 None] Acquiring lock "cinder-quobyte-7f158b31-721b-4fdb-bef8-e8bf3e36adf2" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:33:01 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-62939779-a32d-4be8-aaf2-219e75781cd7 tempest-VolumesListAdminTestJSON-726284880 None] Lock "cinder-quobyte-7f158b31-721b-4fdb-bef8-e8bf3e36adf2" acquired by "delete_volume" :: waited 0.037s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:33:01 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-e2f03a52-a569-4b39-8ee2-efbf36e9cbe3 tempest-VolumesListAdminTestJSON-1469008318 None] Acquiring lock "cinder-145fc931-915a-4598-95ee-8225ee96019b-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:33:01 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b94225-884c-4b09-8d29-3d67d97bc5fb]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:33:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-62939779-a32d-4be8-aaf2-219e75781cd7 tempest-VolumesListAdminTestJSON-726284880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7f158b31-721b-4fdb-bef8-e8bf3e36adf2 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:01 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-e2f03a52-a569-4b39-8ee2-efbf36e9cbe3 tempest-VolumesListAdminTestJSON-1469008318 None] Lock "cinder-145fc931-915a-4598-95ee-8225ee96019b-delete_volume" acquired by "delete_volume" :: waited 0.096s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:33:01 devstack sudo[93698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2cedef2e-36c7-41b1-b810-af924a9eb4ec Nov 03 07:33:01 devstack sudo[93698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:01 devstack cinder-volume[86875]: DEBUG cinder.quota [req-b6146fee-6852-44c8-ab11-87aa0d7daeb2 req-f5fa9da4-5b43-4bdb-a422-7940a281bcd2 tempest-ServerActionsTestOtherA-1944466382 None] Created reservations ['2fa5ea1d-8013-469b-b15d-1056287a022e', '2c898e21-1212-482e-891a-a61e5e28be28', '630bd9f6-4bca-4ad6-b086-c980cdeb1b0a', '570c4b5c-f22a-439e-8696-038b128422c3'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:33:01 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-e2f03a52-a569-4b39-8ee2-efbf36e9cbe3 tempest-VolumesListAdminTestJSON-1469008318 None] Acquiring lock "cinder-quobyte-145fc931-915a-4598-95ee-8225ee96019b" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:33:02 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-e2f03a52-a569-4b39-8ee2-efbf36e9cbe3 tempest-VolumesListAdminTestJSON-1469008318 None] Lock "cinder-quobyte-145fc931-915a-4598-95ee-8225ee96019b" acquired by "delete_volume" :: waited 0.060s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:33:02 devstack sudo[93699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7f158b31-721b-4fdb-bef8-e8bf3e36adf2 Nov 03 07:33:02 devstack sudo[93699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:02 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de049b7-1637-4ccc-b7b7-11682b26fbfd]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:33:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e2f03a52-a569-4b39-8ee2-efbf36e9cbe3 tempest-VolumesListAdminTestJSON-1469008318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-145fc931-915a-4598-95ee-8225ee96019b {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-b6146fee-6852-44c8-ab11-87aa0d7daeb2 req-f5fa9da4-5b43-4bdb-a422-7940a281bcd2 tempest-ServerActionsTestOtherA-1944466382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-b6146fee-6852-44c8-ab11-87aa0d7daeb2 req-f5fa9da4-5b43-4bdb-a422-7940a281bcd2 tempest-ServerActionsTestOtherA-1944466382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:02 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [req-b6146fee-6852-44c8-ab11-87aa0d7daeb2 req-f5fa9da4-5b43-4bdb-a422-7940a281bcd2 tempest-ServerActionsTestOtherA-1944466382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:33:02 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [req-b6146fee-6852-44c8-ab11-87aa0d7daeb2 req-f5fa9da4-5b43-4bdb-a422-7940a281bcd2 tempest-ServerActionsTestOtherA-1944466382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:33:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-b6146fee-6852-44c8-ab11-87aa0d7daeb2 req-f5fa9da4-5b43-4bdb-a422-7940a281bcd2 tempest-ServerActionsTestOtherA-1944466382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [req-b6146fee-6852-44c8-ab11-87aa0d7daeb2 req-f5fa9da4-5b43-4bdb-a422-7940a281bcd2 tempest-ServerActionsTestOtherA-1944466382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:02 devstack sudo[93703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:33:02 devstack sudo[93703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:02 devstack sudo[93702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-145fc931-915a-4598-95ee-8225ee96019b Nov 03 07:33:02 devstack sudo[93702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:02 devstack sudo[93698]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a2a06646-a876-400d-a033-34796077e421 tempest-ServerActionsTestOtherA-1944466382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2cedef2e-36c7-41b1-b810-af924a9eb4ec" returned: 0 in 0.783s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a2a06646-a876-400d-a033-34796077e421 tempest-ServerActionsTestOtherA-1944466382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2cedef2e-36c7-41b1-b810-af924a9eb4ec {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:02 devstack sudo[93709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2cedef2e-36c7-41b1-b810-af924a9eb4ec Nov 03 07:33:02 devstack sudo[93709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:02 devstack sudo[93699]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-62939779-a32d-4be8-aaf2-219e75781cd7 tempest-VolumesListAdminTestJSON-726284880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7f158b31-721b-4fdb-bef8-e8bf3e36adf2" returned: 0 in 0.893s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-62939779-a32d-4be8-aaf2-219e75781cd7 tempest-VolumesListAdminTestJSON-726284880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7f158b31-721b-4fdb-bef8-e8bf3e36adf2 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:02 devstack sudo[93715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7f158b31-721b-4fdb-bef8-e8bf3e36adf2 Nov 03 07:33:02 devstack sudo[93715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:02 devstack sudo[93703]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [req-b6146fee-6852-44c8-ab11-87aa0d7daeb2 req-f5fa9da4-5b43-4bdb-a422-7940a281bcd2 tempest-ServerActionsTestOtherA-1944466382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.623s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:02 devstack cinder-volume[86875]: DEBUG cinder.manager [req-b6146fee-6852-44c8-ab11-87aa0d7daeb2 req-f5fa9da4-5b43-4bdb-a422-7940a281bcd2 tempest-ServerActionsTestOtherA-1944466382 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:33:02 devstack cinder-volume[86875]: INFO cinder.volume.manager [req-b6146fee-6852-44c8-ab11-87aa0d7daeb2 req-f5fa9da4-5b43-4bdb-a422-7940a281bcd2 tempest-ServerActionsTestOtherA-1944466382 None] Deleted volume successfully. Nov 03 07:33:02 devstack cinder-volume[86875]: DEBUG cinder.coordination [req-b6146fee-6852-44c8-ab11-87aa0d7daeb2 req-f5fa9da4-5b43-4bdb-a422-7940a281bcd2 tempest-ServerActionsTestOtherA-1944466382 None] Lock "cinder-a6ce31ba-b408-4a95-8d8b-143709c51ec0-delete_volume" released by "delete_volume" :: held 2.455s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:33:02 devstack sudo[93709]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a2a06646-a876-400d-a033-34796077e421 tempest-ServerActionsTestOtherA-1944466382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2cedef2e-36c7-41b1-b810-af924a9eb4ec" returned: 0 in 0.541s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:02 devstack sudo[93702]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e2f03a52-a569-4b39-8ee2-efbf36e9cbe3 tempest-VolumesListAdminTestJSON-1469008318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-145fc931-915a-4598-95ee-8225ee96019b" returned: 0 in 0.877s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e2f03a52-a569-4b39-8ee2-efbf36e9cbe3 tempest-VolumesListAdminTestJSON-1469008318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-145fc931-915a-4598-95ee-8225ee96019b {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:03 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a2a06646-a876-400d-a033-34796077e421 tempest-ServerActionsTestOtherA-1944466382 None] Lock "cinder-quobyte-2cedef2e-36c7-41b1-b810-af924a9eb4ec" released by "delete_volume" :: held 1.445s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:33:03 devstack sudo[93721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-145fc931-915a-4598-95ee-8225ee96019b Nov 03 07:33:03 devstack sudo[93721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:03 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-a2a06646-a876-400d-a033-34796077e421 tempest-ServerActionsTestOtherA-1944466382 None] Created reservations ['8d806aed-c89e-4d17-ba72-64274f6273a1', '31077582-8932-45bd-8e0e-e2e111abb591', '7e84f59c-9ced-4ac4-871d-fe0adc5b852c', '7a97a516-f6e7-4100-8976-da38737b7032'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:33:03 devstack sudo[93715]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-62939779-a32d-4be8-aaf2-219e75781cd7 tempest-VolumesListAdminTestJSON-726284880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7f158b31-721b-4fdb-bef8-e8bf3e36adf2" returned: 0 in 0.454s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:03 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-62939779-a32d-4be8-aaf2-219e75781cd7 tempest-VolumesListAdminTestJSON-726284880 None] Lock "cinder-quobyte-7f158b31-721b-4fdb-bef8-e8bf3e36adf2" released by "delete_volume" :: held 1.471s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:33:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a2a06646-a876-400d-a033-34796077e421 tempest-ServerActionsTestOtherA-1944466382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a2a06646-a876-400d-a033-34796077e421 tempest-ServerActionsTestOtherA-1944466382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a2a06646-a876-400d-a033-34796077e421 tempest-ServerActionsTestOtherA-1944466382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:33:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a2a06646-a876-400d-a033-34796077e421 tempest-ServerActionsTestOtherA-1944466382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:33:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a2a06646-a876-400d-a033-34796077e421 tempest-ServerActionsTestOtherA-1944466382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a2a06646-a876-400d-a033-34796077e421 tempest-ServerActionsTestOtherA-1944466382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:03 devstack sudo[93724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:33:03 devstack sudo[93724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:03 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-62939779-a32d-4be8-aaf2-219e75781cd7 tempest-VolumesListAdminTestJSON-726284880 None] Created reservations ['756a6b0e-ac96-4657-9405-2d0d084343ab', 'fd79f064-2095-4294-9082-8d1c988b152c', 'be648981-32de-4305-bd1f-27d28e143fc5', 'e9f4259d-d5f7-4076-81cb-c710f222f517'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:33:03 devstack sudo[93721]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e2f03a52-a569-4b39-8ee2-efbf36e9cbe3 tempest-VolumesListAdminTestJSON-1469008318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-145fc931-915a-4598-95ee-8225ee96019b" returned: 0 in 0.454s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-62939779-a32d-4be8-aaf2-219e75781cd7 tempest-VolumesListAdminTestJSON-726284880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-62939779-a32d-4be8-aaf2-219e75781cd7 tempest-VolumesListAdminTestJSON-726284880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-62939779-a32d-4be8-aaf2-219e75781cd7 tempest-VolumesListAdminTestJSON-726284880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:33:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-62939779-a32d-4be8-aaf2-219e75781cd7 tempest-VolumesListAdminTestJSON-726284880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:33:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-62939779-a32d-4be8-aaf2-219e75781cd7 tempest-VolumesListAdminTestJSON-726284880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-62939779-a32d-4be8-aaf2-219e75781cd7 tempest-VolumesListAdminTestJSON-726284880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:03 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-e2f03a52-a569-4b39-8ee2-efbf36e9cbe3 tempest-VolumesListAdminTestJSON-1469008318 None] Lock "cinder-quobyte-145fc931-915a-4598-95ee-8225ee96019b" released by "delete_volume" :: held 1.449s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:33:03 devstack sudo[93727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:33:03 devstack sudo[93727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:03 devstack cinder-volume[86875]: DEBUG oslo_service.periodic_task [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86875) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:33:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:33:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:33:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:03 devstack sudo[93729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:33:03 devstack sudo[93729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:03 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-e2f03a52-a569-4b39-8ee2-efbf36e9cbe3 tempest-VolumesListAdminTestJSON-1469008318 None] Created reservations ['1920ffaa-9c1d-491c-9c0f-098f7bd6328f', '91d730c2-1656-478b-b3f1-821b45b27f75', '126452b3-1a05-4534-bc13-1108237302d6', '90dbd0e1-78fa-4605-b031-2170bd62f6f2'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:33:03 devstack sudo[93724]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a2a06646-a876-400d-a033-34796077e421 tempest-ServerActionsTestOtherA-1944466382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.429s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:03 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-a2a06646-a876-400d-a033-34796077e421 tempest-ServerActionsTestOtherA-1944466382 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:33:03 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-a2a06646-a876-400d-a033-34796077e421 tempest-ServerActionsTestOtherA-1944466382 None] Deleted volume successfully. Nov 03 07:33:03 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a2a06646-a876-400d-a033-34796077e421 tempest-ServerActionsTestOtherA-1944466382 None] Lock "cinder-2cedef2e-36c7-41b1-b810-af924a9eb4ec-delete_volume" released by "delete_volume" :: held 2.350s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:33:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e2f03a52-a569-4b39-8ee2-efbf36e9cbe3 tempest-VolumesListAdminTestJSON-1469008318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e2f03a52-a569-4b39-8ee2-efbf36e9cbe3 tempest-VolumesListAdminTestJSON-1469008318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-e2f03a52-a569-4b39-8ee2-efbf36e9cbe3 tempest-VolumesListAdminTestJSON-1469008318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:33:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-e2f03a52-a569-4b39-8ee2-efbf36e9cbe3 tempest-VolumesListAdminTestJSON-1469008318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:33:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e2f03a52-a569-4b39-8ee2-efbf36e9cbe3 tempest-VolumesListAdminTestJSON-1469008318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e2f03a52-a569-4b39-8ee2-efbf36e9cbe3 tempest-VolumesListAdminTestJSON-1469008318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:03 devstack sudo[93732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:33:03 devstack sudo[93732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:04 devstack sudo[93727]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-62939779-a32d-4be8-aaf2-219e75781cd7 tempest-VolumesListAdminTestJSON-726284880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.530s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:04 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-62939779-a32d-4be8-aaf2-219e75781cd7 tempest-VolumesListAdminTestJSON-726284880 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:33:04 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-62939779-a32d-4be8-aaf2-219e75781cd7 tempest-VolumesListAdminTestJSON-726284880 None] Deleted volume successfully. Nov 03 07:33:04 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-62939779-a32d-4be8-aaf2-219e75781cd7 tempest-VolumesListAdminTestJSON-726284880 None] Lock "cinder-7f158b31-721b-4fdb-bef8-e8bf3e36adf2-delete_volume" released by "delete_volume" :: held 2.592s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:33:04 devstack sudo[93729]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.529s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:04 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:33:04 devstack cinder-volume[86875]: DEBUG oslo_service.periodic_task [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running periodic task VolumeManager._thread_info {{(pid=86875) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:33:04 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] thread count: 28 {{(pid=86875) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:33:04 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] thread info: [<_MainThread(MainThread, started 125626325639296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86875) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:33:04 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-7b610baf-713c-4995-ac7d-b8953a28154e tempest-VolumesListAdminTestJSON-1469008318 None] Acquiring lock "cinder-b29a943a-6de2-4bc9-b30c-5b261ca62aad-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:33:04 devstack sudo[93732]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e2f03a52-a569-4b39-8ee2-efbf36e9cbe3 tempest-VolumesListAdminTestJSON-1469008318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.697s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:04 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-e2f03a52-a569-4b39-8ee2-efbf36e9cbe3 tempest-VolumesListAdminTestJSON-1469008318 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:33:04 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-7b610baf-713c-4995-ac7d-b8953a28154e tempest-VolumesListAdminTestJSON-1469008318 None] Lock "cinder-b29a943a-6de2-4bc9-b30c-5b261ca62aad-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:33:04 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-e2f03a52-a569-4b39-8ee2-efbf36e9cbe3 tempest-VolumesListAdminTestJSON-1469008318 None] Deleted volume successfully. Nov 03 07:33:04 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-e2f03a52-a569-4b39-8ee2-efbf36e9cbe3 tempest-VolumesListAdminTestJSON-1469008318 None] Lock "cinder-145fc931-915a-4598-95ee-8225ee96019b-delete_volume" released by "delete_volume" :: held 2.847s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:33:04 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-7b610baf-713c-4995-ac7d-b8953a28154e tempest-VolumesListAdminTestJSON-1469008318 None] Acquiring lock "cinder-quobyte-b29a943a-6de2-4bc9-b30c-5b261ca62aad" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:33:04 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-7b610baf-713c-4995-ac7d-b8953a28154e tempest-VolumesListAdminTestJSON-1469008318 None] Lock "cinder-quobyte-b29a943a-6de2-4bc9-b30c-5b261ca62aad" acquired by "delete_volume" :: waited 0.032s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:33:04 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff12fb5-ef1b-4dd4-a114-df1c41afd970]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:33:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7b610baf-713c-4995-ac7d-b8953a28154e tempest-VolumesListAdminTestJSON-1469008318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b29a943a-6de2-4bc9-b30c-5b261ca62aad {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:04 devstack sudo[93755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b29a943a-6de2-4bc9-b30c-5b261ca62aad Nov 03 07:33:04 devstack sudo[93755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:05 devstack sudo[93755]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7b610baf-713c-4995-ac7d-b8953a28154e tempest-VolumesListAdminTestJSON-1469008318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b29a943a-6de2-4bc9-b30c-5b261ca62aad" returned: 0 in 0.501s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7b610baf-713c-4995-ac7d-b8953a28154e tempest-VolumesListAdminTestJSON-1469008318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b29a943a-6de2-4bc9-b30c-5b261ca62aad {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:05 devstack sudo[93765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b29a943a-6de2-4bc9-b30c-5b261ca62aad Nov 03 07:33:05 devstack sudo[93765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:05 devstack sudo[93765]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7b610baf-713c-4995-ac7d-b8953a28154e tempest-VolumesListAdminTestJSON-1469008318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b29a943a-6de2-4bc9-b30c-5b261ca62aad" returned: 0 in 0.392s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:05 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-7b610baf-713c-4995-ac7d-b8953a28154e tempest-VolumesListAdminTestJSON-1469008318 None] Lock "cinder-quobyte-b29a943a-6de2-4bc9-b30c-5b261ca62aad" released by "delete_volume" :: held 0.979s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:33:05 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-7b610baf-713c-4995-ac7d-b8953a28154e tempest-VolumesListAdminTestJSON-1469008318 None] Created reservations ['92ac1dae-da8f-41fa-9d41-7b3e4ac67a1f', '6d392c78-647e-46ea-ae26-32d40e295951', '44c2d471-97a2-451d-849b-bdbbde5577f4', '2338781c-9877-4c77-9a32-be12e3b43647'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:33:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7b610baf-713c-4995-ac7d-b8953a28154e tempest-VolumesListAdminTestJSON-1469008318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7b610baf-713c-4995-ac7d-b8953a28154e tempest-VolumesListAdminTestJSON-1469008318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:05 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-7b610baf-713c-4995-ac7d-b8953a28154e tempest-VolumesListAdminTestJSON-1469008318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:33:05 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-7b610baf-713c-4995-ac7d-b8953a28154e tempest-VolumesListAdminTestJSON-1469008318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:33:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7b610baf-713c-4995-ac7d-b8953a28154e tempest-VolumesListAdminTestJSON-1469008318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7b610baf-713c-4995-ac7d-b8953a28154e tempest-VolumesListAdminTestJSON-1469008318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:05 devstack sudo[93768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:33:05 devstack sudo[93768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:06 devstack sudo[93768]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7b610baf-713c-4995-ac7d-b8953a28154e tempest-VolumesListAdminTestJSON-1469008318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.365s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:06 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-7b610baf-713c-4995-ac7d-b8953a28154e tempest-VolumesListAdminTestJSON-1469008318 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:33:06 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-7b610baf-713c-4995-ac7d-b8953a28154e tempest-VolumesListAdminTestJSON-1469008318 None] Deleted volume successfully. Nov 03 07:33:06 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-7b610baf-713c-4995-ac7d-b8953a28154e tempest-VolumesListAdminTestJSON-1469008318 None] Lock "cinder-b29a943a-6de2-4bc9-b30c-5b261ca62aad-delete_volume" released by "delete_volume" :: held 1.868s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:33:07 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d8e4fa2b-e4b2-4d56-939a-bd0d010767fb tempest-VolumesListAdminTestJSON-1469008318 None] Acquiring lock "cinder-9f49626a-5079-4d38-8e7f-a2cca926318e-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:33:07 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d8e4fa2b-e4b2-4d56-939a-bd0d010767fb tempest-VolumesListAdminTestJSON-1469008318 None] Lock "cinder-9f49626a-5079-4d38-8e7f-a2cca926318e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:33:07 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d8e4fa2b-e4b2-4d56-939a-bd0d010767fb tempest-VolumesListAdminTestJSON-1469008318 None] Acquiring lock "cinder-quobyte-9f49626a-5079-4d38-8e7f-a2cca926318e" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:33:07 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d8e4fa2b-e4b2-4d56-939a-bd0d010767fb tempest-VolumesListAdminTestJSON-1469008318 None] Lock "cinder-quobyte-9f49626a-5079-4d38-8e7f-a2cca926318e" acquired by "delete_volume" :: waited 0.031s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:33:07 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bee34dc-914d-4834-98d2-e859016ff1a5]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:33:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d8e4fa2b-e4b2-4d56-939a-bd0d010767fb tempest-VolumesListAdminTestJSON-1469008318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f49626a-5079-4d38-8e7f-a2cca926318e {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:07 devstack sudo[93774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f49626a-5079-4d38-8e7f-a2cca926318e Nov 03 07:33:07 devstack sudo[93774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:08 devstack sudo[93774]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d8e4fa2b-e4b2-4d56-939a-bd0d010767fb tempest-VolumesListAdminTestJSON-1469008318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f49626a-5079-4d38-8e7f-a2cca926318e" returned: 0 in 0.663s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d8e4fa2b-e4b2-4d56-939a-bd0d010767fb tempest-VolumesListAdminTestJSON-1469008318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f49626a-5079-4d38-8e7f-a2cca926318e {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:08 devstack sudo[93779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f49626a-5079-4d38-8e7f-a2cca926318e Nov 03 07:33:08 devstack sudo[93779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:08 devstack sudo[93779]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d8e4fa2b-e4b2-4d56-939a-bd0d010767fb tempest-VolumesListAdminTestJSON-1469008318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f49626a-5079-4d38-8e7f-a2cca926318e" returned: 0 in 0.408s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:08 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d8e4fa2b-e4b2-4d56-939a-bd0d010767fb tempest-VolumesListAdminTestJSON-1469008318 None] Lock "cinder-quobyte-9f49626a-5079-4d38-8e7f-a2cca926318e" released by "delete_volume" :: held 1.149s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:33:08 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-d8e4fa2b-e4b2-4d56-939a-bd0d010767fb tempest-VolumesListAdminTestJSON-1469008318 None] Created reservations ['53488e03-720c-400f-ad58-9ac925d90ae7', '35669845-886a-444d-a84b-90f9e8c0acb8', '73474687-19c7-4984-ae87-665db8076461', '953a65ae-dcaa-43a3-97aa-b9a13f8f7f17'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:33:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-d8e4fa2b-e4b2-4d56-939a-bd0d010767fb tempest-VolumesListAdminTestJSON-1469008318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-d8e4fa2b-e4b2-4d56-939a-bd0d010767fb tempest-VolumesListAdminTestJSON-1469008318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:08 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-d8e4fa2b-e4b2-4d56-939a-bd0d010767fb tempest-VolumesListAdminTestJSON-1469008318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:33:08 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-d8e4fa2b-e4b2-4d56-939a-bd0d010767fb tempest-VolumesListAdminTestJSON-1469008318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:33:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-d8e4fa2b-e4b2-4d56-939a-bd0d010767fb tempest-VolumesListAdminTestJSON-1469008318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d8e4fa2b-e4b2-4d56-939a-bd0d010767fb tempest-VolumesListAdminTestJSON-1469008318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:08 devstack sudo[93782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:33:08 devstack sudo[93782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:09 devstack sudo[93782]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d8e4fa2b-e4b2-4d56-939a-bd0d010767fb tempest-VolumesListAdminTestJSON-1469008318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.322s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:09 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-d8e4fa2b-e4b2-4d56-939a-bd0d010767fb tempest-VolumesListAdminTestJSON-1469008318 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:33:09 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-d8e4fa2b-e4b2-4d56-939a-bd0d010767fb tempest-VolumesListAdminTestJSON-1469008318 None] Deleted volume successfully. Nov 03 07:33:09 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d8e4fa2b-e4b2-4d56-939a-bd0d010767fb tempest-VolumesListAdminTestJSON-1469008318 None] Lock "cinder-9f49626a-5079-4d38-8e7f-a2cca926318e-delete_volume" released by "delete_volume" :: held 1.864s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:33:13 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b50417f-b384-4d3f-9818-64952ea5b9cf tempest-VolumesListTestJSON-152154906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:33:13 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-9b50417f-b384-4d3f-9818-64952ea5b9cf tempest-VolumesListTestJSON-152154906 None] Flow 'volume_create_manager' (27ce8332-817f-472c-b019-1373f658f6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:33:13 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-9b50417f-b384-4d3f-9818-64952ea5b9cf tempest-VolumesListTestJSON-152154906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb47ec04-1269-4c37-b4a6-8253317d37f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:13 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-9b50417f-b384-4d3f-9818-64952ea5b9cf tempest-VolumesListTestJSON-152154906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb47ec04-1269-4c37-b4a6-8253317d37f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:33:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1306887047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6497f269-7fe8-4730-a01b-3c08649a3304,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='50f35b8e33f8432bbd709a41d5e7321a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:33:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:33:14Z,use_quota=True,user_id='47a28d91d4154023bfddbaa21c547589',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:13 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-9b50417f-b384-4d3f-9818-64952ea5b9cf tempest-VolumesListTestJSON-152154906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3aada29-2e7a-4806-8eaf-2fdeb8d13e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:13 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-9b50417f-b384-4d3f-9818-64952ea5b9cf tempest-VolumesListTestJSON-152154906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3aada29-2e7a-4806-8eaf-2fdeb8d13e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:13 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-9b50417f-b384-4d3f-9818-64952ea5b9cf tempest-VolumesListTestJSON-152154906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (754298fe-cfb4-45bb-ba37-6f8f97e1d901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:13 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-9b50417f-b384-4d3f-9818-64952ea5b9cf tempest-VolumesListTestJSON-152154906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (754298fe-cfb4-45bb-ba37-6f8f97e1d901) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6497f269-7fe8-4730-a01b-3c08649a3304', 'volume_name': 'volume-6497f269-7fe8-4730-a01b-3c08649a3304', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:13 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-9b50417f-b384-4d3f-9818-64952ea5b9cf tempest-VolumesListTestJSON-152154906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac0a813e-827b-44f7-8963-98dadcb1c8e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:13 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-9b50417f-b384-4d3f-9818-64952ea5b9cf tempest-VolumesListTestJSON-152154906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac0a813e-827b-44f7-8963-98dadcb1c8e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:13 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-9b50417f-b384-4d3f-9818-64952ea5b9cf tempest-VolumesListTestJSON-152154906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b97c96e8-ee45-4696-9047-421ec9c49c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:13 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-9b50417f-b384-4d3f-9818-64952ea5b9cf tempest-VolumesListTestJSON-152154906 None] Volume 6497f269-7fe8-4730-a01b-3c08649a3304: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6497f269-7fe8-4730-a01b-3c08649a3304', 'volume_size': 1} Nov 03 07:33:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-9b50417f-b384-4d3f-9818-64952ea5b9cf tempest-VolumesListTestJSON-152154906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-9b50417f-b384-4d3f-9818-64952ea5b9cf tempest-VolumesListTestJSON-152154906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:13 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-9b50417f-b384-4d3f-9818-64952ea5b9cf tempest-VolumesListTestJSON-152154906 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:33:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1306887047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6497f269-7fe8-4730-a01b-3c08649a3304,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='50f35b8e33f8432bbd709a41d5e7321a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:33:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:33:14Z,use_quota=True,user_id='47a28d91d4154023bfddbaa21c547589',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:33:13 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-9b50417f-b384-4d3f-9818-64952ea5b9cf tempest-VolumesListTestJSON-152154906 None] Creating volume 6497f269-7fe8-4730-a01b-3c08649a3304 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:33:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-9b50417f-b384-4d3f-9818-64952ea5b9cf tempest-VolumesListTestJSON-152154906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-9b50417f-b384-4d3f-9818-64952ea5b9cf tempest-VolumesListTestJSON-152154906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:13 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-9b50417f-b384-4d3f-9818-64952ea5b9cf tempest-VolumesListTestJSON-152154906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:33:13 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-9b50417f-b384-4d3f-9818-64952ea5b9cf tempest-VolumesListTestJSON-152154906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:33:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-9b50417f-b384-4d3f-9818-64952ea5b9cf tempest-VolumesListTestJSON-152154906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:13 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-9b50417f-b384-4d3f-9818-64952ea5b9cf tempest-VolumesListTestJSON-152154906 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:33:13 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-9b50417f-b384-4d3f-9818-64952ea5b9cf tempest-VolumesListTestJSON-152154906 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:33:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9b50417f-b384-4d3f-9818-64952ea5b9cf tempest-VolumesListTestJSON-152154906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6497f269-7fe8-4730-a01b-3c08649a3304 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:14 devstack sudo[93821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6497f269-7fe8-4730-a01b-3c08649a3304 1073741824 Nov 03 07:33:14 devstack sudo[93821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:14 devstack sudo[93821]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:14 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9b50417f-b384-4d3f-9818-64952ea5b9cf tempest-VolumesListTestJSON-152154906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6497f269-7fe8-4730-a01b-3c08649a3304 1073741824" returned: 0 in 0.732s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:14 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9b50417f-b384-4d3f-9818-64952ea5b9cf tempest-VolumesListTestJSON-152154906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6497f269-7fe8-4730-a01b-3c08649a3304 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:14 devstack sudo[93828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6497f269-7fe8-4730-a01b-3c08649a3304 Nov 03 07:33:14 devstack sudo[93828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:15 devstack sudo[93828]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9b50417f-b384-4d3f-9818-64952ea5b9cf tempest-VolumesListTestJSON-152154906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6497f269-7fe8-4730-a01b-3c08649a3304" returned: 0 in 0.390s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:15 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-9b50417f-b384-4d3f-9818-64952ea5b9cf tempest-VolumesListTestJSON-152154906 None] <== create_volume: return (1220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:33:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-9b50417f-b384-4d3f-9818-64952ea5b9cf tempest-VolumesListTestJSON-152154906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.226s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:15 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-9b50417f-b384-4d3f-9818-64952ea5b9cf tempest-VolumesListTestJSON-152154906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b97c96e8-ee45-4696-9047-421ec9c49c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6497f269-7fe8-4730-a01b-3c08649a3304', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:15 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-9b50417f-b384-4d3f-9818-64952ea5b9cf tempest-VolumesListTestJSON-152154906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf9344da-670b-45f0-876a-3374f2d7b3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:15 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-9b50417f-b384-4d3f-9818-64952ea5b9cf tempest-VolumesListTestJSON-152154906 None] Volume volume-6497f269-7fe8-4730-a01b-3c08649a3304 (6497f269-7fe8-4730-a01b-3c08649a3304): created successfully Nov 03 07:33:15 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-9b50417f-b384-4d3f-9818-64952ea5b9cf tempest-VolumesListTestJSON-152154906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf9344da-670b-45f0-876a-3374f2d7b3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:15 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-9b50417f-b384-4d3f-9818-64952ea5b9cf tempest-VolumesListTestJSON-152154906 None] Flow 'volume_create_manager' (27ce8332-817f-472c-b019-1373f658f6e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:33:15 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-9b50417f-b384-4d3f-9818-64952ea5b9cf tempest-VolumesListTestJSON-152154906 None] Created volume successfully. Nov 03 07:33:16 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa2a418c-0f9c-4d00-9619-c5401e689086 tempest-VolumesListTestJSON-152154906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:33:16 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fa2a418c-0f9c-4d00-9619-c5401e689086 tempest-VolumesListTestJSON-152154906 None] Flow 'volume_create_manager' (bf8216bc-68cd-46e9-911c-7928be76f961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:33:16 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fa2a418c-0f9c-4d00-9619-c5401e689086 tempest-VolumesListTestJSON-152154906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edf30100-028b-4246-ae11-784b4577b393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:16 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fa2a418c-0f9c-4d00-9619-c5401e689086 tempest-VolumesListTestJSON-152154906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edf30100-028b-4246-ae11-784b4577b393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:33:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1724020070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79c7134e-bdf7-407c-b617-66f1df73e6e9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='50f35b8e33f8432bbd709a41d5e7321a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:33:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:33:17Z,use_quota=True,user_id='47a28d91d4154023bfddbaa21c547589',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:16 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fa2a418c-0f9c-4d00-9619-c5401e689086 tempest-VolumesListTestJSON-152154906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3126d4e3-85ea-4b1d-b2a5-7c56c1611e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:17 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fa2a418c-0f9c-4d00-9619-c5401e689086 tempest-VolumesListTestJSON-152154906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3126d4e3-85ea-4b1d-b2a5-7c56c1611e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:17 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fa2a418c-0f9c-4d00-9619-c5401e689086 tempest-VolumesListTestJSON-152154906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b36c2df8-060e-4850-8bd9-108c9d7a94b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:17 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fa2a418c-0f9c-4d00-9619-c5401e689086 tempest-VolumesListTestJSON-152154906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b36c2df8-060e-4850-8bd9-108c9d7a94b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79c7134e-bdf7-407c-b617-66f1df73e6e9', 'volume_name': 'volume-79c7134e-bdf7-407c-b617-66f1df73e6e9', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:17 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fa2a418c-0f9c-4d00-9619-c5401e689086 tempest-VolumesListTestJSON-152154906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (771e9b4e-4078-4328-bad9-738a2aa28026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:17 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fa2a418c-0f9c-4d00-9619-c5401e689086 tempest-VolumesListTestJSON-152154906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (771e9b4e-4078-4328-bad9-738a2aa28026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:17 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fa2a418c-0f9c-4d00-9619-c5401e689086 tempest-VolumesListTestJSON-152154906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (958c53f6-83c8-495c-bd14-63bc13c0a87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:17 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-fa2a418c-0f9c-4d00-9619-c5401e689086 tempest-VolumesListTestJSON-152154906 None] Volume 79c7134e-bdf7-407c-b617-66f1df73e6e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79c7134e-bdf7-407c-b617-66f1df73e6e9', 'volume_size': 1} Nov 03 07:33:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-fa2a418c-0f9c-4d00-9619-c5401e689086 tempest-VolumesListTestJSON-152154906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-fa2a418c-0f9c-4d00-9619-c5401e689086 tempest-VolumesListTestJSON-152154906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:17 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-fa2a418c-0f9c-4d00-9619-c5401e689086 tempest-VolumesListTestJSON-152154906 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:33:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1724020070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79c7134e-bdf7-407c-b617-66f1df73e6e9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='50f35b8e33f8432bbd709a41d5e7321a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:33:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:33:17Z,use_quota=True,user_id='47a28d91d4154023bfddbaa21c547589',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:33:17 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-fa2a418c-0f9c-4d00-9619-c5401e689086 tempest-VolumesListTestJSON-152154906 None] Creating volume 79c7134e-bdf7-407c-b617-66f1df73e6e9 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:33:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-fa2a418c-0f9c-4d00-9619-c5401e689086 tempest-VolumesListTestJSON-152154906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-fa2a418c-0f9c-4d00-9619-c5401e689086 tempest-VolumesListTestJSON-152154906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:17 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-fa2a418c-0f9c-4d00-9619-c5401e689086 tempest-VolumesListTestJSON-152154906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:33:17 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-fa2a418c-0f9c-4d00-9619-c5401e689086 tempest-VolumesListTestJSON-152154906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:33:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-fa2a418c-0f9c-4d00-9619-c5401e689086 tempest-VolumesListTestJSON-152154906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:17 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-fa2a418c-0f9c-4d00-9619-c5401e689086 tempest-VolumesListTestJSON-152154906 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:33:17 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-fa2a418c-0f9c-4d00-9619-c5401e689086 tempest-VolumesListTestJSON-152154906 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:33:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fa2a418c-0f9c-4d00-9619-c5401e689086 tempest-VolumesListTestJSON-152154906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-79c7134e-bdf7-407c-b617-66f1df73e6e9 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:17 devstack sudo[93838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-79c7134e-bdf7-407c-b617-66f1df73e6e9 1073741824 Nov 03 07:33:17 devstack sudo[93838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:17 devstack sudo[93838]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fa2a418c-0f9c-4d00-9619-c5401e689086 tempest-VolumesListTestJSON-152154906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-79c7134e-bdf7-407c-b617-66f1df73e6e9 1073741824" returned: 0 in 0.678s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fa2a418c-0f9c-4d00-9619-c5401e689086 tempest-VolumesListTestJSON-152154906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-79c7134e-bdf7-407c-b617-66f1df73e6e9 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:17 devstack sudo[93845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-79c7134e-bdf7-407c-b617-66f1df73e6e9 Nov 03 07:33:17 devstack sudo[93845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:18 devstack sudo[93845]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:18 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fa2a418c-0f9c-4d00-9619-c5401e689086 tempest-VolumesListTestJSON-152154906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-79c7134e-bdf7-407c-b617-66f1df73e6e9" returned: 0 in 0.385s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:18 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-fa2a418c-0f9c-4d00-9619-c5401e689086 tempest-VolumesListTestJSON-152154906 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:33:18 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-fa2a418c-0f9c-4d00-9619-c5401e689086 tempest-VolumesListTestJSON-152154906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:18 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fa2a418c-0f9c-4d00-9619-c5401e689086 tempest-VolumesListTestJSON-152154906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (958c53f6-83c8-495c-bd14-63bc13c0a87a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79c7134e-bdf7-407c-b617-66f1df73e6e9', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:18 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fa2a418c-0f9c-4d00-9619-c5401e689086 tempest-VolumesListTestJSON-152154906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e31b5c3-3ba1-40dd-ba91-1840e18451aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:18 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-fa2a418c-0f9c-4d00-9619-c5401e689086 tempest-VolumesListTestJSON-152154906 None] Volume volume-79c7134e-bdf7-407c-b617-66f1df73e6e9 (79c7134e-bdf7-407c-b617-66f1df73e6e9): created successfully Nov 03 07:33:18 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fa2a418c-0f9c-4d00-9619-c5401e689086 tempest-VolumesListTestJSON-152154906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e31b5c3-3ba1-40dd-ba91-1840e18451aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:18 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fa2a418c-0f9c-4d00-9619-c5401e689086 tempest-VolumesListTestJSON-152154906 None] Flow 'volume_create_manager' (bf8216bc-68cd-46e9-911c-7928be76f961) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:33:18 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-fa2a418c-0f9c-4d00-9619-c5401e689086 tempest-VolumesListTestJSON-152154906 None] Created volume successfully. Nov 03 07:33:20 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4ffc971-a009-454e-95ab-3bfdb87ddaed tempest-VolumesListTestJSON-152154906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:33:20 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a4ffc971-a009-454e-95ab-3bfdb87ddaed tempest-VolumesListTestJSON-152154906 None] Flow 'volume_create_manager' (4fc7932c-20bf-419e-aca0-41e846499586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:33:20 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a4ffc971-a009-454e-95ab-3bfdb87ddaed tempest-VolumesListTestJSON-152154906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3d62911-4104-4a9e-a879-c71b6ea09d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:20 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a4ffc971-a009-454e-95ab-3bfdb87ddaed tempest-VolumesListTestJSON-152154906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3d62911-4104-4a9e-a879-c71b6ea09d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:33:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-863470536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a2ff3c9-4f1a-4190-9957-c57967f5f30d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='50f35b8e33f8432bbd709a41d5e7321a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:33:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:33:20Z,use_quota=True,user_id='47a28d91d4154023bfddbaa21c547589',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:20 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a4ffc971-a009-454e-95ab-3bfdb87ddaed tempest-VolumesListTestJSON-152154906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd15415e-08c2-4a7a-b8fb-62661e2c6037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:20 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a4ffc971-a009-454e-95ab-3bfdb87ddaed tempest-VolumesListTestJSON-152154906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd15415e-08c2-4a7a-b8fb-62661e2c6037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:20 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a4ffc971-a009-454e-95ab-3bfdb87ddaed tempest-VolumesListTestJSON-152154906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a004f7f2-5700-4a4f-b1c4-b5c82a9ef072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:20 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a4ffc971-a009-454e-95ab-3bfdb87ddaed tempest-VolumesListTestJSON-152154906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a004f7f2-5700-4a4f-b1c4-b5c82a9ef072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a2ff3c9-4f1a-4190-9957-c57967f5f30d', 'volume_name': 'volume-9a2ff3c9-4f1a-4190-9957-c57967f5f30d', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:20 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a4ffc971-a009-454e-95ab-3bfdb87ddaed tempest-VolumesListTestJSON-152154906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc6d40ce-518c-4206-b6be-645236a5a986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:20 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a4ffc971-a009-454e-95ab-3bfdb87ddaed tempest-VolumesListTestJSON-152154906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc6d40ce-518c-4206-b6be-645236a5a986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:20 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a4ffc971-a009-454e-95ab-3bfdb87ddaed tempest-VolumesListTestJSON-152154906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8e36ebc-5841-4609-a9a1-0e551afccc77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:20 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-a4ffc971-a009-454e-95ab-3bfdb87ddaed tempest-VolumesListTestJSON-152154906 None] Volume 9a2ff3c9-4f1a-4190-9957-c57967f5f30d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a2ff3c9-4f1a-4190-9957-c57967f5f30d', 'volume_size': 1} Nov 03 07:33:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a4ffc971-a009-454e-95ab-3bfdb87ddaed tempest-VolumesListTestJSON-152154906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a4ffc971-a009-454e-95ab-3bfdb87ddaed tempest-VolumesListTestJSON-152154906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:20 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a4ffc971-a009-454e-95ab-3bfdb87ddaed tempest-VolumesListTestJSON-152154906 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:33:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-863470536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a2ff3c9-4f1a-4190-9957-c57967f5f30d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='50f35b8e33f8432bbd709a41d5e7321a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:33:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:33:20Z,use_quota=True,user_id='47a28d91d4154023bfddbaa21c547589',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:33:20 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-a4ffc971-a009-454e-95ab-3bfdb87ddaed tempest-VolumesListTestJSON-152154906 None] Creating volume 9a2ff3c9-4f1a-4190-9957-c57967f5f30d {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:33:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a4ffc971-a009-454e-95ab-3bfdb87ddaed tempest-VolumesListTestJSON-152154906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a4ffc971-a009-454e-95ab-3bfdb87ddaed tempest-VolumesListTestJSON-152154906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:20 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a4ffc971-a009-454e-95ab-3bfdb87ddaed tempest-VolumesListTestJSON-152154906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:33:20 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a4ffc971-a009-454e-95ab-3bfdb87ddaed tempest-VolumesListTestJSON-152154906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:33:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a4ffc971-a009-454e-95ab-3bfdb87ddaed tempest-VolumesListTestJSON-152154906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:20 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a4ffc971-a009-454e-95ab-3bfdb87ddaed tempest-VolumesListTestJSON-152154906 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:33:20 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-a4ffc971-a009-454e-95ab-3bfdb87ddaed tempest-VolumesListTestJSON-152154906 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:33:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a4ffc971-a009-454e-95ab-3bfdb87ddaed tempest-VolumesListTestJSON-152154906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9a2ff3c9-4f1a-4190-9957-c57967f5f30d 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:20 devstack sudo[93848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9a2ff3c9-4f1a-4190-9957-c57967f5f30d 1073741824 Nov 03 07:33:20 devstack sudo[93848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:20 devstack sudo[93848]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a4ffc971-a009-454e-95ab-3bfdb87ddaed tempest-VolumesListTestJSON-152154906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9a2ff3c9-4f1a-4190-9957-c57967f5f30d 1073741824" returned: 0 in 0.738s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a4ffc971-a009-454e-95ab-3bfdb87ddaed tempest-VolumesListTestJSON-152154906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9a2ff3c9-4f1a-4190-9957-c57967f5f30d {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:21 devstack sudo[93854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9a2ff3c9-4f1a-4190-9957-c57967f5f30d Nov 03 07:33:21 devstack sudo[93854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:21 devstack sudo[93854]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a4ffc971-a009-454e-95ab-3bfdb87ddaed tempest-VolumesListTestJSON-152154906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9a2ff3c9-4f1a-4190-9957-c57967f5f30d" returned: 0 in 0.357s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:21 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a4ffc971-a009-454e-95ab-3bfdb87ddaed tempest-VolumesListTestJSON-152154906 None] <== create_volume: return (1178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:33:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a4ffc971-a009-454e-95ab-3bfdb87ddaed tempest-VolumesListTestJSON-152154906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:21 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a4ffc971-a009-454e-95ab-3bfdb87ddaed tempest-VolumesListTestJSON-152154906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8e36ebc-5841-4609-a9a1-0e551afccc77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a2ff3c9-4f1a-4190-9957-c57967f5f30d', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:21 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a4ffc971-a009-454e-95ab-3bfdb87ddaed tempest-VolumesListTestJSON-152154906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e76bcc8-e850-4c13-b5ce-64ae3f41a932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:21 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-a4ffc971-a009-454e-95ab-3bfdb87ddaed tempest-VolumesListTestJSON-152154906 None] Volume volume-9a2ff3c9-4f1a-4190-9957-c57967f5f30d (9a2ff3c9-4f1a-4190-9957-c57967f5f30d): created successfully Nov 03 07:33:21 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a4ffc971-a009-454e-95ab-3bfdb87ddaed tempest-VolumesListTestJSON-152154906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e76bcc8-e850-4c13-b5ce-64ae3f41a932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:21 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a4ffc971-a009-454e-95ab-3bfdb87ddaed tempest-VolumesListTestJSON-152154906 None] Flow 'volume_create_manager' (4fc7932c-20bf-419e-aca0-41e846499586) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:33:21 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-a4ffc971-a009-454e-95ab-3bfdb87ddaed tempest-VolumesListTestJSON-152154906 None] Created volume successfully. Nov 03 07:33:26 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-6cb39942-43bf-454c-b9a0-136a98b7bbea tempest-VolumesListTestJSON-152154906 None] Acquiring lock "cinder-9a2ff3c9-4f1a-4190-9957-c57967f5f30d-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:33:26 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-6cb39942-43bf-454c-b9a0-136a98b7bbea tempest-VolumesListTestJSON-152154906 None] Lock "cinder-9a2ff3c9-4f1a-4190-9957-c57967f5f30d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:33:26 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-6cb39942-43bf-454c-b9a0-136a98b7bbea tempest-VolumesListTestJSON-152154906 None] Acquiring lock "cinder-quobyte-9a2ff3c9-4f1a-4190-9957-c57967f5f30d" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:33:26 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-6cb39942-43bf-454c-b9a0-136a98b7bbea tempest-VolumesListTestJSON-152154906 None] Lock "cinder-quobyte-9a2ff3c9-4f1a-4190-9957-c57967f5f30d" acquired by "delete_volume" :: waited 0.019s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:33:26 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8fda7b-a839-4a7c-b1e8-9ac412c3733c]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:33:26 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6cb39942-43bf-454c-b9a0-136a98b7bbea tempest-VolumesListTestJSON-152154906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9a2ff3c9-4f1a-4190-9957-c57967f5f30d {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:26 devstack sudo[93882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9a2ff3c9-4f1a-4190-9957-c57967f5f30d Nov 03 07:33:26 devstack sudo[93882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:27 devstack sudo[93882]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6cb39942-43bf-454c-b9a0-136a98b7bbea tempest-VolumesListTestJSON-152154906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9a2ff3c9-4f1a-4190-9957-c57967f5f30d" returned: 0 in 0.535s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6cb39942-43bf-454c-b9a0-136a98b7bbea tempest-VolumesListTestJSON-152154906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9a2ff3c9-4f1a-4190-9957-c57967f5f30d {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:27 devstack sudo[93888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9a2ff3c9-4f1a-4190-9957-c57967f5f30d Nov 03 07:33:27 devstack sudo[93888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:27 devstack sudo[93888]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6cb39942-43bf-454c-b9a0-136a98b7bbea tempest-VolumesListTestJSON-152154906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9a2ff3c9-4f1a-4190-9957-c57967f5f30d" returned: 0 in 0.334s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:27 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-6cb39942-43bf-454c-b9a0-136a98b7bbea tempest-VolumesListTestJSON-152154906 None] Lock "cinder-quobyte-9a2ff3c9-4f1a-4190-9957-c57967f5f30d" released by "delete_volume" :: held 0.945s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:33:27 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-6cb39942-43bf-454c-b9a0-136a98b7bbea tempest-VolumesListTestJSON-152154906 None] Created reservations ['7a41e00e-8a38-47b6-ae57-0f397adfe3a9', 'd88f8e49-37c4-4360-a681-6f3b59c81ebb', 'f00e4e7d-1f13-48e4-9192-847ac8d9adce', '64e94c0b-2bfa-477f-a064-d73ae0cc554d'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:33:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-6cb39942-43bf-454c-b9a0-136a98b7bbea tempest-VolumesListTestJSON-152154906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-6cb39942-43bf-454c-b9a0-136a98b7bbea tempest-VolumesListTestJSON-152154906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:27 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-6cb39942-43bf-454c-b9a0-136a98b7bbea tempest-VolumesListTestJSON-152154906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:33:27 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-6cb39942-43bf-454c-b9a0-136a98b7bbea tempest-VolumesListTestJSON-152154906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:33:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-6cb39942-43bf-454c-b9a0-136a98b7bbea tempest-VolumesListTestJSON-152154906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6cb39942-43bf-454c-b9a0-136a98b7bbea tempest-VolumesListTestJSON-152154906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:27 devstack sudo[93891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:33:27 devstack sudo[93891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:27 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-8384f64f-d565-4f8e-b748-fcc675fae047 tempest-VolumesListTestJSON-152154906 None] Acquiring lock "cinder-79c7134e-bdf7-407c-b617-66f1df73e6e9-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:33:27 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-8384f64f-d565-4f8e-b748-fcc675fae047 tempest-VolumesListTestJSON-152154906 None] Lock "cinder-79c7134e-bdf7-407c-b617-66f1df73e6e9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:33:27 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-8384f64f-d565-4f8e-b748-fcc675fae047 tempest-VolumesListTestJSON-152154906 None] Acquiring lock "cinder-quobyte-79c7134e-bdf7-407c-b617-66f1df73e6e9" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:33:27 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-8384f64f-d565-4f8e-b748-fcc675fae047 tempest-VolumesListTestJSON-152154906 None] Lock "cinder-quobyte-79c7134e-bdf7-407c-b617-66f1df73e6e9" acquired by "delete_volume" :: waited 0.022s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:33:28 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad70b96-d240-4091-bc8f-ee1c2f9e9a46]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:33:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8384f64f-d565-4f8e-b748-fcc675fae047 tempest-VolumesListTestJSON-152154906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-79c7134e-bdf7-407c-b617-66f1df73e6e9 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:28 devstack sudo[93891]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6cb39942-43bf-454c-b9a0-136a98b7bbea tempest-VolumesListTestJSON-152154906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.386s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:28 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-6cb39942-43bf-454c-b9a0-136a98b7bbea tempest-VolumesListTestJSON-152154906 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:33:28 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-6cb39942-43bf-454c-b9a0-136a98b7bbea tempest-VolumesListTestJSON-152154906 None] Deleted volume successfully. Nov 03 07:33:28 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-6cb39942-43bf-454c-b9a0-136a98b7bbea tempest-VolumesListTestJSON-152154906 None] Lock "cinder-9a2ff3c9-4f1a-4190-9957-c57967f5f30d-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:33:28 devstack sudo[93894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-79c7134e-bdf7-407c-b617-66f1df73e6e9 Nov 03 07:33:28 devstack sudo[93894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:28 devstack sudo[93894]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8384f64f-d565-4f8e-b748-fcc675fae047 tempest-VolumesListTestJSON-152154906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-79c7134e-bdf7-407c-b617-66f1df73e6e9" returned: 0 in 0.558s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8384f64f-d565-4f8e-b748-fcc675fae047 tempest-VolumesListTestJSON-152154906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-79c7134e-bdf7-407c-b617-66f1df73e6e9 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:28 devstack sudo[93900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-79c7134e-bdf7-407c-b617-66f1df73e6e9 Nov 03 07:33:28 devstack sudo[93900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:28 devstack sudo[93900]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8384f64f-d565-4f8e-b748-fcc675fae047 tempest-VolumesListTestJSON-152154906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-79c7134e-bdf7-407c-b617-66f1df73e6e9" returned: 0 in 0.350s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:28 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-8384f64f-d565-4f8e-b748-fcc675fae047 tempest-VolumesListTestJSON-152154906 None] Lock "cinder-quobyte-79c7134e-bdf7-407c-b617-66f1df73e6e9" released by "delete_volume" :: held 0.968s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:33:29 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-8384f64f-d565-4f8e-b748-fcc675fae047 tempest-VolumesListTestJSON-152154906 None] Created reservations ['bb5b26f4-b317-458b-8008-6263ad563aad', '3117f3ab-b120-4569-8c87-df0844f6bb76', '3e22c767-f8c8-4c22-8a78-b4d6eddca3a0', 'd0f823e0-c29e-4781-b991-3dff8e3eddf3'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:33:29 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-8384f64f-d565-4f8e-b748-fcc675fae047 tempest-VolumesListTestJSON-152154906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:29 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-8384f64f-d565-4f8e-b748-fcc675fae047 tempest-VolumesListTestJSON-152154906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:29 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-8384f64f-d565-4f8e-b748-fcc675fae047 tempest-VolumesListTestJSON-152154906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:33:29 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-8384f64f-d565-4f8e-b748-fcc675fae047 tempest-VolumesListTestJSON-152154906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:33:29 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-8384f64f-d565-4f8e-b748-fcc675fae047 tempest-VolumesListTestJSON-152154906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:29 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8384f64f-d565-4f8e-b748-fcc675fae047 tempest-VolumesListTestJSON-152154906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:29 devstack sudo[93903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:33:29 devstack sudo[93903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:29 devstack sudo[93903]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:29 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8384f64f-d565-4f8e-b748-fcc675fae047 tempest-VolumesListTestJSON-152154906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.371s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:29 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-8384f64f-d565-4f8e-b748-fcc675fae047 tempest-VolumesListTestJSON-152154906 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:33:29 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-8384f64f-d565-4f8e-b748-fcc675fae047 tempest-VolumesListTestJSON-152154906 None] Deleted volume successfully. Nov 03 07:33:29 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-8384f64f-d565-4f8e-b748-fcc675fae047 tempest-VolumesListTestJSON-152154906 None] Lock "cinder-79c7134e-bdf7-407c-b617-66f1df73e6e9-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:33:30 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-0e10dc94-a3f2-46e0-91e9-eab488edea23 tempest-VolumesListTestJSON-152154906 None] Acquiring lock "cinder-6497f269-7fe8-4730-a01b-3c08649a3304-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:33:30 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-0e10dc94-a3f2-46e0-91e9-eab488edea23 tempest-VolumesListTestJSON-152154906 None] Lock "cinder-6497f269-7fe8-4730-a01b-3c08649a3304-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:33:30 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-0e10dc94-a3f2-46e0-91e9-eab488edea23 tempest-VolumesListTestJSON-152154906 None] Acquiring lock "cinder-quobyte-6497f269-7fe8-4730-a01b-3c08649a3304" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:33:30 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-0e10dc94-a3f2-46e0-91e9-eab488edea23 tempest-VolumesListTestJSON-152154906 None] Lock "cinder-quobyte-6497f269-7fe8-4730-a01b-3c08649a3304" acquired by "delete_volume" :: waited 0.031s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:33:31 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[5746ede2-2a8f-4c53-a53c-1a954a0209af]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:33:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0e10dc94-a3f2-46e0-91e9-eab488edea23 tempest-VolumesListTestJSON-152154906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6497f269-7fe8-4730-a01b-3c08649a3304 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:31 devstack sudo[93964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6497f269-7fe8-4730-a01b-3c08649a3304 Nov 03 07:33:31 devstack sudo[93964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:31 devstack sudo[93964]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0e10dc94-a3f2-46e0-91e9-eab488edea23 tempest-VolumesListTestJSON-152154906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6497f269-7fe8-4730-a01b-3c08649a3304" returned: 0 in 0.709s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0e10dc94-a3f2-46e0-91e9-eab488edea23 tempest-VolumesListTestJSON-152154906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6497f269-7fe8-4730-a01b-3c08649a3304 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:31 devstack sudo[93977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6497f269-7fe8-4730-a01b-3c08649a3304 Nov 03 07:33:31 devstack sudo[93977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:32 devstack sudo[93977]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:32 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0e10dc94-a3f2-46e0-91e9-eab488edea23 tempest-VolumesListTestJSON-152154906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6497f269-7fe8-4730-a01b-3c08649a3304" returned: 0 in 0.678s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:32 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-0e10dc94-a3f2-46e0-91e9-eab488edea23 tempest-VolumesListTestJSON-152154906 None] Lock "cinder-quobyte-6497f269-7fe8-4730-a01b-3c08649a3304" released by "delete_volume" :: held 1.485s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:33:32 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-0e10dc94-a3f2-46e0-91e9-eab488edea23 tempest-VolumesListTestJSON-152154906 None] Created reservations ['ac79137f-6ca4-4737-be8c-a33b1ab2d17b', 'e43910ea-5c2d-481c-82ce-785b862c2e2b', '7bf88102-8be8-4de5-86ec-5f776d70649e', 'cab75a27-ae63-407c-872d-b9892b0ce889'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:33:32 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0e10dc94-a3f2-46e0-91e9-eab488edea23 tempest-VolumesListTestJSON-152154906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:32 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0e10dc94-a3f2-46e0-91e9-eab488edea23 tempest-VolumesListTestJSON-152154906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:32 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-0e10dc94-a3f2-46e0-91e9-eab488edea23 tempest-VolumesListTestJSON-152154906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:33:32 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-0e10dc94-a3f2-46e0-91e9-eab488edea23 tempest-VolumesListTestJSON-152154906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:33:32 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0e10dc94-a3f2-46e0-91e9-eab488edea23 tempest-VolumesListTestJSON-152154906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:32 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0e10dc94-a3f2-46e0-91e9-eab488edea23 tempest-VolumesListTestJSON-152154906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:32 devstack sudo[93983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:33:32 devstack sudo[93983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:33 devstack sudo[93983]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0e10dc94-a3f2-46e0-91e9-eab488edea23 tempest-VolumesListTestJSON-152154906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.831s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:33 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-0e10dc94-a3f2-46e0-91e9-eab488edea23 tempest-VolumesListTestJSON-152154906 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:33:33 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-0e10dc94-a3f2-46e0-91e9-eab488edea23 tempest-VolumesListTestJSON-152154906 None] Deleted volume successfully. Nov 03 07:33:33 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-0e10dc94-a3f2-46e0-91e9-eab488edea23 tempest-VolumesListTestJSON-152154906 None] Lock "cinder-6497f269-7fe8-4730-a01b-3c08649a3304-delete_volume" released by "delete_volume" :: held 2.988s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:33:34 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-16806d3e-4746-44c6-941f-984d63cacf89 tempest-VolumesMetadataTest-674781989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:33:34 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-16806d3e-4746-44c6-941f-984d63cacf89 tempest-VolumesMetadataTest-674781989 None] Flow 'volume_create_manager' (62952c39-6ddf-4eda-bae4-89b1bef78956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:33:34 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-16806d3e-4746-44c6-941f-984d63cacf89 tempest-VolumesMetadataTest-674781989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9532044-4fa2-4b1e-8aed-923a40b6e956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:34 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-16806d3e-4746-44c6-941f-984d63cacf89 tempest-VolumesMetadataTest-674781989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9532044-4fa2-4b1e-8aed-923a40b6e956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:33:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-342094630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c440c8a-dda5-401e-a63c-4ec9ce0b4c7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90530a0555cc47a58f0b1c8403a888b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:33:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:33:34Z,use_quota=True,user_id='888ac4a27d78412ea34115af65457268',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:34 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-16806d3e-4746-44c6-941f-984d63cacf89 tempest-VolumesMetadataTest-674781989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0a5f69d-bc0d-4f26-b992-9858b4e1e7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:34 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-16806d3e-4746-44c6-941f-984d63cacf89 tempest-VolumesMetadataTest-674781989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0a5f69d-bc0d-4f26-b992-9858b4e1e7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:34 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-16806d3e-4746-44c6-941f-984d63cacf89 tempest-VolumesMetadataTest-674781989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4c38622-6d46-4739-98f3-9f6d10c7fa72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:34 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-16806d3e-4746-44c6-941f-984d63cacf89 tempest-VolumesMetadataTest-674781989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4c38622-6d46-4739-98f3-9f6d10c7fa72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c440c8a-dda5-401e-a63c-4ec9ce0b4c7b', 'volume_name': 'volume-8c440c8a-dda5-401e-a63c-4ec9ce0b4c7b', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:34 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-16806d3e-4746-44c6-941f-984d63cacf89 tempest-VolumesMetadataTest-674781989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c343ea3-37f8-4541-a0d8-ae0f2f794737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:34 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-16806d3e-4746-44c6-941f-984d63cacf89 tempest-VolumesMetadataTest-674781989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c343ea3-37f8-4541-a0d8-ae0f2f794737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:34 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-16806d3e-4746-44c6-941f-984d63cacf89 tempest-VolumesMetadataTest-674781989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d78ab9b5-4741-413d-99ae-478d10603985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:34 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-16806d3e-4746-44c6-941f-984d63cacf89 tempest-VolumesMetadataTest-674781989 None] Volume 8c440c8a-dda5-401e-a63c-4ec9ce0b4c7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c440c8a-dda5-401e-a63c-4ec9ce0b4c7b', 'volume_size': 1} Nov 03 07:33:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-16806d3e-4746-44c6-941f-984d63cacf89 tempest-VolumesMetadataTest-674781989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-16806d3e-4746-44c6-941f-984d63cacf89 tempest-VolumesMetadataTest-674781989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:34 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-16806d3e-4746-44c6-941f-984d63cacf89 tempest-VolumesMetadataTest-674781989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:33:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-342094630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c440c8a-dda5-401e-a63c-4ec9ce0b4c7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90530a0555cc47a58f0b1c8403a888b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:33:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:33:34Z,use_quota=True,user_id='888ac4a27d78412ea34115af65457268',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:33:34 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-16806d3e-4746-44c6-941f-984d63cacf89 tempest-VolumesMetadataTest-674781989 None] Creating volume 8c440c8a-dda5-401e-a63c-4ec9ce0b4c7b {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:33:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-16806d3e-4746-44c6-941f-984d63cacf89 tempest-VolumesMetadataTest-674781989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-16806d3e-4746-44c6-941f-984d63cacf89 tempest-VolumesMetadataTest-674781989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:34 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-16806d3e-4746-44c6-941f-984d63cacf89 tempest-VolumesMetadataTest-674781989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:33:34 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-16806d3e-4746-44c6-941f-984d63cacf89 tempest-VolumesMetadataTest-674781989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:33:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-16806d3e-4746-44c6-941f-984d63cacf89 tempest-VolumesMetadataTest-674781989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:34 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-16806d3e-4746-44c6-941f-984d63cacf89 tempest-VolumesMetadataTest-674781989 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:33:34 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-16806d3e-4746-44c6-941f-984d63cacf89 tempest-VolumesMetadataTest-674781989 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:33:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-16806d3e-4746-44c6-941f-984d63cacf89 tempest-VolumesMetadataTest-674781989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8c440c8a-dda5-401e-a63c-4ec9ce0b4c7b 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:34 devstack sudo[93986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8c440c8a-dda5-401e-a63c-4ec9ce0b4c7b 1073741824 Nov 03 07:33:34 devstack sudo[93986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:34 devstack sudo[93986]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-16806d3e-4746-44c6-941f-984d63cacf89 tempest-VolumesMetadataTest-674781989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8c440c8a-dda5-401e-a63c-4ec9ce0b4c7b 1073741824" returned: 0 in 0.669s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-16806d3e-4746-44c6-941f-984d63cacf89 tempest-VolumesMetadataTest-674781989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8c440c8a-dda5-401e-a63c-4ec9ce0b4c7b {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:34 devstack sudo[93993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8c440c8a-dda5-401e-a63c-4ec9ce0b4c7b Nov 03 07:33:34 devstack sudo[93993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:35 devstack sudo[93993]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-16806d3e-4746-44c6-941f-984d63cacf89 tempest-VolumesMetadataTest-674781989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8c440c8a-dda5-401e-a63c-4ec9ce0b4c7b" returned: 0 in 0.414s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:35 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-16806d3e-4746-44c6-941f-984d63cacf89 tempest-VolumesMetadataTest-674781989 None] <== create_volume: return (1176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:33:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-16806d3e-4746-44c6-941f-984d63cacf89 tempest-VolumesMetadataTest-674781989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:35 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-16806d3e-4746-44c6-941f-984d63cacf89 tempest-VolumesMetadataTest-674781989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d78ab9b5-4741-413d-99ae-478d10603985) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c440c8a-dda5-401e-a63c-4ec9ce0b4c7b', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:35 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-16806d3e-4746-44c6-941f-984d63cacf89 tempest-VolumesMetadataTest-674781989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (595d9b62-2bac-4b15-91d0-997d32738ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:35 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-16806d3e-4746-44c6-941f-984d63cacf89 tempest-VolumesMetadataTest-674781989 None] Volume volume-8c440c8a-dda5-401e-a63c-4ec9ce0b4c7b (8c440c8a-dda5-401e-a63c-4ec9ce0b4c7b): created successfully Nov 03 07:33:35 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-16806d3e-4746-44c6-941f-984d63cacf89 tempest-VolumesMetadataTest-674781989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (595d9b62-2bac-4b15-91d0-997d32738ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:35 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-16806d3e-4746-44c6-941f-984d63cacf89 tempest-VolumesMetadataTest-674781989 None] Flow 'volume_create_manager' (62952c39-6ddf-4eda-bae4-89b1bef78956) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:33:35 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-16806d3e-4746-44c6-941f-984d63cacf89 tempest-VolumesMetadataTest-674781989 None] Created volume successfully. Nov 03 07:33:38 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-f18e3c08-6b11-4d00-b478-04acd7edd8cf tempest-VolumesMetadataTest-674781989 None] Acquiring lock "cinder-8c440c8a-dda5-401e-a63c-4ec9ce0b4c7b-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:33:38 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-f18e3c08-6b11-4d00-b478-04acd7edd8cf tempest-VolumesMetadataTest-674781989 None] Lock "cinder-8c440c8a-dda5-401e-a63c-4ec9ce0b4c7b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:33:38 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-f18e3c08-6b11-4d00-b478-04acd7edd8cf tempest-VolumesMetadataTest-674781989 None] Acquiring lock "cinder-quobyte-8c440c8a-dda5-401e-a63c-4ec9ce0b4c7b" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:33:38 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-f18e3c08-6b11-4d00-b478-04acd7edd8cf tempest-VolumesMetadataTest-674781989 None] Lock "cinder-quobyte-8c440c8a-dda5-401e-a63c-4ec9ce0b4c7b" acquired by "delete_volume" :: waited 0.041s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:33:38 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d501bec-44cf-4123-972b-c7b8b23f78cb]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:33:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f18e3c08-6b11-4d00-b478-04acd7edd8cf tempest-VolumesMetadataTest-674781989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8c440c8a-dda5-401e-a63c-4ec9ce0b4c7b {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:38 devstack sudo[94001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8c440c8a-dda5-401e-a63c-4ec9ce0b4c7b Nov 03 07:33:38 devstack sudo[94001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:39 devstack sudo[94001]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f18e3c08-6b11-4d00-b478-04acd7edd8cf tempest-VolumesMetadataTest-674781989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8c440c8a-dda5-401e-a63c-4ec9ce0b4c7b" returned: 0 in 0.782s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f18e3c08-6b11-4d00-b478-04acd7edd8cf tempest-VolumesMetadataTest-674781989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8c440c8a-dda5-401e-a63c-4ec9ce0b4c7b {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:39 devstack sudo[94008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8c440c8a-dda5-401e-a63c-4ec9ce0b4c7b Nov 03 07:33:39 devstack sudo[94008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:39 devstack sudo[94008]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f18e3c08-6b11-4d00-b478-04acd7edd8cf tempest-VolumesMetadataTest-674781989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8c440c8a-dda5-401e-a63c-4ec9ce0b4c7b" returned: 0 in 0.627s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:39 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-f18e3c08-6b11-4d00-b478-04acd7edd8cf tempest-VolumesMetadataTest-674781989 None] Lock "cinder-quobyte-8c440c8a-dda5-401e-a63c-4ec9ce0b4c7b" released by "delete_volume" :: held 1.518s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:33:40 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-f18e3c08-6b11-4d00-b478-04acd7edd8cf tempest-VolumesMetadataTest-674781989 None] Created reservations ['dedc2d09-cdcf-47fe-8e22-ab166fd7fd6e', 'db398249-2c24-4e15-a89f-fe2aa1c0f2e1', 'e019fa0e-1ffe-4b28-8912-acace6aaf8b5', '89bcc7ba-1cb3-47c7-bbff-8c0c484bed16'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:33:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-f18e3c08-6b11-4d00-b478-04acd7edd8cf tempest-VolumesMetadataTest-674781989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-f18e3c08-6b11-4d00-b478-04acd7edd8cf tempest-VolumesMetadataTest-674781989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:40 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-f18e3c08-6b11-4d00-b478-04acd7edd8cf tempest-VolumesMetadataTest-674781989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:33:40 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-f18e3c08-6b11-4d00-b478-04acd7edd8cf tempest-VolumesMetadataTest-674781989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:33:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-f18e3c08-6b11-4d00-b478-04acd7edd8cf tempest-VolumesMetadataTest-674781989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f18e3c08-6b11-4d00-b478-04acd7edd8cf tempest-VolumesMetadataTest-674781989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:40 devstack sudo[94011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:33:40 devstack sudo[94011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:40 devstack sudo[94011]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f18e3c08-6b11-4d00-b478-04acd7edd8cf tempest-VolumesMetadataTest-674781989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.507s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:40 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-f18e3c08-6b11-4d00-b478-04acd7edd8cf tempest-VolumesMetadataTest-674781989 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:33:40 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-f18e3c08-6b11-4d00-b478-04acd7edd8cf tempest-VolumesMetadataTest-674781989 None] Deleted volume successfully. Nov 03 07:33:40 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-f18e3c08-6b11-4d00-b478-04acd7edd8cf tempest-VolumesMetadataTest-674781989 None] Lock "cinder-8c440c8a-dda5-401e-a63c-4ec9ce0b4c7b-delete_volume" released by "delete_volume" :: held 2.552s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:33:41 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-485a7ba1-495b-45d0-bb69-e2f5ea1e96fb tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:33:41 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-485a7ba1-495b-45d0-bb69-e2f5ea1e96fb tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Flow 'volume_create_manager' (3344e1eb-fd77-416c-9ad6-ff1de0932c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:33:41 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-485a7ba1-495b-45d0-bb69-e2f5ea1e96fb tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12afb2ab-a94a-4221-8abe-3b4386e5f1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:41 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-485a7ba1-495b-45d0-bb69-e2f5ea1e96fb tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12afb2ab-a94a-4221-8abe-3b4386e5f1f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-115067579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6fc71ff-50ed-48b3-8a0f-94b0678118b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f25ca13d57284d62a505990f52ab718f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:33:42Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:33:42Z,use_quota=True,user_id='78bbbdcedb0f4620b3598f3d5464039b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:41 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-485a7ba1-495b-45d0-bb69-e2f5ea1e96fb tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d92e9d25-6334-4f69-850c-7fb0fb34f5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:41 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-485a7ba1-495b-45d0-bb69-e2f5ea1e96fb tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d92e9d25-6334-4f69-850c-7fb0fb34f5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:41 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-485a7ba1-495b-45d0-bb69-e2f5ea1e96fb tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4397a2be-17b4-41f8-8bc7-094981ff5798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:41 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-485a7ba1-495b-45d0-bb69-e2f5ea1e96fb tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4397a2be-17b4-41f8-8bc7-094981ff5798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6fc71ff-50ed-48b3-8a0f-94b0678118b2', 'volume_name': 'volume-f6fc71ff-50ed-48b3-8a0f-94b0678118b2', 'volume_size': 2}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:41 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-485a7ba1-495b-45d0-bb69-e2f5ea1e96fb tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (017290aa-ae2b-456e-b04c-9a3ab950c309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:41 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-485a7ba1-495b-45d0-bb69-e2f5ea1e96fb tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (017290aa-ae2b-456e-b04c-9a3ab950c309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:41 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-485a7ba1-495b-45d0-bb69-e2f5ea1e96fb tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e350b12-0a22-4387-a444-01b46a3943a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:41 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-485a7ba1-495b-45d0-bb69-e2f5ea1e96fb tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Volume f6fc71ff-50ed-48b3-8a0f-94b0678118b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6fc71ff-50ed-48b3-8a0f-94b0678118b2', 'volume_size': 2} Nov 03 07:33:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-485a7ba1-495b-45d0-bb69-e2f5ea1e96fb tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-485a7ba1-495b-45d0-bb69-e2f5ea1e96fb tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:41 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-485a7ba1-495b-45d0-bb69-e2f5ea1e96fb tempest-VolumesSnapshotNegativeTestJSON-686800794 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-115067579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6fc71ff-50ed-48b3-8a0f-94b0678118b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f25ca13d57284d62a505990f52ab718f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:33:42Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:33:42Z,use_quota=True,user_id='78bbbdcedb0f4620b3598f3d5464039b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:33:41 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-485a7ba1-495b-45d0-bb69-e2f5ea1e96fb tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Creating volume f6fc71ff-50ed-48b3-8a0f-94b0678118b2 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:33:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-485a7ba1-495b-45d0-bb69-e2f5ea1e96fb tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-485a7ba1-495b-45d0-bb69-e2f5ea1e96fb tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:41 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-485a7ba1-495b-45d0-bb69-e2f5ea1e96fb tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:33:41 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-485a7ba1-495b-45d0-bb69-e2f5ea1e96fb tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:33:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-485a7ba1-495b-45d0-bb69-e2f5ea1e96fb tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:41 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-485a7ba1-495b-45d0-bb69-e2f5ea1e96fb tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:33:41 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-485a7ba1-495b-45d0-bb69-e2f5ea1e96fb tempest-VolumesSnapshotNegativeTestJSON-686800794 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:33:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-485a7ba1-495b-45d0-bb69-e2f5ea1e96fb tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f6fc71ff-50ed-48b3-8a0f-94b0678118b2 2147483648 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:41 devstack sudo[94015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f6fc71ff-50ed-48b3-8a0f-94b0678118b2 2147483648 Nov 03 07:33:41 devstack sudo[94015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:42 devstack sudo[94015]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-485a7ba1-495b-45d0-bb69-e2f5ea1e96fb tempest-VolumesSnapshotNegativeTestJSON-686800794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f6fc71ff-50ed-48b3-8a0f-94b0678118b2 2147483648" returned: 0 in 0.836s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-485a7ba1-495b-45d0-bb69-e2f5ea1e96fb tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f6fc71ff-50ed-48b3-8a0f-94b0678118b2 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:42 devstack sudo[94021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f6fc71ff-50ed-48b3-8a0f-94b0678118b2 Nov 03 07:33:42 devstack sudo[94021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:43 devstack sudo[94021]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:43 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-485a7ba1-495b-45d0-bb69-e2f5ea1e96fb tempest-VolumesSnapshotNegativeTestJSON-686800794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f6fc71ff-50ed-48b3-8a0f-94b0678118b2" returned: 0 in 0.518s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:43 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-485a7ba1-495b-45d0-bb69-e2f5ea1e96fb tempest-VolumesSnapshotNegativeTestJSON-686800794 None] <== create_volume: return (1450ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:33:43 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-485a7ba1-495b-45d0-bb69-e2f5ea1e96fb tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.460s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:43 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-485a7ba1-495b-45d0-bb69-e2f5ea1e96fb tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e350b12-0a22-4387-a444-01b46a3943a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6fc71ff-50ed-48b3-8a0f-94b0678118b2', 'volume_size': 2}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:43 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-485a7ba1-495b-45d0-bb69-e2f5ea1e96fb tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acbe9c3f-a81c-4dc6-89d5-3b1c341efdb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:43 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-485a7ba1-495b-45d0-bb69-e2f5ea1e96fb tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Volume volume-f6fc71ff-50ed-48b3-8a0f-94b0678118b2 (f6fc71ff-50ed-48b3-8a0f-94b0678118b2): created successfully Nov 03 07:33:43 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-485a7ba1-495b-45d0-bb69-e2f5ea1e96fb tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acbe9c3f-a81c-4dc6-89d5-3b1c341efdb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:43 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-485a7ba1-495b-45d0-bb69-e2f5ea1e96fb tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Flow 'volume_create_manager' (3344e1eb-fd77-416c-9ad6-ff1de0932c9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:33:43 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-485a7ba1-495b-45d0-bb69-e2f5ea1e96fb tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Created volume successfully. Nov 03 07:33:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-d69c5665-4f50-49a2-b88b-ab9de65381bc tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-d69c5665-4f50-49a2-b88b-ab9de65381bc tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:44 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-d69c5665-4f50-49a2-b88b-ab9de65381bc tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Creating offline snapshot 7f340324-32b7-4fec-91e4-ea7c2ad57cad of volume f6fc71ff-50ed-48b3-8a0f-94b0678118b2 {{(pid=86875) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:33:44 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[daaaee01-eb9a-464b-8a90-2d3861a647cd]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:33:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d69c5665-4f50-49a2-b88b-ab9de65381bc tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f6fc71ff-50ed-48b3-8a0f-94b0678118b2 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:44 devstack sudo[94024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f6fc71ff-50ed-48b3-8a0f-94b0678118b2 Nov 03 07:33:44 devstack sudo[94024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:45 devstack sudo[94024]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d69c5665-4f50-49a2-b88b-ab9de65381bc tempest-VolumesSnapshotNegativeTestJSON-686800794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f6fc71ff-50ed-48b3-8a0f-94b0678118b2" returned: 0 in 0.674s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d69c5665-4f50-49a2-b88b-ab9de65381bc tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f6fc71ff-50ed-48b3-8a0f-94b0678118b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f6fc71ff-50ed-48b3-8a0f-94b0678118b2.7f340324-32b7-4fec-91e4-ea7c2ad57cad 2G {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:45 devstack sudo[94060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f6fc71ff-50ed-48b3-8a0f-94b0678118b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f6fc71ff-50ed-48b3-8a0f-94b0678118b2.7f340324-32b7-4fec-91e4-ea7c2ad57cad 2G Nov 03 07:33:45 devstack sudo[94060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:45 devstack sudo[94060]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d69c5665-4f50-49a2-b88b-ab9de65381bc tempest-VolumesSnapshotNegativeTestJSON-686800794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f6fc71ff-50ed-48b3-8a0f-94b0678118b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f6fc71ff-50ed-48b3-8a0f-94b0678118b2.7f340324-32b7-4fec-91e4-ea7c2ad57cad 2G" returned: 0 in 0.719s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d69c5665-4f50-49a2-b88b-ab9de65381bc tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6fc71ff-50ed-48b3-8a0f-94b0678118b2 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f6fc71ff-50ed-48b3-8a0f-94b0678118b2.7f340324-32b7-4fec-91e4-ea7c2ad57cad {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:45 devstack sudo[94066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6fc71ff-50ed-48b3-8a0f-94b0678118b2 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f6fc71ff-50ed-48b3-8a0f-94b0678118b2.7f340324-32b7-4fec-91e4-ea7c2ad57cad Nov 03 07:33:45 devstack sudo[94066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:46 devstack sudo[94066]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d69c5665-4f50-49a2-b88b-ab9de65381bc tempest-VolumesSnapshotNegativeTestJSON-686800794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6fc71ff-50ed-48b3-8a0f-94b0678118b2 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f6fc71ff-50ed-48b3-8a0f-94b0678118b2.7f340324-32b7-4fec-91e4-ea7c2ad57cad" returned: 0 in 0.441s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:46 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-d69c5665-4f50-49a2-b88b-ab9de65381bc tempest-VolumesSnapshotNegativeTestJSON-686800794 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f6fc71ff-50ed-48b3-8a0f-94b0678118b2.7f340324-32b7-4fec-91e4-ea7c2ad57cad is being set with open permissions: ugo+rw Nov 03 07:33:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d69c5665-4f50-49a2-b88b-ab9de65381bc tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f6fc71ff-50ed-48b3-8a0f-94b0678118b2.7f340324-32b7-4fec-91e4-ea7c2ad57cad {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:46 devstack sudo[94071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f6fc71ff-50ed-48b3-8a0f-94b0678118b2.7f340324-32b7-4fec-91e4-ea7c2ad57cad Nov 03 07:33:46 devstack sudo[94071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:46 devstack sudo[94071]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d69c5665-4f50-49a2-b88b-ab9de65381bc tempest-VolumesSnapshotNegativeTestJSON-686800794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f6fc71ff-50ed-48b3-8a0f-94b0678118b2.7f340324-32b7-4fec-91e4-ea7c2ad57cad" returned: 0 in 0.305s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d69c5665-4f50-49a2-b88b-ab9de65381bc tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f6fc71ff-50ed-48b3-8a0f-94b0678118b2.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:46 devstack sudo[94074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f6fc71ff-50ed-48b3-8a0f-94b0678118b2.info Nov 03 07:33:46 devstack sudo[94074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:46 devstack sudo[94074]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d69c5665-4f50-49a2-b88b-ab9de65381bc tempest-VolumesSnapshotNegativeTestJSON-686800794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f6fc71ff-50ed-48b3-8a0f-94b0678118b2.info" returned: 0 in 0.308s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:46 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-d69c5665-4f50-49a2-b88b-ab9de65381bc tempest-VolumesSnapshotNegativeTestJSON-686800794 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f6fc71ff-50ed-48b3-8a0f-94b0678118b2.info is being set with open permissions: ugo+rw Nov 03 07:33:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d69c5665-4f50-49a2-b88b-ab9de65381bc tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f6fc71ff-50ed-48b3-8a0f-94b0678118b2.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:46 devstack sudo[94077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f6fc71ff-50ed-48b3-8a0f-94b0678118b2.info Nov 03 07:33:46 devstack sudo[94077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:47 devstack sudo[94077]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:47 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d69c5665-4f50-49a2-b88b-ab9de65381bc tempest-VolumesSnapshotNegativeTestJSON-686800794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f6fc71ff-50ed-48b3-8a0f-94b0678118b2.info" returned: 0 in 0.282s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:47 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-d69c5665-4f50-49a2-b88b-ab9de65381bc tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.884s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:47 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-d69c5665-4f50-49a2-b88b-ab9de65381bc tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Create snapshot completed successfully Nov 03 07:33:47 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a0873696-e363-4ae2-880e-d45d442d7daa tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Acquiring lock "cinder-7f340324-32b7-4fec-91e4-ea7c2ad57cad-delete_snapshot" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:33:47 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a0873696-e363-4ae2-880e-d45d442d7daa tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Lock "cinder-7f340324-32b7-4fec-91e4-ea7c2ad57cad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:33:47 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a0873696-e363-4ae2-880e-d45d442d7daa tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Acquiring lock "cinder-quobyte-f6fc71ff-50ed-48b3-8a0f-94b0678118b2" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:33:47 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a0873696-e363-4ae2-880e-d45d442d7daa tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Lock "cinder-quobyte-f6fc71ff-50ed-48b3-8a0f-94b0678118b2" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:33:47 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a0873696-e363-4ae2-880e-d45d442d7daa tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Acquiring lock "cinder-quobyte-7f340324-32b7-4fec-91e4-ea7c2ad57cad" by "_delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:33:47 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a0873696-e363-4ae2-880e-d45d442d7daa tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Lock "cinder-quobyte-7f340324-32b7-4fec-91e4-ea7c2ad57cad" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:33:47 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-a0873696-e363-4ae2-880e-d45d442d7daa tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Deleting offline snapshot 7f340324-32b7-4fec-91e4-ea7c2ad57cad of volume f6fc71ff-50ed-48b3-8a0f-94b0678118b2 {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:33:47 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-a0873696-e363-4ae2-880e-d45d442d7daa tempest-VolumesSnapshotNegativeTestJSON-686800794 None] snapshot_file for this snap is: volume-f6fc71ff-50ed-48b3-8a0f-94b0678118b2.7f340324-32b7-4fec-91e4-ea7c2ad57cad {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:33:47 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dbb8518-b2ab-4ac9-8166-e8c738416f38]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:33:47 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a0873696-e363-4ae2-880e-d45d442d7daa tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f6fc71ff-50ed-48b3-8a0f-94b0678118b2.7f340324-32b7-4fec-91e4-ea7c2ad57cad {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:47 devstack sudo[94081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f6fc71ff-50ed-48b3-8a0f-94b0678118b2.7f340324-32b7-4fec-91e4-ea7c2ad57cad Nov 03 07:33:47 devstack sudo[94081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:48 devstack sudo[94081]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a0873696-e363-4ae2-880e-d45d442d7daa tempest-VolumesSnapshotNegativeTestJSON-686800794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f6fc71ff-50ed-48b3-8a0f-94b0678118b2.7f340324-32b7-4fec-91e4-ea7c2ad57cad" returned: 0 in 0.435s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:48 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-a0873696-e363-4ae2-880e-d45d442d7daa tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6fc71ff-50ed-48b3-8a0f-94b0678118b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:33:48 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ce6c24-d2ae-4a8a-88aa-b696d4a71fb8]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:33:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a0873696-e363-4ae2-880e-d45d442d7daa tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f6fc71ff-50ed-48b3-8a0f-94b0678118b2 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:48 devstack sudo[94086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f6fc71ff-50ed-48b3-8a0f-94b0678118b2 Nov 03 07:33:48 devstack sudo[94086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:48 devstack sudo[94086]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a0873696-e363-4ae2-880e-d45d442d7daa tempest-VolumesSnapshotNegativeTestJSON-686800794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f6fc71ff-50ed-48b3-8a0f-94b0678118b2" returned: 0 in 0.533s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a0873696-e363-4ae2-880e-d45d442d7daa tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f6fc71ff-50ed-48b3-8a0f-94b0678118b2.7f340324-32b7-4fec-91e4-ea7c2ad57cad {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:48 devstack sudo[94094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f6fc71ff-50ed-48b3-8a0f-94b0678118b2.7f340324-32b7-4fec-91e4-ea7c2ad57cad Nov 03 07:33:48 devstack sudo[94094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:49 devstack sudo[94094]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a0873696-e363-4ae2-880e-d45d442d7daa tempest-VolumesSnapshotNegativeTestJSON-686800794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f6fc71ff-50ed-48b3-8a0f-94b0678118b2.7f340324-32b7-4fec-91e4-ea7c2ad57cad" returned: 0 in 0.514s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a0873696-e363-4ae2-880e-d45d442d7daa tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f6fc71ff-50ed-48b3-8a0f-94b0678118b2.7f340324-32b7-4fec-91e4-ea7c2ad57cad {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:49 devstack sudo[94099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f6fc71ff-50ed-48b3-8a0f-94b0678118b2.7f340324-32b7-4fec-91e4-ea7c2ad57cad Nov 03 07:33:49 devstack sudo[94099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:49 devstack sudo[94099]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a0873696-e363-4ae2-880e-d45d442d7daa tempest-VolumesSnapshotNegativeTestJSON-686800794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f6fc71ff-50ed-48b3-8a0f-94b0678118b2.7f340324-32b7-4fec-91e4-ea7c2ad57cad" returned: 0 in 0.404s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:49 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-e43c5be3-4bf8-48ec-bf01-2778a830ae68 tempest-VolumesTransfersTest-1813382883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:33:49 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e43c5be3-4bf8-48ec-bf01-2778a830ae68 tempest-VolumesTransfersTest-1813382883 None] Flow 'volume_create_manager' (79a79502-06d1-4845-b751-47a76020a27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:33:49 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e43c5be3-4bf8-48ec-bf01-2778a830ae68 tempest-VolumesTransfersTest-1813382883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (351e5531-6b8d-4d48-b2e2-47f78da25519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:49 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a0873696-e363-4ae2-880e-d45d442d7daa tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Lock "cinder-quobyte-7f340324-32b7-4fec-91e4-ea7c2ad57cad" released by "_delete_snapshot" :: held 2.116s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:33:49 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e43c5be3-4bf8-48ec-bf01-2778a830ae68 tempest-VolumesTransfersTest-1813382883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (351e5531-6b8d-4d48-b2e2-47f78da25519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:33:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-460099700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=831a2fea-1430-4877-a2aa-dabe66a950e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e809aabba1aa4defab557bc605bcfb28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:33:50Z,use_quota=True,user_id='c58157da2c874458a907d946f817a524',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:49 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e43c5be3-4bf8-48ec-bf01-2778a830ae68 tempest-VolumesTransfersTest-1813382883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f7e95a6-e281-45f5-85f4-17973c01b16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:49 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e43c5be3-4bf8-48ec-bf01-2778a830ae68 tempest-VolumesTransfersTest-1813382883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f7e95a6-e281-45f5-85f4-17973c01b16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:49 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e43c5be3-4bf8-48ec-bf01-2778a830ae68 tempest-VolumesTransfersTest-1813382883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91966093-1d14-4e63-806e-3805594cf72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:49 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e43c5be3-4bf8-48ec-bf01-2778a830ae68 tempest-VolumesTransfersTest-1813382883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91966093-1d14-4e63-806e-3805594cf72a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '831a2fea-1430-4877-a2aa-dabe66a950e2', 'volume_name': 'volume-831a2fea-1430-4877-a2aa-dabe66a950e2', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:49 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e43c5be3-4bf8-48ec-bf01-2778a830ae68 tempest-VolumesTransfersTest-1813382883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eced9967-884f-42a5-b9bf-cf80d0f99c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:49 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e43c5be3-4bf8-48ec-bf01-2778a830ae68 tempest-VolumesTransfersTest-1813382883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eced9967-884f-42a5-b9bf-cf80d0f99c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:49 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e43c5be3-4bf8-48ec-bf01-2778a830ae68 tempest-VolumesTransfersTest-1813382883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e748d966-4af6-44b9-b0f0-07db1427a7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:49 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-e43c5be3-4bf8-48ec-bf01-2778a830ae68 tempest-VolumesTransfersTest-1813382883 None] Volume 831a2fea-1430-4877-a2aa-dabe66a950e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-831a2fea-1430-4877-a2aa-dabe66a950e2', 'volume_size': 1} Nov 03 07:33:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e43c5be3-4bf8-48ec-bf01-2778a830ae68 tempest-VolumesTransfersTest-1813382883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e43c5be3-4bf8-48ec-bf01-2778a830ae68 tempest-VolumesTransfersTest-1813382883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:49 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-e43c5be3-4bf8-48ec-bf01-2778a830ae68 tempest-VolumesTransfersTest-1813382883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:33:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-460099700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=831a2fea-1430-4877-a2aa-dabe66a950e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e809aabba1aa4defab557bc605bcfb28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:33:50Z,use_quota=True,user_id='c58157da2c874458a907d946f817a524',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:33:49 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-e43c5be3-4bf8-48ec-bf01-2778a830ae68 tempest-VolumesTransfersTest-1813382883 None] Creating volume 831a2fea-1430-4877-a2aa-dabe66a950e2 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:33:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e43c5be3-4bf8-48ec-bf01-2778a830ae68 tempest-VolumesTransfersTest-1813382883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e43c5be3-4bf8-48ec-bf01-2778a830ae68 tempest-VolumesTransfersTest-1813382883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:49 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-e43c5be3-4bf8-48ec-bf01-2778a830ae68 tempest-VolumesTransfersTest-1813382883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:33:49 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-e43c5be3-4bf8-48ec-bf01-2778a830ae68 tempest-VolumesTransfersTest-1813382883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:33:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e43c5be3-4bf8-48ec-bf01-2778a830ae68 tempest-VolumesTransfersTest-1813382883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:49 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-e43c5be3-4bf8-48ec-bf01-2778a830ae68 tempest-VolumesTransfersTest-1813382883 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:33:49 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-e43c5be3-4bf8-48ec-bf01-2778a830ae68 tempest-VolumesTransfersTest-1813382883 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:33:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e43c5be3-4bf8-48ec-bf01-2778a830ae68 tempest-VolumesTransfersTest-1813382883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-831a2fea-1430-4877-a2aa-dabe66a950e2 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:49 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a0873696-e363-4ae2-880e-d45d442d7daa tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Lock "cinder-quobyte-f6fc71ff-50ed-48b3-8a0f-94b0678118b2" released by "delete_snapshot" :: held 2.226s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:33:49 devstack sudo[94106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-831a2fea-1430-4877-a2aa-dabe66a950e2 1073741824 Nov 03 07:33:49 devstack sudo[94106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:50 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-a0873696-e363-4ae2-880e-d45d442d7daa tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Created reservations ['81f4e6b1-8939-48a5-848d-1cc4266bb4c3', '27504585-02ee-48ee-b41a-343a7af51ca6', '3673cfaf-4660-4369-b92a-bef8badaff48', '26a02ee7-efa7-4176-a8f3-e54f2bd0c5b0'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:33:50 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-a0873696-e363-4ae2-880e-d45d442d7daa tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Delete snapshot completed successfully. Nov 03 07:33:50 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a0873696-e363-4ae2-880e-d45d442d7daa tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Lock "cinder-7f340324-32b7-4fec-91e4-ea7c2ad57cad-delete_snapshot" released by "delete_snapshot" :: held 2.487s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:33:50 devstack sudo[94106]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e43c5be3-4bf8-48ec-bf01-2778a830ae68 tempest-VolumesTransfersTest-1813382883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-831a2fea-1430-4877-a2aa-dabe66a950e2 1073741824" returned: 0 in 0.716s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e43c5be3-4bf8-48ec-bf01-2778a830ae68 tempest-VolumesTransfersTest-1813382883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-831a2fea-1430-4877-a2aa-dabe66a950e2 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:50 devstack sudo[94118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-831a2fea-1430-4877-a2aa-dabe66a950e2 Nov 03 07:33:50 devstack sudo[94118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:51 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-b0ccb30e-0b40-4a96-8a9a-9a87eb67bcdd tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Acquiring lock "cinder-f6fc71ff-50ed-48b3-8a0f-94b0678118b2-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:33:51 devstack sudo[94118]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:51 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-b0ccb30e-0b40-4a96-8a9a-9a87eb67bcdd tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Lock "cinder-f6fc71ff-50ed-48b3-8a0f-94b0678118b2-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:33:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e43c5be3-4bf8-48ec-bf01-2778a830ae68 tempest-VolumesTransfersTest-1813382883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-831a2fea-1430-4877-a2aa-dabe66a950e2" returned: 0 in 0.505s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:51 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-e43c5be3-4bf8-48ec-bf01-2778a830ae68 tempest-VolumesTransfersTest-1813382883 None] <== create_volume: return (1309ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:33:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e43c5be3-4bf8-48ec-bf01-2778a830ae68 tempest-VolumesTransfersTest-1813382883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.312s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:51 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e43c5be3-4bf8-48ec-bf01-2778a830ae68 tempest-VolumesTransfersTest-1813382883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e748d966-4af6-44b9-b0f0-07db1427a7e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-831a2fea-1430-4877-a2aa-dabe66a950e2', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:51 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e43c5be3-4bf8-48ec-bf01-2778a830ae68 tempest-VolumesTransfersTest-1813382883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54a1c532-6932-4803-857c-60e3e585e373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:51 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-b0ccb30e-0b40-4a96-8a9a-9a87eb67bcdd tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Acquiring lock "cinder-quobyte-f6fc71ff-50ed-48b3-8a0f-94b0678118b2" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:33:51 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-e43c5be3-4bf8-48ec-bf01-2778a830ae68 tempest-VolumesTransfersTest-1813382883 None] Volume volume-831a2fea-1430-4877-a2aa-dabe66a950e2 (831a2fea-1430-4877-a2aa-dabe66a950e2): created successfully Nov 03 07:33:51 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e43c5be3-4bf8-48ec-bf01-2778a830ae68 tempest-VolumesTransfersTest-1813382883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54a1c532-6932-4803-857c-60e3e585e373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:51 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e43c5be3-4bf8-48ec-bf01-2778a830ae68 tempest-VolumesTransfersTest-1813382883 None] Flow 'volume_create_manager' (79a79502-06d1-4845-b751-47a76020a27c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:33:51 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-b0ccb30e-0b40-4a96-8a9a-9a87eb67bcdd tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Lock "cinder-quobyte-f6fc71ff-50ed-48b3-8a0f-94b0678118b2" acquired by "delete_volume" :: waited 0.082s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:33:51 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-e43c5be3-4bf8-48ec-bf01-2778a830ae68 tempest-VolumesTransfersTest-1813382883 None] Created volume successfully. Nov 03 07:33:51 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[57928fe7-6b55-41eb-b201-048074fd260e]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:33:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b0ccb30e-0b40-4a96-8a9a-9a87eb67bcdd tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f6fc71ff-50ed-48b3-8a0f-94b0678118b2 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:51 devstack sudo[94133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f6fc71ff-50ed-48b3-8a0f-94b0678118b2 Nov 03 07:33:51 devstack sudo[94133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:52 devstack sudo[94133]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b0ccb30e-0b40-4a96-8a9a-9a87eb67bcdd tempest-VolumesSnapshotNegativeTestJSON-686800794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f6fc71ff-50ed-48b3-8a0f-94b0678118b2" returned: 0 in 0.577s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b0ccb30e-0b40-4a96-8a9a-9a87eb67bcdd tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f6fc71ff-50ed-48b3-8a0f-94b0678118b2 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:52 devstack sudo[94138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f6fc71ff-50ed-48b3-8a0f-94b0678118b2 Nov 03 07:33:52 devstack sudo[94138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:52 devstack sudo[94138]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b0ccb30e-0b40-4a96-8a9a-9a87eb67bcdd tempest-VolumesSnapshotNegativeTestJSON-686800794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f6fc71ff-50ed-48b3-8a0f-94b0678118b2" returned: 0 in 0.481s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:52 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-b0ccb30e-0b40-4a96-8a9a-9a87eb67bcdd tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Lock "cinder-quobyte-f6fc71ff-50ed-48b3-8a0f-94b0678118b2" released by "delete_volume" :: held 1.199s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:33:52 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-b0ccb30e-0b40-4a96-8a9a-9a87eb67bcdd tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Created reservations ['51269d11-83d6-426c-aa2f-5ba3823e3b0d', 'ce8336d9-28f3-4ff7-b3f0-2a385067e823', '6810585c-3922-4a75-865a-4f218fe39160', '6a84430f-5498-48af-94fe-4b04edbe4aa9'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:33:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b0ccb30e-0b40-4a96-8a9a-9a87eb67bcdd tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b0ccb30e-0b40-4a96-8a9a-9a87eb67bcdd tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:52 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b0ccb30e-0b40-4a96-8a9a-9a87eb67bcdd tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:33:52 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b0ccb30e-0b40-4a96-8a9a-9a87eb67bcdd tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:33:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b0ccb30e-0b40-4a96-8a9a-9a87eb67bcdd tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b0ccb30e-0b40-4a96-8a9a-9a87eb67bcdd tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:52 devstack sudo[94153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:33:52 devstack sudo[94153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:53 devstack sudo[94153]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b0ccb30e-0b40-4a96-8a9a-9a87eb67bcdd tempest-VolumesSnapshotNegativeTestJSON-686800794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.357s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:53 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-b0ccb30e-0b40-4a96-8a9a-9a87eb67bcdd tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:33:53 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-b0ccb30e-0b40-4a96-8a9a-9a87eb67bcdd tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Deleted volume successfully. Nov 03 07:33:53 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-b0ccb30e-0b40-4a96-8a9a-9a87eb67bcdd tempest-VolumesSnapshotNegativeTestJSON-686800794 None] Lock "cinder-f6fc71ff-50ed-48b3-8a0f-94b0678118b2-delete_volume" released by "delete_volume" :: held 2.076s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:33:53 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-64ca6db0-5124-4041-83c6-dc6d829a1835 tempest-VolumesTransfersTest-1366336683 None] Transfer volume completed successfully. Nov 03 07:33:55 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-252af03f-6860-462a-b871-9562ddd75b4f tempest-VolumesTransfersTest-916717927 None] Acquiring lock "cinder-831a2fea-1430-4877-a2aa-dabe66a950e2-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:33:55 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-252af03f-6860-462a-b871-9562ddd75b4f tempest-VolumesTransfersTest-916717927 None] Lock "cinder-831a2fea-1430-4877-a2aa-dabe66a950e2-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:33:55 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-252af03f-6860-462a-b871-9562ddd75b4f tempest-VolumesTransfersTest-916717927 None] Acquiring lock "cinder-quobyte-831a2fea-1430-4877-a2aa-dabe66a950e2" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:33:55 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-252af03f-6860-462a-b871-9562ddd75b4f tempest-VolumesTransfersTest-916717927 None] Lock "cinder-quobyte-831a2fea-1430-4877-a2aa-dabe66a950e2" acquired by "delete_volume" :: waited 0.039s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:33:55 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[923357c7-7bf0-458b-8e2a-b0f0b7cb9512]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:33:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-252af03f-6860-462a-b871-9562ddd75b4f tempest-VolumesTransfersTest-916717927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-831a2fea-1430-4877-a2aa-dabe66a950e2 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:55 devstack sudo[94170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-831a2fea-1430-4877-a2aa-dabe66a950e2 Nov 03 07:33:55 devstack sudo[94170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:56 devstack sudo[94170]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-252af03f-6860-462a-b871-9562ddd75b4f tempest-VolumesTransfersTest-916717927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-831a2fea-1430-4877-a2aa-dabe66a950e2" returned: 0 in 1.113s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-252af03f-6860-462a-b871-9562ddd75b4f tempest-VolumesTransfersTest-916717927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-831a2fea-1430-4877-a2aa-dabe66a950e2 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:56 devstack sudo[94224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-831a2fea-1430-4877-a2aa-dabe66a950e2 Nov 03 07:33:56 devstack sudo[94224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:57 devstack sudo[94224]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-252af03f-6860-462a-b871-9562ddd75b4f tempest-VolumesTransfersTest-916717927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-831a2fea-1430-4877-a2aa-dabe66a950e2" returned: 0 in 0.571s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:57 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-252af03f-6860-462a-b871-9562ddd75b4f tempest-VolumesTransfersTest-916717927 None] Lock "cinder-quobyte-831a2fea-1430-4877-a2aa-dabe66a950e2" released by "delete_volume" :: held 1.846s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:33:57 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:SELECT=98,cinder:INSERT=34,cinder:UPDATE=154,cinder:DELETE=6 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:33:57 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:SELECT=89,cinder:INSERT=31,cinder:UPDATE=111,cinder:DELETE=15 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:33:57 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-252af03f-6860-462a-b871-9562ddd75b4f tempest-VolumesTransfersTest-916717927 None] Created reservations ['d517a4ec-fa6f-4a7a-b2d2-6ffe0c834989', '53357935-96b3-4331-8012-aeedde4c6f35', '000e2982-7bac-4cbf-8d32-9e9e383b984b', '146f6504-d5d9-484b-a32f-323eaa96678f'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:33:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-252af03f-6860-462a-b871-9562ddd75b4f tempest-VolumesTransfersTest-916717927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-252af03f-6860-462a-b871-9562ddd75b4f tempest-VolumesTransfersTest-916717927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:57 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-252af03f-6860-462a-b871-9562ddd75b4f tempest-VolumesTransfersTest-916717927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:33:57 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-252af03f-6860-462a-b871-9562ddd75b4f tempest-VolumesTransfersTest-916717927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:33:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-252af03f-6860-462a-b871-9562ddd75b4f tempest-VolumesTransfersTest-916717927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-252af03f-6860-462a-b871-9562ddd75b4f tempest-VolumesTransfersTest-916717927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:57 devstack sudo[94238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:33:57 devstack sudo[94238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:33:57 devstack sudo[94238]: pam_unix(sudo:session): session closed for user root Nov 03 07:33:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-252af03f-6860-462a-b871-9562ddd75b4f tempest-VolumesTransfersTest-916717927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.457s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:33:57 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-252af03f-6860-462a-b871-9562ddd75b4f tempest-VolumesTransfersTest-916717927 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:33:57 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-252af03f-6860-462a-b871-9562ddd75b4f tempest-VolumesTransfersTest-916717927 None] Deleted volume successfully. Nov 03 07:33:57 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-252af03f-6860-462a-b871-9562ddd75b4f tempest-VolumesTransfersTest-916717927 None] Lock "cinder-831a2fea-1430-4877-a2aa-dabe66a950e2-delete_volume" released by "delete_volume" :: held 2.855s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:33:58 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-f765802d-8a90-4586-adfa-21d03ab521c6 tempest-VolumesTransfersTest-1813382883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:33:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f765802d-8a90-4586-adfa-21d03ab521c6 tempest-VolumesTransfersTest-1813382883 None] Flow 'volume_create_manager' (91bda98b-1da1-496f-ac9c-47c91cd61780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:33:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f765802d-8a90-4586-adfa-21d03ab521c6 tempest-VolumesTransfersTest-1813382883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbfc448c-0fe1-4983-adb7-b8d762c3ff5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f765802d-8a90-4586-adfa-21d03ab521c6 tempest-VolumesTransfersTest-1813382883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbfc448c-0fe1-4983-adb7-b8d762c3ff5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:33:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-4051672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae416807-7591-42cc-9b6a-8f080b5928b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e809aabba1aa4defab557bc605bcfb28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:33:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:33:58Z,use_quota=True,user_id='c58157da2c874458a907d946f817a524',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f765802d-8a90-4586-adfa-21d03ab521c6 tempest-VolumesTransfersTest-1813382883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cdab907-d836-4e1c-812d-3b967c278e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f765802d-8a90-4586-adfa-21d03ab521c6 tempest-VolumesTransfersTest-1813382883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cdab907-d836-4e1c-812d-3b967c278e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f765802d-8a90-4586-adfa-21d03ab521c6 tempest-VolumesTransfersTest-1813382883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da144891-bfdf-4919-bc05-9681f15b47a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f765802d-8a90-4586-adfa-21d03ab521c6 tempest-VolumesTransfersTest-1813382883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da144891-bfdf-4919-bc05-9681f15b47a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae416807-7591-42cc-9b6a-8f080b5928b2', 'volume_name': 'volume-ae416807-7591-42cc-9b6a-8f080b5928b2', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f765802d-8a90-4586-adfa-21d03ab521c6 tempest-VolumesTransfersTest-1813382883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3f55db0-654a-4720-b4c4-7994b310f884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f765802d-8a90-4586-adfa-21d03ab521c6 tempest-VolumesTransfersTest-1813382883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3f55db0-654a-4720-b4c4-7994b310f884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:33:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f765802d-8a90-4586-adfa-21d03ab521c6 tempest-VolumesTransfersTest-1813382883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b66c142-d247-481e-bbab-3301760de4bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:33:58 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-f765802d-8a90-4586-adfa-21d03ab521c6 tempest-VolumesTransfersTest-1813382883 None] Volume ae416807-7591-42cc-9b6a-8f080b5928b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae416807-7591-42cc-9b6a-8f080b5928b2', 'volume_size': 1} Nov 03 07:33:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-f765802d-8a90-4586-adfa-21d03ab521c6 tempest-VolumesTransfersTest-1813382883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-f765802d-8a90-4586-adfa-21d03ab521c6 tempest-VolumesTransfersTest-1813382883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:58 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-f765802d-8a90-4586-adfa-21d03ab521c6 tempest-VolumesTransfersTest-1813382883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:33:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-4051672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae416807-7591-42cc-9b6a-8f080b5928b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e809aabba1aa4defab557bc605bcfb28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:33:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:33:58Z,use_quota=True,user_id='c58157da2c874458a907d946f817a524',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:33:58 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-f765802d-8a90-4586-adfa-21d03ab521c6 tempest-VolumesTransfersTest-1813382883 None] Creating volume ae416807-7591-42cc-9b6a-8f080b5928b2 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:33:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-f765802d-8a90-4586-adfa-21d03ab521c6 tempest-VolumesTransfersTest-1813382883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:33:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-f765802d-8a90-4586-adfa-21d03ab521c6 tempest-VolumesTransfersTest-1813382883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:33:58 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-f765802d-8a90-4586-adfa-21d03ab521c6 tempest-VolumesTransfersTest-1813382883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:33:59 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-f765802d-8a90-4586-adfa-21d03ab521c6 tempest-VolumesTransfersTest-1813382883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:33:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-f765802d-8a90-4586-adfa-21d03ab521c6 tempest-VolumesTransfersTest-1813382883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.085s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:33:59 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-f765802d-8a90-4586-adfa-21d03ab521c6 tempest-VolumesTransfersTest-1813382883 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:33:59 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-f765802d-8a90-4586-adfa-21d03ab521c6 tempest-VolumesTransfersTest-1813382883 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:33:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f765802d-8a90-4586-adfa-21d03ab521c6 tempest-VolumesTransfersTest-1813382883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ae416807-7591-42cc-9b6a-8f080b5928b2 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:33:59 devstack sudo[94254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ae416807-7591-42cc-9b6a-8f080b5928b2 1073741824 Nov 03 07:33:59 devstack sudo[94254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:00 devstack sudo[94254]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f765802d-8a90-4586-adfa-21d03ab521c6 tempest-VolumesTransfersTest-1813382883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ae416807-7591-42cc-9b6a-8f080b5928b2 1073741824" returned: 0 in 1.536s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f765802d-8a90-4586-adfa-21d03ab521c6 tempest-VolumesTransfersTest-1813382883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ae416807-7591-42cc-9b6a-8f080b5928b2 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:00 devstack sudo[94290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ae416807-7591-42cc-9b6a-8f080b5928b2 Nov 03 07:34:00 devstack sudo[94290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:01 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-60b0631d-c32c-4fc5-8900-2f6e7a3ba093 tempest-AttachVolumeNegativeTest-376242003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:34:01 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-60b0631d-c32c-4fc5-8900-2f6e7a3ba093 tempest-AttachVolumeNegativeTest-376242003 None] Flow 'volume_create_manager' (606f804a-493c-45c3-8d12-e0878f9b66b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:34:01 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-60b0631d-c32c-4fc5-8900-2f6e7a3ba093 tempest-AttachVolumeNegativeTest-376242003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f0b9cd2-683e-48f6-96d3-1e2971514f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:01 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-60b0631d-c32c-4fc5-8900-2f6e7a3ba093 tempest-AttachVolumeNegativeTest-376242003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f0b9cd2-683e-48f6-96d3-1e2971514f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-838829551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25386aa5-945f-4f69-9b1a-cae9c027fc04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60564972953a439ba57e1761dfc75f41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:34:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:34:01Z,use_quota=True,user_id='822a51fff8714448872da499e2386447',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:01 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-60b0631d-c32c-4fc5-8900-2f6e7a3ba093 tempest-AttachVolumeNegativeTest-376242003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b5161e9-da91-4e51-92fb-f4d321f4f51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:01 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-60b0631d-c32c-4fc5-8900-2f6e7a3ba093 tempest-AttachVolumeNegativeTest-376242003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b5161e9-da91-4e51-92fb-f4d321f4f51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:01 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-60b0631d-c32c-4fc5-8900-2f6e7a3ba093 tempest-AttachVolumeNegativeTest-376242003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bb4903f-85e0-4bde-a234-43dbe4c6524e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:01 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-60b0631d-c32c-4fc5-8900-2f6e7a3ba093 tempest-AttachVolumeNegativeTest-376242003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bb4903f-85e0-4bde-a234-43dbe4c6524e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25386aa5-945f-4f69-9b1a-cae9c027fc04', 'volume_name': 'volume-25386aa5-945f-4f69-9b1a-cae9c027fc04', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:01 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-60b0631d-c32c-4fc5-8900-2f6e7a3ba093 tempest-AttachVolumeNegativeTest-376242003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eee9f5b-35de-49a0-8fa7-ba6378cb7799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:01 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-60b0631d-c32c-4fc5-8900-2f6e7a3ba093 tempest-AttachVolumeNegativeTest-376242003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eee9f5b-35de-49a0-8fa7-ba6378cb7799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:01 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-60b0631d-c32c-4fc5-8900-2f6e7a3ba093 tempest-AttachVolumeNegativeTest-376242003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff02d3f5-f9f9-459d-b7f0-265ac19d4cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:01 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-60b0631d-c32c-4fc5-8900-2f6e7a3ba093 tempest-AttachVolumeNegativeTest-376242003 None] Volume 25386aa5-945f-4f69-9b1a-cae9c027fc04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25386aa5-945f-4f69-9b1a-cae9c027fc04', 'volume_size': 1} Nov 03 07:34:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-60b0631d-c32c-4fc5-8900-2f6e7a3ba093 tempest-AttachVolumeNegativeTest-376242003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:01 devstack sudo[94290]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f765802d-8a90-4586-adfa-21d03ab521c6 tempest-VolumesTransfersTest-1813382883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ae416807-7591-42cc-9b6a-8f080b5928b2" returned: 0 in 0.685s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:01 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-f765802d-8a90-4586-adfa-21d03ab521c6 tempest-VolumesTransfersTest-1813382883 None] <== create_volume: return (2461ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:34:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-f765802d-8a90-4586-adfa-21d03ab521c6 tempest-VolumesTransfersTest-1813382883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.464s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-60b0631d-c32c-4fc5-8900-2f6e7a3ba093 tempest-AttachVolumeNegativeTest-376242003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.095s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:01 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-60b0631d-c32c-4fc5-8900-2f6e7a3ba093 tempest-AttachVolumeNegativeTest-376242003 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-838829551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25386aa5-945f-4f69-9b1a-cae9c027fc04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60564972953a439ba57e1761dfc75f41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:34:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:34:01Z,use_quota=True,user_id='822a51fff8714448872da499e2386447',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:34:01 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-60b0631d-c32c-4fc5-8900-2f6e7a3ba093 tempest-AttachVolumeNegativeTest-376242003 None] Creating volume 25386aa5-945f-4f69-9b1a-cae9c027fc04 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:34:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-60b0631d-c32c-4fc5-8900-2f6e7a3ba093 tempest-AttachVolumeNegativeTest-376242003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-60b0631d-c32c-4fc5-8900-2f6e7a3ba093 tempest-AttachVolumeNegativeTest-376242003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:01 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-60b0631d-c32c-4fc5-8900-2f6e7a3ba093 tempest-AttachVolumeNegativeTest-376242003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:34:01 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-60b0631d-c32c-4fc5-8900-2f6e7a3ba093 tempest-AttachVolumeNegativeTest-376242003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:34:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-60b0631d-c32c-4fc5-8900-2f6e7a3ba093 tempest-AttachVolumeNegativeTest-376242003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:01 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-60b0631d-c32c-4fc5-8900-2f6e7a3ba093 tempest-AttachVolumeNegativeTest-376242003 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:34:01 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-60b0631d-c32c-4fc5-8900-2f6e7a3ba093 tempest-AttachVolumeNegativeTest-376242003 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:34:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-60b0631d-c32c-4fc5-8900-2f6e7a3ba093 tempest-AttachVolumeNegativeTest-376242003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-25386aa5-945f-4f69-9b1a-cae9c027fc04 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:01 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f765802d-8a90-4586-adfa-21d03ab521c6 tempest-VolumesTransfersTest-1813382883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b66c142-d247-481e-bbab-3301760de4bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae416807-7591-42cc-9b6a-8f080b5928b2', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:01 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f765802d-8a90-4586-adfa-21d03ab521c6 tempest-VolumesTransfersTest-1813382883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1feae3e6-b753-409e-9e82-a956d45e39ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:01 devstack sudo[94294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-25386aa5-945f-4f69-9b1a-cae9c027fc04 1073741824 Nov 03 07:34:01 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-f765802d-8a90-4586-adfa-21d03ab521c6 tempest-VolumesTransfersTest-1813382883 None] Volume volume-ae416807-7591-42cc-9b6a-8f080b5928b2 (ae416807-7591-42cc-9b6a-8f080b5928b2): created successfully Nov 03 07:34:01 devstack sudo[94294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:01 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f765802d-8a90-4586-adfa-21d03ab521c6 tempest-VolumesTransfersTest-1813382883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1feae3e6-b753-409e-9e82-a956d45e39ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:01 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f765802d-8a90-4586-adfa-21d03ab521c6 tempest-VolumesTransfersTest-1813382883 None] Flow 'volume_create_manager' (91bda98b-1da1-496f-ac9c-47c91cd61780) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:34:01 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-f765802d-8a90-4586-adfa-21d03ab521c6 tempest-VolumesTransfersTest-1813382883 None] Created volume successfully. Nov 03 07:34:02 devstack sudo[94294]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-60b0631d-c32c-4fc5-8900-2f6e7a3ba093 tempest-AttachVolumeNegativeTest-376242003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-25386aa5-945f-4f69-9b1a-cae9c027fc04 1073741824" returned: 0 in 1.333s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:02 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a2dad856-7a7f-4644-bf68-c57aa5d0d9af tempest-VolumesTransfersTest-916717927 None] Acquiring lock "cinder-ae416807-7591-42cc-9b6a-8f080b5928b2-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:34:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-60b0631d-c32c-4fc5-8900-2f6e7a3ba093 tempest-AttachVolumeNegativeTest-376242003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-25386aa5-945f-4f69-9b1a-cae9c027fc04 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:03 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a2dad856-7a7f-4644-bf68-c57aa5d0d9af tempest-VolumesTransfersTest-916717927 None] Lock "cinder-ae416807-7591-42cc-9b6a-8f080b5928b2-delete_volume" acquired by "delete_volume" :: waited 0.101s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:34:03 devstack sudo[94302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-25386aa5-945f-4f69-9b1a-cae9c027fc04 Nov 03 07:34:03 devstack sudo[94302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:03 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a2dad856-7a7f-4644-bf68-c57aa5d0d9af tempest-VolumesTransfersTest-916717927 None] Acquiring lock "cinder-quobyte-ae416807-7591-42cc-9b6a-8f080b5928b2" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:34:03 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a2dad856-7a7f-4644-bf68-c57aa5d0d9af tempest-VolumesTransfersTest-916717927 None] Lock "cinder-quobyte-ae416807-7591-42cc-9b6a-8f080b5928b2" acquired by "delete_volume" :: waited 0.032s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:34:03 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[32bf7642-9bb0-455c-a640-29c570e4ce49]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:34:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a2dad856-7a7f-4644-bf68-c57aa5d0d9af tempest-VolumesTransfersTest-916717927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ae416807-7591-42cc-9b6a-8f080b5928b2 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:03 devstack sudo[94304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ae416807-7591-42cc-9b6a-8f080b5928b2 Nov 03 07:34:03 devstack sudo[94304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:03 devstack cinder-volume[86875]: DEBUG oslo_service.periodic_task [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86875) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:34:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:34:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:34:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:03 devstack sudo[94307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:34:03 devstack sudo[94307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:03 devstack sudo[94302]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-60b0631d-c32c-4fc5-8900-2f6e7a3ba093 tempest-AttachVolumeNegativeTest-376242003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-25386aa5-945f-4f69-9b1a-cae9c027fc04" returned: 0 in 0.693s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-60b0631d-c32c-4fc5-8900-2f6e7a3ba093 tempest-AttachVolumeNegativeTest-376242003 None] <== create_volume: return (2242ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:34:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-60b0631d-c32c-4fc5-8900-2f6e7a3ba093 tempest-AttachVolumeNegativeTest-376242003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.248s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:03 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-60b0631d-c32c-4fc5-8900-2f6e7a3ba093 tempest-AttachVolumeNegativeTest-376242003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff02d3f5-f9f9-459d-b7f0-265ac19d4cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25386aa5-945f-4f69-9b1a-cae9c027fc04', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:03 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-60b0631d-c32c-4fc5-8900-2f6e7a3ba093 tempest-AttachVolumeNegativeTest-376242003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81ef7439-b1c3-4b74-9fa3-2e50c079e577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:03 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-60b0631d-c32c-4fc5-8900-2f6e7a3ba093 tempest-AttachVolumeNegativeTest-376242003 None] Volume volume-25386aa5-945f-4f69-9b1a-cae9c027fc04 (25386aa5-945f-4f69-9b1a-cae9c027fc04): created successfully Nov 03 07:34:03 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-60b0631d-c32c-4fc5-8900-2f6e7a3ba093 tempest-AttachVolumeNegativeTest-376242003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81ef7439-b1c3-4b74-9fa3-2e50c079e577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:03 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-60b0631d-c32c-4fc5-8900-2f6e7a3ba093 tempest-AttachVolumeNegativeTest-376242003 None] Flow 'volume_create_manager' (606f804a-493c-45c3-8d12-e0878f9b66b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:34:03 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-60b0631d-c32c-4fc5-8900-2f6e7a3ba093 tempest-AttachVolumeNegativeTest-376242003 None] Created volume successfully. Nov 03 07:34:03 devstack sudo[94304]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a2dad856-7a7f-4644-bf68-c57aa5d0d9af tempest-VolumesTransfersTest-916717927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ae416807-7591-42cc-9b6a-8f080b5928b2" returned: 0 in 0.631s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a2dad856-7a7f-4644-bf68-c57aa5d0d9af tempest-VolumesTransfersTest-916717927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ae416807-7591-42cc-9b6a-8f080b5928b2 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:03 devstack sudo[94312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ae416807-7591-42cc-9b6a-8f080b5928b2 Nov 03 07:34:03 devstack sudo[94312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:04 devstack sudo[94307]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.498s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:04 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:34:04 devstack cinder-volume[86875]: DEBUG oslo_service.periodic_task [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running periodic task VolumeManager._thread_info {{(pid=86875) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:34:04 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] thread count: 28 {{(pid=86875) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:34:04 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] thread info: [<_MainThread(MainThread, started 125626325639296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86875) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:34:04 devstack sudo[94312]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a2dad856-7a7f-4644-bf68-c57aa5d0d9af tempest-VolumesTransfersTest-916717927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ae416807-7591-42cc-9b6a-8f080b5928b2" returned: 0 in 0.489s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:04 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a2dad856-7a7f-4644-bf68-c57aa5d0d9af tempest-VolumesTransfersTest-916717927 None] Lock "cinder-quobyte-ae416807-7591-42cc-9b6a-8f080b5928b2" released by "delete_volume" :: held 1.267s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:34:04 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-a2dad856-7a7f-4644-bf68-c57aa5d0d9af tempest-VolumesTransfersTest-916717927 None] Created reservations ['b5bd949a-2872-4c52-baec-de5f7a50a043', 'c1bcc8fe-ea76-48ed-ab0b-dacdd14b7da8', '6f229f5c-9fe7-4286-ad68-7558d6998052', '60763726-c66e-466d-be51-abe9fcb5bcb2'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:34:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a2dad856-7a7f-4644-bf68-c57aa5d0d9af tempest-VolumesTransfersTest-916717927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a2dad856-7a7f-4644-bf68-c57aa5d0d9af tempest-VolumesTransfersTest-916717927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:04 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a2dad856-7a7f-4644-bf68-c57aa5d0d9af tempest-VolumesTransfersTest-916717927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:34:04 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a2dad856-7a7f-4644-bf68-c57aa5d0d9af tempest-VolumesTransfersTest-916717927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:34:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a2dad856-7a7f-4644-bf68-c57aa5d0d9af tempest-VolumesTransfersTest-916717927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a2dad856-7a7f-4644-bf68-c57aa5d0d9af tempest-VolumesTransfersTest-916717927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:04 devstack sudo[94316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:34:04 devstack sudo[94316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:05 devstack sudo[94316]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a2dad856-7a7f-4644-bf68-c57aa5d0d9af tempest-VolumesTransfersTest-916717927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.715s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:05 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-a2dad856-7a7f-4644-bf68-c57aa5d0d9af tempest-VolumesTransfersTest-916717927 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:34:05 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-a2dad856-7a7f-4644-bf68-c57aa5d0d9af tempest-VolumesTransfersTest-916717927 None] Deleted volume successfully. Nov 03 07:34:05 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a2dad856-7a7f-4644-bf68-c57aa5d0d9af tempest-VolumesTransfersTest-916717927 None] Lock "cinder-ae416807-7591-42cc-9b6a-8f080b5928b2-delete_volume" released by "delete_volume" :: held 2.571s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:34:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-94763981-301e-4e8b-b98e-8c971b8f512c req-42c47766-86ef-4194-aed8-d10dde1aebe6 tempest-AttachVolumeNegativeTest-376242003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-94763981-301e-4e8b-b98e-8c971b8f512c req-42c47766-86ef-4194-aed8-d10dde1aebe6 tempest-AttachVolumeNegativeTest-376242003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-94763981-301e-4e8b-b98e-8c971b8f512c req-42c47766-86ef-4194-aed8-d10dde1aebe6 tempest-AttachVolumeNegativeTest-376242003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.048s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:07 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-94763981-301e-4e8b-b98e-8c971b8f512c req-42c47766-86ef-4194-aed8-d10dde1aebe6 tempest-AttachVolumeNegativeTest-376242003 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1', 'name': 'volume-25386aa5-945f-4f69-9b1a-cae9c027fc04', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fbefebec-46a3-484c-8794-9f09c32a1e52', 'enforce_multipath': True} {{(pid=86875) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:34:07 devstack cinder-volume[86875]: INFO cinder.volume.manager [req-94763981-301e-4e8b-b98e-8c971b8f512c req-42c47766-86ef-4194-aed8-d10dde1aebe6 tempest-AttachVolumeNegativeTest-376242003 None] attachment_update completed successfully. Nov 03 07:34:17 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:SELECT=23,cinder:INSERT=6,cinder:UPDATE=22,cinder:DELETE=2 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:34:17 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:SELECT=14,cinder:INSERT=4,cinder:UPDATE=24,cinder:DELETE=2 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:34:19 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2e27293-fdc1-4d0d-91c5-5a00641849bb tempest-ServerRescueNegativeTestJSON-1493427581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:34:19 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a2e27293-fdc1-4d0d-91c5-5a00641849bb tempest-ServerRescueNegativeTestJSON-1493427581 None] Flow 'volume_create_manager' (f77735fb-5663-49bf-b888-338505ee66aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:34:19 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a2e27293-fdc1-4d0d-91c5-5a00641849bb tempest-ServerRescueNegativeTestJSON-1493427581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c98df82-fc4b-4630-b62a-f301dc37e126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:19 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a2e27293-fdc1-4d0d-91c5-5a00641849bb tempest-ServerRescueNegativeTestJSON-1493427581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c98df82-fc4b-4630-b62a-f301dc37e126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-895555432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4350f5da-ab73-4110-9b7b-d1d46049492b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564ef7347c844c3aac66803d83d185d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:34:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:34:20Z,use_quota=True,user_id='8a14f75a9ae949f18aed98550e491e77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:19 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a2e27293-fdc1-4d0d-91c5-5a00641849bb tempest-ServerRescueNegativeTestJSON-1493427581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4611492d-f081-4566-838f-634613eae4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:19 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a2e27293-fdc1-4d0d-91c5-5a00641849bb tempest-ServerRescueNegativeTestJSON-1493427581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4611492d-f081-4566-838f-634613eae4a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:19 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a2e27293-fdc1-4d0d-91c5-5a00641849bb tempest-ServerRescueNegativeTestJSON-1493427581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fb24fab-39cc-4f74-babc-f2b5213dba92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:19 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a2e27293-fdc1-4d0d-91c5-5a00641849bb tempest-ServerRescueNegativeTestJSON-1493427581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fb24fab-39cc-4f74-babc-f2b5213dba92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4350f5da-ab73-4110-9b7b-d1d46049492b', 'volume_name': 'volume-4350f5da-ab73-4110-9b7b-d1d46049492b', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:19 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a2e27293-fdc1-4d0d-91c5-5a00641849bb tempest-ServerRescueNegativeTestJSON-1493427581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4a3095f-2746-4c3c-b204-2d51b6c7d5f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:19 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a2e27293-fdc1-4d0d-91c5-5a00641849bb tempest-ServerRescueNegativeTestJSON-1493427581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4a3095f-2746-4c3c-b204-2d51b6c7d5f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:19 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a2e27293-fdc1-4d0d-91c5-5a00641849bb tempest-ServerRescueNegativeTestJSON-1493427581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a6e1694-9c0c-4b36-8755-413758b6a565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:19 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-a2e27293-fdc1-4d0d-91c5-5a00641849bb tempest-ServerRescueNegativeTestJSON-1493427581 None] Volume 4350f5da-ab73-4110-9b7b-d1d46049492b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4350f5da-ab73-4110-9b7b-d1d46049492b', 'volume_size': 1} Nov 03 07:34:19 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a2e27293-fdc1-4d0d-91c5-5a00641849bb tempest-ServerRescueNegativeTestJSON-1493427581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:19 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a2e27293-fdc1-4d0d-91c5-5a00641849bb tempest-ServerRescueNegativeTestJSON-1493427581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:19 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a2e27293-fdc1-4d0d-91c5-5a00641849bb tempest-ServerRescueNegativeTestJSON-1493427581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-895555432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4350f5da-ab73-4110-9b7b-d1d46049492b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564ef7347c844c3aac66803d83d185d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:34:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:34:20Z,use_quota=True,user_id='8a14f75a9ae949f18aed98550e491e77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:34:19 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-a2e27293-fdc1-4d0d-91c5-5a00641849bb tempest-ServerRescueNegativeTestJSON-1493427581 None] Creating volume 4350f5da-ab73-4110-9b7b-d1d46049492b {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:34:19 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a2e27293-fdc1-4d0d-91c5-5a00641849bb tempest-ServerRescueNegativeTestJSON-1493427581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:19 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a2e27293-fdc1-4d0d-91c5-5a00641849bb tempest-ServerRescueNegativeTestJSON-1493427581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:19 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a2e27293-fdc1-4d0d-91c5-5a00641849bb tempest-ServerRescueNegativeTestJSON-1493427581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:34:19 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a2e27293-fdc1-4d0d-91c5-5a00641849bb tempest-ServerRescueNegativeTestJSON-1493427581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:34:19 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a2e27293-fdc1-4d0d-91c5-5a00641849bb tempest-ServerRescueNegativeTestJSON-1493427581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:19 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a2e27293-fdc1-4d0d-91c5-5a00641849bb tempest-ServerRescueNegativeTestJSON-1493427581 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:34:19 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-a2e27293-fdc1-4d0d-91c5-5a00641849bb tempest-ServerRescueNegativeTestJSON-1493427581 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:34:19 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a2e27293-fdc1-4d0d-91c5-5a00641849bb tempest-ServerRescueNegativeTestJSON-1493427581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4350f5da-ab73-4110-9b7b-d1d46049492b 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:19 devstack sudo[94875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4350f5da-ab73-4110-9b7b-d1d46049492b 1073741824 Nov 03 07:34:19 devstack sudo[94875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:20 devstack sudo[94875]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a2e27293-fdc1-4d0d-91c5-5a00641849bb tempest-ServerRescueNegativeTestJSON-1493427581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4350f5da-ab73-4110-9b7b-d1d46049492b 1073741824" returned: 0 in 1.086s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a2e27293-fdc1-4d0d-91c5-5a00641849bb tempest-ServerRescueNegativeTestJSON-1493427581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4350f5da-ab73-4110-9b7b-d1d46049492b {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:21 devstack sudo[94881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4350f5da-ab73-4110-9b7b-d1d46049492b Nov 03 07:34:21 devstack sudo[94881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:21 devstack sudo[94881]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a2e27293-fdc1-4d0d-91c5-5a00641849bb tempest-ServerRescueNegativeTestJSON-1493427581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4350f5da-ab73-4110-9b7b-d1d46049492b" returned: 0 in 0.637s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:21 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a2e27293-fdc1-4d0d-91c5-5a00641849bb tempest-ServerRescueNegativeTestJSON-1493427581 None] <== create_volume: return (1825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:34:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a2e27293-fdc1-4d0d-91c5-5a00641849bb tempest-ServerRescueNegativeTestJSON-1493427581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.828s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:21 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a2e27293-fdc1-4d0d-91c5-5a00641849bb tempest-ServerRescueNegativeTestJSON-1493427581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a6e1694-9c0c-4b36-8755-413758b6a565) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4350f5da-ab73-4110-9b7b-d1d46049492b', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:21 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a2e27293-fdc1-4d0d-91c5-5a00641849bb tempest-ServerRescueNegativeTestJSON-1493427581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2031ef5-ae0e-457c-8941-7531f77c198a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:21 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-a2e27293-fdc1-4d0d-91c5-5a00641849bb tempest-ServerRescueNegativeTestJSON-1493427581 None] Volume volume-4350f5da-ab73-4110-9b7b-d1d46049492b (4350f5da-ab73-4110-9b7b-d1d46049492b): created successfully Nov 03 07:34:21 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a2e27293-fdc1-4d0d-91c5-5a00641849bb tempest-ServerRescueNegativeTestJSON-1493427581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2031ef5-ae0e-457c-8941-7531f77c198a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:21 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a2e27293-fdc1-4d0d-91c5-5a00641849bb tempest-ServerRescueNegativeTestJSON-1493427581 None] Flow 'volume_create_manager' (f77735fb-5663-49bf-b888-338505ee66aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:34:21 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-a2e27293-fdc1-4d0d-91c5-5a00641849bb tempest-ServerRescueNegativeTestJSON-1493427581 None] Created volume successfully. Nov 03 07:34:27 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-3966ce03-0e12-4f8d-80a9-7c41784d4fc6 tempest-VolumesTransfersV357Test-947552926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:34:27 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3966ce03-0e12-4f8d-80a9-7c41784d4fc6 tempest-VolumesTransfersV357Test-947552926 None] Flow 'volume_create_manager' (ea438fa6-7e41-4ed4-b92e-48a5c9973586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:34:27 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3966ce03-0e12-4f8d-80a9-7c41784d4fc6 tempest-VolumesTransfersV357Test-947552926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07fda29e-3f57-4caf-8d9a-61d06cd202fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:27 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3966ce03-0e12-4f8d-80a9-7c41784d4fc6 tempest-VolumesTransfersV357Test-947552926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07fda29e-3f57-4caf-8d9a-61d06cd202fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-146617205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfb4ba6c-aadc-43bb-83c2-86da22a8248b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2653a7a1754417c82ba6266add55c81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:34:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:34:27Z,use_quota=True,user_id='846af8309cf04213a38a95c8397e6f62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:27 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3966ce03-0e12-4f8d-80a9-7c41784d4fc6 tempest-VolumesTransfersV357Test-947552926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40deed52-7b1a-492d-b0bd-a9c153eb0906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:27 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3966ce03-0e12-4f8d-80a9-7c41784d4fc6 tempest-VolumesTransfersV357Test-947552926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40deed52-7b1a-492d-b0bd-a9c153eb0906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:27 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3966ce03-0e12-4f8d-80a9-7c41784d4fc6 tempest-VolumesTransfersV357Test-947552926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22bc8326-f566-48cb-84d2-8dc4f2235a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:27 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3966ce03-0e12-4f8d-80a9-7c41784d4fc6 tempest-VolumesTransfersV357Test-947552926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22bc8326-f566-48cb-84d2-8dc4f2235a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfb4ba6c-aadc-43bb-83c2-86da22a8248b', 'volume_name': 'volume-cfb4ba6c-aadc-43bb-83c2-86da22a8248b', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:27 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3966ce03-0e12-4f8d-80a9-7c41784d4fc6 tempest-VolumesTransfersV357Test-947552926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd909cf6-fda7-474e-ac7c-f66c7ce0d389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:27 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3966ce03-0e12-4f8d-80a9-7c41784d4fc6 tempest-VolumesTransfersV357Test-947552926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd909cf6-fda7-474e-ac7c-f66c7ce0d389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:27 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3966ce03-0e12-4f8d-80a9-7c41784d4fc6 tempest-VolumesTransfersV357Test-947552926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (428f44a1-f672-4921-8b8e-896a8c9db20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:27 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-3966ce03-0e12-4f8d-80a9-7c41784d4fc6 tempest-VolumesTransfersV357Test-947552926 None] Volume cfb4ba6c-aadc-43bb-83c2-86da22a8248b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfb4ba6c-aadc-43bb-83c2-86da22a8248b', 'volume_size': 1} Nov 03 07:34:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3966ce03-0e12-4f8d-80a9-7c41784d4fc6 tempest-VolumesTransfersV357Test-947552926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3966ce03-0e12-4f8d-80a9-7c41784d4fc6 tempest-VolumesTransfersV357Test-947552926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:27 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-3966ce03-0e12-4f8d-80a9-7c41784d4fc6 tempest-VolumesTransfersV357Test-947552926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-146617205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfb4ba6c-aadc-43bb-83c2-86da22a8248b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2653a7a1754417c82ba6266add55c81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:34:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:34:27Z,use_quota=True,user_id='846af8309cf04213a38a95c8397e6f62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:34:27 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-3966ce03-0e12-4f8d-80a9-7c41784d4fc6 tempest-VolumesTransfersV357Test-947552926 None] Creating volume cfb4ba6c-aadc-43bb-83c2-86da22a8248b {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:34:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3966ce03-0e12-4f8d-80a9-7c41784d4fc6 tempest-VolumesTransfersV357Test-947552926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3966ce03-0e12-4f8d-80a9-7c41784d4fc6 tempest-VolumesTransfersV357Test-947552926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:27 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-3966ce03-0e12-4f8d-80a9-7c41784d4fc6 tempest-VolumesTransfersV357Test-947552926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:34:27 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-3966ce03-0e12-4f8d-80a9-7c41784d4fc6 tempest-VolumesTransfersV357Test-947552926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:34:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3966ce03-0e12-4f8d-80a9-7c41784d4fc6 tempest-VolumesTransfersV357Test-947552926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:27 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-3966ce03-0e12-4f8d-80a9-7c41784d4fc6 tempest-VolumesTransfersV357Test-947552926 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:34:27 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-3966ce03-0e12-4f8d-80a9-7c41784d4fc6 tempest-VolumesTransfersV357Test-947552926 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:34:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3966ce03-0e12-4f8d-80a9-7c41784d4fc6 tempest-VolumesTransfersV357Test-947552926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cfb4ba6c-aadc-43bb-83c2-86da22a8248b 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:27 devstack sudo[94949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cfb4ba6c-aadc-43bb-83c2-86da22a8248b 1073741824 Nov 03 07:34:27 devstack sudo[94949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:28 devstack sudo[94949]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3966ce03-0e12-4f8d-80a9-7c41784d4fc6 tempest-VolumesTransfersV357Test-947552926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cfb4ba6c-aadc-43bb-83c2-86da22a8248b 1073741824" returned: 0 in 0.698s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3966ce03-0e12-4f8d-80a9-7c41784d4fc6 tempest-VolumesTransfersV357Test-947552926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cfb4ba6c-aadc-43bb-83c2-86da22a8248b {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:28 devstack sudo[94980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cfb4ba6c-aadc-43bb-83c2-86da22a8248b Nov 03 07:34:28 devstack sudo[94980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:28 devstack sudo[94980]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3966ce03-0e12-4f8d-80a9-7c41784d4fc6 tempest-VolumesTransfersV357Test-947552926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cfb4ba6c-aadc-43bb-83c2-86da22a8248b" returned: 0 in 0.397s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:28 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-3966ce03-0e12-4f8d-80a9-7c41784d4fc6 tempest-VolumesTransfersV357Test-947552926 None] <== create_volume: return (1178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:34:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3966ce03-0e12-4f8d-80a9-7c41784d4fc6 tempest-VolumesTransfersV357Test-947552926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:28 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3966ce03-0e12-4f8d-80a9-7c41784d4fc6 tempest-VolumesTransfersV357Test-947552926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (428f44a1-f672-4921-8b8e-896a8c9db20f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfb4ba6c-aadc-43bb-83c2-86da22a8248b', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:28 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3966ce03-0e12-4f8d-80a9-7c41784d4fc6 tempest-VolumesTransfersV357Test-947552926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6afbbbf4-b2d9-463a-8d25-91512c80b213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:28 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-3966ce03-0e12-4f8d-80a9-7c41784d4fc6 tempest-VolumesTransfersV357Test-947552926 None] Volume volume-cfb4ba6c-aadc-43bb-83c2-86da22a8248b (cfb4ba6c-aadc-43bb-83c2-86da22a8248b): created successfully Nov 03 07:34:28 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3966ce03-0e12-4f8d-80a9-7c41784d4fc6 tempest-VolumesTransfersV357Test-947552926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6afbbbf4-b2d9-463a-8d25-91512c80b213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:28 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3966ce03-0e12-4f8d-80a9-7c41784d4fc6 tempest-VolumesTransfersV357Test-947552926 None] Flow 'volume_create_manager' (ea438fa6-7e41-4ed4-b92e-48a5c9973586) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:34:28 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-3966ce03-0e12-4f8d-80a9-7c41784d4fc6 tempest-VolumesTransfersV357Test-947552926 None] Created volume successfully. Nov 03 07:34:31 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-ac0928a8-3e33-424b-a64b-66d260d401f4 tempest-VolumesTransfersV357Test-289801026 None] Transfer volume completed successfully. Nov 03 07:34:33 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-3cd594dc-07b2-4c97-b75d-01350a06ef56 tempest-VolumesTransfersV357Test-527924947 None] Acquiring lock "cinder-cfb4ba6c-aadc-43bb-83c2-86da22a8248b-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:34:33 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-3cd594dc-07b2-4c97-b75d-01350a06ef56 tempest-VolumesTransfersV357Test-527924947 None] Lock "cinder-cfb4ba6c-aadc-43bb-83c2-86da22a8248b-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:34:33 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-3cd594dc-07b2-4c97-b75d-01350a06ef56 tempest-VolumesTransfersV357Test-527924947 None] Acquiring lock "cinder-quobyte-cfb4ba6c-aadc-43bb-83c2-86da22a8248b" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:34:33 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-3cd594dc-07b2-4c97-b75d-01350a06ef56 tempest-VolumesTransfersV357Test-527924947 None] Lock "cinder-quobyte-cfb4ba6c-aadc-43bb-83c2-86da22a8248b" acquired by "delete_volume" :: waited 0.050s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:34:33 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae4c00c-c9e8-4722-bed4-b23e091f859f]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:34:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3cd594dc-07b2-4c97-b75d-01350a06ef56 tempest-VolumesTransfersV357Test-527924947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cfb4ba6c-aadc-43bb-83c2-86da22a8248b {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:33 devstack sudo[95093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cfb4ba6c-aadc-43bb-83c2-86da22a8248b Nov 03 07:34:33 devstack sudo[95093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:34 devstack sudo[95093]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3cd594dc-07b2-4c97-b75d-01350a06ef56 tempest-VolumesTransfersV357Test-527924947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cfb4ba6c-aadc-43bb-83c2-86da22a8248b" returned: 0 in 0.791s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3cd594dc-07b2-4c97-b75d-01350a06ef56 tempest-VolumesTransfersV357Test-527924947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cfb4ba6c-aadc-43bb-83c2-86da22a8248b {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:34 devstack sudo[95101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cfb4ba6c-aadc-43bb-83c2-86da22a8248b Nov 03 07:34:34 devstack sudo[95101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:35 devstack sudo[95101]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3cd594dc-07b2-4c97-b75d-01350a06ef56 tempest-VolumesTransfersV357Test-527924947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cfb4ba6c-aadc-43bb-83c2-86da22a8248b" returned: 0 in 0.826s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:35 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-3cd594dc-07b2-4c97-b75d-01350a06ef56 tempest-VolumesTransfersV357Test-527924947 None] Lock "cinder-quobyte-cfb4ba6c-aadc-43bb-83c2-86da22a8248b" released by "delete_volume" :: held 1.747s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:34:35 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-3cd594dc-07b2-4c97-b75d-01350a06ef56 tempest-VolumesTransfersV357Test-527924947 None] Created reservations ['f8cd0560-a117-4b02-9a2c-2cf2dc138d29', 'e93c2692-8c6d-4da6-81e4-cd5f1691dd10', '54e32b1e-59d9-4a49-92ad-1207ee422d45', '0f25f584-4df8-4128-8c90-51b1b4fe2bc7'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:34:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3cd594dc-07b2-4c97-b75d-01350a06ef56 tempest-VolumesTransfersV357Test-527924947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3cd594dc-07b2-4c97-b75d-01350a06ef56 tempest-VolumesTransfersV357Test-527924947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:35 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-3cd594dc-07b2-4c97-b75d-01350a06ef56 tempest-VolumesTransfersV357Test-527924947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:34:35 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-3cd594dc-07b2-4c97-b75d-01350a06ef56 tempest-VolumesTransfersV357Test-527924947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:34:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3cd594dc-07b2-4c97-b75d-01350a06ef56 tempest-VolumesTransfersV357Test-527924947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3cd594dc-07b2-4c97-b75d-01350a06ef56 tempest-VolumesTransfersV357Test-527924947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:35 devstack sudo[95105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:34:35 devstack sudo[95105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:36 devstack sudo[95105]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:36 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3cd594dc-07b2-4c97-b75d-01350a06ef56 tempest-VolumesTransfersV357Test-527924947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.649s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:36 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-3cd594dc-07b2-4c97-b75d-01350a06ef56 tempest-VolumesTransfersV357Test-527924947 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:34:36 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-3cd594dc-07b2-4c97-b75d-01350a06ef56 tempest-VolumesTransfersV357Test-527924947 None] Deleted volume successfully. Nov 03 07:34:36 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-3cd594dc-07b2-4c97-b75d-01350a06ef56 tempest-VolumesTransfersV357Test-527924947 None] Lock "cinder-cfb4ba6c-aadc-43bb-83c2-86da22a8248b-delete_volume" released by "delete_volume" :: held 2.991s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:34:37 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bdab8d5-5347-4d0b-988a-662b66ed24d5 tempest-VolumesTransfersV357Test-947552926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:34:37 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7bdab8d5-5347-4d0b-988a-662b66ed24d5 tempest-VolumesTransfersV357Test-947552926 None] Flow 'volume_create_manager' (548841b2-b3db-450b-92cb-7889a79936c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:34:37 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7bdab8d5-5347-4d0b-988a-662b66ed24d5 tempest-VolumesTransfersV357Test-947552926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f3d9985-fefb-4473-883d-f69ccb5823e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:37 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7bdab8d5-5347-4d0b-988a-662b66ed24d5 tempest-VolumesTransfersV357Test-947552926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f3d9985-fefb-4473-883d-f69ccb5823e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1335648593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69cc5920-cee4-4289-a2dd-cabf000110d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2653a7a1754417c82ba6266add55c81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:34:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:34:38Z,use_quota=True,user_id='846af8309cf04213a38a95c8397e6f62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:37 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7bdab8d5-5347-4d0b-988a-662b66ed24d5 tempest-VolumesTransfersV357Test-947552926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f44eb473-fdde-4631-9041-a5698363d2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:37 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7bdab8d5-5347-4d0b-988a-662b66ed24d5 tempest-VolumesTransfersV357Test-947552926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f44eb473-fdde-4631-9041-a5698363d2b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:37 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7bdab8d5-5347-4d0b-988a-662b66ed24d5 tempest-VolumesTransfersV357Test-947552926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aed9a06-18bb-4b90-b747-2d873681af7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:37 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7bdab8d5-5347-4d0b-988a-662b66ed24d5 tempest-VolumesTransfersV357Test-947552926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aed9a06-18bb-4b90-b747-2d873681af7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69cc5920-cee4-4289-a2dd-cabf000110d1', 'volume_name': 'volume-69cc5920-cee4-4289-a2dd-cabf000110d1', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:37 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7bdab8d5-5347-4d0b-988a-662b66ed24d5 tempest-VolumesTransfersV357Test-947552926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7f9b690-72a2-4f36-8282-9c8e6cdd8202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:37 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7bdab8d5-5347-4d0b-988a-662b66ed24d5 tempest-VolumesTransfersV357Test-947552926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7f9b690-72a2-4f36-8282-9c8e6cdd8202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:37 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7bdab8d5-5347-4d0b-988a-662b66ed24d5 tempest-VolumesTransfersV357Test-947552926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ee72be6-93a2-48bc-a977-c9749a178b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:37 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-7bdab8d5-5347-4d0b-988a-662b66ed24d5 tempest-VolumesTransfersV357Test-947552926 None] Volume 69cc5920-cee4-4289-a2dd-cabf000110d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69cc5920-cee4-4289-a2dd-cabf000110d1', 'volume_size': 1} Nov 03 07:34:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7bdab8d5-5347-4d0b-988a-662b66ed24d5 tempest-VolumesTransfersV357Test-947552926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7bdab8d5-5347-4d0b-988a-662b66ed24d5 tempest-VolumesTransfersV357Test-947552926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:37 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-7bdab8d5-5347-4d0b-988a-662b66ed24d5 tempest-VolumesTransfersV357Test-947552926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1335648593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69cc5920-cee4-4289-a2dd-cabf000110d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2653a7a1754417c82ba6266add55c81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:34:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:34:38Z,use_quota=True,user_id='846af8309cf04213a38a95c8397e6f62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:34:37 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-7bdab8d5-5347-4d0b-988a-662b66ed24d5 tempest-VolumesTransfersV357Test-947552926 None] Creating volume 69cc5920-cee4-4289-a2dd-cabf000110d1 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:34:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7bdab8d5-5347-4d0b-988a-662b66ed24d5 tempest-VolumesTransfersV357Test-947552926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7bdab8d5-5347-4d0b-988a-662b66ed24d5 tempest-VolumesTransfersV357Test-947552926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:37 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-7bdab8d5-5347-4d0b-988a-662b66ed24d5 tempest-VolumesTransfersV357Test-947552926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:34:37 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-7bdab8d5-5347-4d0b-988a-662b66ed24d5 tempest-VolumesTransfersV357Test-947552926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:34:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7bdab8d5-5347-4d0b-988a-662b66ed24d5 tempest-VolumesTransfersV357Test-947552926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:37 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-7bdab8d5-5347-4d0b-988a-662b66ed24d5 tempest-VolumesTransfersV357Test-947552926 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:34:37 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-7bdab8d5-5347-4d0b-988a-662b66ed24d5 tempest-VolumesTransfersV357Test-947552926 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:34:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7bdab8d5-5347-4d0b-988a-662b66ed24d5 tempest-VolumesTransfersV357Test-947552926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-69cc5920-cee4-4289-a2dd-cabf000110d1 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:37 devstack sudo[95117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-69cc5920-cee4-4289-a2dd-cabf000110d1 1073741824 Nov 03 07:34:37 devstack sudo[95117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:38 devstack sudo[95117]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7bdab8d5-5347-4d0b-988a-662b66ed24d5 tempest-VolumesTransfersV357Test-947552926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-69cc5920-cee4-4289-a2dd-cabf000110d1 1073741824" returned: 0 in 1.016s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7bdab8d5-5347-4d0b-988a-662b66ed24d5 tempest-VolumesTransfersV357Test-947552926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-69cc5920-cee4-4289-a2dd-cabf000110d1 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:39 devstack sudo[95123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-69cc5920-cee4-4289-a2dd-cabf000110d1 Nov 03 07:34:39 devstack sudo[95123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:39 devstack sudo[95123]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7bdab8d5-5347-4d0b-988a-662b66ed24d5 tempest-VolumesTransfersV357Test-947552926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-69cc5920-cee4-4289-a2dd-cabf000110d1" returned: 0 in 0.477s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:39 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-7bdab8d5-5347-4d0b-988a-662b66ed24d5 tempest-VolumesTransfersV357Test-947552926 None] <== create_volume: return (1627ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:34:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7bdab8d5-5347-4d0b-988a-662b66ed24d5 tempest-VolumesTransfersV357Test-947552926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.636s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:39 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7bdab8d5-5347-4d0b-988a-662b66ed24d5 tempest-VolumesTransfersV357Test-947552926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ee72be6-93a2-48bc-a977-c9749a178b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69cc5920-cee4-4289-a2dd-cabf000110d1', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:39 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7bdab8d5-5347-4d0b-988a-662b66ed24d5 tempest-VolumesTransfersV357Test-947552926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c2cab0d-e4aa-4447-af96-3c6441eaf51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:34:39 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-7bdab8d5-5347-4d0b-988a-662b66ed24d5 tempest-VolumesTransfersV357Test-947552926 None] Volume volume-69cc5920-cee4-4289-a2dd-cabf000110d1 (69cc5920-cee4-4289-a2dd-cabf000110d1): created successfully Nov 03 07:34:39 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7bdab8d5-5347-4d0b-988a-662b66ed24d5 tempest-VolumesTransfersV357Test-947552926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c2cab0d-e4aa-4447-af96-3c6441eaf51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:34:39 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7bdab8d5-5347-4d0b-988a-662b66ed24d5 tempest-VolumesTransfersV357Test-947552926 None] Flow 'volume_create_manager' (548841b2-b3db-450b-92cb-7889a79936c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:34:39 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-7bdab8d5-5347-4d0b-988a-662b66ed24d5 tempest-VolumesTransfersV357Test-947552926 None] Created volume successfully. Nov 03 07:34:41 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d0ed8db9-bf62-40db-8b57-e65b59808e16 tempest-VolumesTransfersV357Test-527924947 None] Acquiring lock "cinder-69cc5920-cee4-4289-a2dd-cabf000110d1-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:34:41 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d0ed8db9-bf62-40db-8b57-e65b59808e16 tempest-VolumesTransfersV357Test-527924947 None] Lock "cinder-69cc5920-cee4-4289-a2dd-cabf000110d1-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:34:41 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d0ed8db9-bf62-40db-8b57-e65b59808e16 tempest-VolumesTransfersV357Test-527924947 None] Acquiring lock "cinder-quobyte-69cc5920-cee4-4289-a2dd-cabf000110d1" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:34:41 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d0ed8db9-bf62-40db-8b57-e65b59808e16 tempest-VolumesTransfersV357Test-527924947 None] Lock "cinder-quobyte-69cc5920-cee4-4289-a2dd-cabf000110d1" acquired by "delete_volume" :: waited 0.038s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:34:41 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe26920-d97c-47db-a72b-f5108bbeec1c]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:34:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d0ed8db9-bf62-40db-8b57-e65b59808e16 tempest-VolumesTransfersV357Test-527924947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-69cc5920-cee4-4289-a2dd-cabf000110d1 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:41 devstack sudo[95128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-69cc5920-cee4-4289-a2dd-cabf000110d1 Nov 03 07:34:41 devstack sudo[95128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:42 devstack sudo[95128]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d0ed8db9-bf62-40db-8b57-e65b59808e16 tempest-VolumesTransfersV357Test-527924947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-69cc5920-cee4-4289-a2dd-cabf000110d1" returned: 0 in 0.770s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d0ed8db9-bf62-40db-8b57-e65b59808e16 tempest-VolumesTransfersV357Test-527924947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-69cc5920-cee4-4289-a2dd-cabf000110d1 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:42 devstack sudo[95134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-69cc5920-cee4-4289-a2dd-cabf000110d1 Nov 03 07:34:42 devstack sudo[95134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:43 devstack sudo[95134]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:43 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d0ed8db9-bf62-40db-8b57-e65b59808e16 tempest-VolumesTransfersV357Test-527924947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-69cc5920-cee4-4289-a2dd-cabf000110d1" returned: 0 in 0.619s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:43 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d0ed8db9-bf62-40db-8b57-e65b59808e16 tempest-VolumesTransfersV357Test-527924947 None] Lock "cinder-quobyte-69cc5920-cee4-4289-a2dd-cabf000110d1" released by "delete_volume" :: held 1.530s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:34:43 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-d0ed8db9-bf62-40db-8b57-e65b59808e16 tempest-VolumesTransfersV357Test-527924947 None] Created reservations ['47876b58-9497-4049-9bd2-bf5188d5889a', '98fffc2e-53fe-4c78-9c8c-064943e0b980', '9d8ccebd-33ff-4269-abe2-d7f5b8c7e2ae', '9651e262-f2fb-4714-8479-ff275c0f933f'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:34:43 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-d0ed8db9-bf62-40db-8b57-e65b59808e16 tempest-VolumesTransfersV357Test-527924947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:43 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-d0ed8db9-bf62-40db-8b57-e65b59808e16 tempest-VolumesTransfersV357Test-527924947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:43 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-d0ed8db9-bf62-40db-8b57-e65b59808e16 tempest-VolumesTransfersV357Test-527924947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:34:43 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-d0ed8db9-bf62-40db-8b57-e65b59808e16 tempest-VolumesTransfersV357Test-527924947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:34:43 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-d0ed8db9-bf62-40db-8b57-e65b59808e16 tempest-VolumesTransfersV357Test-527924947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:43 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d0ed8db9-bf62-40db-8b57-e65b59808e16 tempest-VolumesTransfersV357Test-527924947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:43 devstack sudo[95139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:34:43 devstack sudo[95139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:44 devstack sudo[95139]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d0ed8db9-bf62-40db-8b57-e65b59808e16 tempest-VolumesTransfersV357Test-527924947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.434s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:44 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-d0ed8db9-bf62-40db-8b57-e65b59808e16 tempest-VolumesTransfersV357Test-527924947 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:34:44 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-d0ed8db9-bf62-40db-8b57-e65b59808e16 tempest-VolumesTransfersV357Test-527924947 None] Deleted volume successfully. Nov 03 07:34:44 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d0ed8db9-bf62-40db-8b57-e65b59808e16 tempest-VolumesTransfersV357Test-527924947 None] Lock "cinder-69cc5920-cee4-4289-a2dd-cabf000110d1-delete_volume" released by "delete_volume" :: held 2.636s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:34:50 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-aff9094d-5b0b-471e-8162-865edbef2641 tempest-ServerRescueNegativeTestJSON-1493427581 None] Acquiring lock "cinder-4350f5da-ab73-4110-9b7b-d1d46049492b-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:34:50 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-aff9094d-5b0b-471e-8162-865edbef2641 tempest-ServerRescueNegativeTestJSON-1493427581 None] Lock "cinder-4350f5da-ab73-4110-9b7b-d1d46049492b-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:34:50 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-aff9094d-5b0b-471e-8162-865edbef2641 tempest-ServerRescueNegativeTestJSON-1493427581 None] Acquiring lock "cinder-quobyte-4350f5da-ab73-4110-9b7b-d1d46049492b" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:34:50 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-aff9094d-5b0b-471e-8162-865edbef2641 tempest-ServerRescueNegativeTestJSON-1493427581 None] Lock "cinder-quobyte-4350f5da-ab73-4110-9b7b-d1d46049492b" acquired by "delete_volume" :: waited 0.073s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:34:50 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a568c8-5091-4e88-8f59-c9cee7dbd1be]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:34:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-aff9094d-5b0b-471e-8162-865edbef2641 tempest-ServerRescueNegativeTestJSON-1493427581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4350f5da-ab73-4110-9b7b-d1d46049492b {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:50 devstack sudo[95191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4350f5da-ab73-4110-9b7b-d1d46049492b Nov 03 07:34:50 devstack sudo[95191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:51 devstack sudo[95191]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-aff9094d-5b0b-471e-8162-865edbef2641 tempest-ServerRescueNegativeTestJSON-1493427581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4350f5da-ab73-4110-9b7b-d1d46049492b" returned: 0 in 0.987s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-aff9094d-5b0b-471e-8162-865edbef2641 tempest-ServerRescueNegativeTestJSON-1493427581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4350f5da-ab73-4110-9b7b-d1d46049492b {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:51 devstack sudo[95214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4350f5da-ab73-4110-9b7b-d1d46049492b Nov 03 07:34:51 devstack sudo[95214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:51 devstack sudo[95214]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-aff9094d-5b0b-471e-8162-865edbef2641 tempest-ServerRescueNegativeTestJSON-1493427581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4350f5da-ab73-4110-9b7b-d1d46049492b" returned: 0 in 0.588s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:52 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-aff9094d-5b0b-471e-8162-865edbef2641 tempest-ServerRescueNegativeTestJSON-1493427581 None] Lock "cinder-quobyte-4350f5da-ab73-4110-9b7b-d1d46049492b" released by "delete_volume" :: held 1.710s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:34:52 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-aff9094d-5b0b-471e-8162-865edbef2641 tempest-ServerRescueNegativeTestJSON-1493427581 None] Created reservations ['59a2617e-831e-4e1a-bb21-ac343e0c90bc', '8d439b2e-5fe2-42b0-88dc-19edda28c3f2', '61878b18-28f6-4544-8d37-15fd1b03d4f0', 'd11cd1ed-1176-44f3-9f62-f7f8f1349361'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:34:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-aff9094d-5b0b-471e-8162-865edbef2641 tempest-ServerRescueNegativeTestJSON-1493427581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:34:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-aff9094d-5b0b-471e-8162-865edbef2641 tempest-ServerRescueNegativeTestJSON-1493427581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:34:52 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-aff9094d-5b0b-471e-8162-865edbef2641 tempest-ServerRescueNegativeTestJSON-1493427581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:34:52 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-aff9094d-5b0b-471e-8162-865edbef2641 tempest-ServerRescueNegativeTestJSON-1493427581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:34:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-aff9094d-5b0b-471e-8162-865edbef2641 tempest-ServerRescueNegativeTestJSON-1493427581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:34:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-aff9094d-5b0b-471e-8162-865edbef2641 tempest-ServerRescueNegativeTestJSON-1493427581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:34:52 devstack sudo[95217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:34:52 devstack sudo[95217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:34:52 devstack sudo[95217]: pam_unix(sudo:session): session closed for user root Nov 03 07:34:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-aff9094d-5b0b-471e-8162-865edbef2641 tempest-ServerRescueNegativeTestJSON-1493427581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.674s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:34:52 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-aff9094d-5b0b-471e-8162-865edbef2641 tempest-ServerRescueNegativeTestJSON-1493427581 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:34:52 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-aff9094d-5b0b-471e-8162-865edbef2641 tempest-ServerRescueNegativeTestJSON-1493427581 None] Deleted volume successfully. Nov 03 07:34:53 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-aff9094d-5b0b-471e-8162-865edbef2641 tempest-ServerRescueNegativeTestJSON-1493427581 None] Lock "cinder-4350f5da-ab73-4110-9b7b-d1d46049492b-delete_volume" released by "delete_volume" :: held 2.943s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:35:02 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:SELECT=19,cinder:UPDATE=34,cinder:INSERT=9,cinder:DELETE=1 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:35:02 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c373618-332f-43f1-9c39-a6ac60b64d9f tempest-VolumesGetTest-907870811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:35:02 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0c373618-332f-43f1-9c39-a6ac60b64d9f tempest-VolumesGetTest-907870811 None] Flow 'volume_create_manager' (4f4cd88a-58d7-4db3-ac53-565b1a88c264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:35:02 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0c373618-332f-43f1-9c39-a6ac60b64d9f tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bda1667a-8c18-40bd-ac56-4ab997cda6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:02 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0c373618-332f-43f1-9c39-a6ac60b64d9f tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bda1667a-8c18-40bd-ac56-4ab997cda6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:35:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2144755825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdd83c01-41e8-477c-a000-f12b869d786f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='22222170fcf741d7a736bc82b75e21f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:35:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:35:02Z,use_quota=True,user_id='39c2f1663cad426498e6fc266f9b70dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:02 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0c373618-332f-43f1-9c39-a6ac60b64d9f tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a24a906-056f-4fd7-a747-d7d8cd217751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:02 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0c373618-332f-43f1-9c39-a6ac60b64d9f tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a24a906-056f-4fd7-a747-d7d8cd217751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:02 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0c373618-332f-43f1-9c39-a6ac60b64d9f tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27503681-364b-4140-b26d-7a340fd4e0a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:02 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0c373618-332f-43f1-9c39-a6ac60b64d9f tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27503681-364b-4140-b26d-7a340fd4e0a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdd83c01-41e8-477c-a000-f12b869d786f', 'volume_name': 'volume-bdd83c01-41e8-477c-a000-f12b869d786f', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:02 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0c373618-332f-43f1-9c39-a6ac60b64d9f tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (156a8b77-adb3-42af-8252-e1a2cf7115ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:02 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0c373618-332f-43f1-9c39-a6ac60b64d9f tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (156a8b77-adb3-42af-8252-e1a2cf7115ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:02 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0c373618-332f-43f1-9c39-a6ac60b64d9f tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f327ef7-c449-4577-a0a1-ca5eb063dc91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:02 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-0c373618-332f-43f1-9c39-a6ac60b64d9f tempest-VolumesGetTest-907870811 None] Volume bdd83c01-41e8-477c-a000-f12b869d786f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdd83c01-41e8-477c-a000-f12b869d786f', 'volume_size': 1} Nov 03 07:35:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0c373618-332f-43f1-9c39-a6ac60b64d9f tempest-VolumesGetTest-907870811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:35:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0c373618-332f-43f1-9c39-a6ac60b64d9f tempest-VolumesGetTest-907870811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:35:02 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-0c373618-332f-43f1-9c39-a6ac60b64d9f tempest-VolumesGetTest-907870811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:35:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2144755825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdd83c01-41e8-477c-a000-f12b869d786f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='22222170fcf741d7a736bc82b75e21f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:35:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:35:02Z,use_quota=True,user_id='39c2f1663cad426498e6fc266f9b70dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:35:02 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-0c373618-332f-43f1-9c39-a6ac60b64d9f tempest-VolumesGetTest-907870811 None] Creating volume bdd83c01-41e8-477c-a000-f12b869d786f {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:35:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0c373618-332f-43f1-9c39-a6ac60b64d9f tempest-VolumesGetTest-907870811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:35:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0c373618-332f-43f1-9c39-a6ac60b64d9f tempest-VolumesGetTest-907870811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:35:02 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-0c373618-332f-43f1-9c39-a6ac60b64d9f tempest-VolumesGetTest-907870811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:35:02 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-0c373618-332f-43f1-9c39-a6ac60b64d9f tempest-VolumesGetTest-907870811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:35:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0c373618-332f-43f1-9c39-a6ac60b64d9f tempest-VolumesGetTest-907870811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:35:02 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-0c373618-332f-43f1-9c39-a6ac60b64d9f tempest-VolumesGetTest-907870811 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:35:02 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-0c373618-332f-43f1-9c39-a6ac60b64d9f tempest-VolumesGetTest-907870811 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:35:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0c373618-332f-43f1-9c39-a6ac60b64d9f tempest-VolumesGetTest-907870811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bdd83c01-41e8-477c-a000-f12b869d786f 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:02 devstack sudo[95306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bdd83c01-41e8-477c-a000-f12b869d786f 1073741824 Nov 03 07:35:02 devstack sudo[95306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:03 devstack cinder-volume[86875]: DEBUG oslo_service.periodic_task [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86875) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:35:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:35:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:35:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:35:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:35:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:35:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:03 devstack sudo[95306]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0c373618-332f-43f1-9c39-a6ac60b64d9f tempest-VolumesGetTest-907870811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bdd83c01-41e8-477c-a000-f12b869d786f 1073741824" returned: 0 in 0.871s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:03 devstack sudo[95312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:35:03 devstack sudo[95312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0c373618-332f-43f1-9c39-a6ac60b64d9f tempest-VolumesGetTest-907870811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bdd83c01-41e8-477c-a000-f12b869d786f {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:03 devstack sudo[95318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bdd83c01-41e8-477c-a000-f12b869d786f Nov 03 07:35:03 devstack sudo[95318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:04 devstack sudo[95312]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.566s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:04 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:35:04 devstack sudo[95318]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0c373618-332f-43f1-9c39-a6ac60b64d9f tempest-VolumesGetTest-907870811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bdd83c01-41e8-477c-a000-f12b869d786f" returned: 0 in 0.506s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:04 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-0c373618-332f-43f1-9c39-a6ac60b64d9f tempest-VolumesGetTest-907870811 None] <== create_volume: return (1451ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:35:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0c373618-332f-43f1-9c39-a6ac60b64d9f tempest-VolumesGetTest-907870811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.454s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:35:04 devstack cinder-volume[86875]: DEBUG oslo_service.periodic_task [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running periodic task VolumeManager._thread_info {{(pid=86875) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:35:04 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] thread count: 28 {{(pid=86875) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:35:04 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] thread info: [<_MainThread(MainThread, started 125626325639296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86875) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:35:04 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0c373618-332f-43f1-9c39-a6ac60b64d9f tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f327ef7-c449-4577-a0a1-ca5eb063dc91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdd83c01-41e8-477c-a000-f12b869d786f', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:04 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0c373618-332f-43f1-9c39-a6ac60b64d9f tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ca3dd5a-0a94-49f3-96a8-59d290781fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:04 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-0c373618-332f-43f1-9c39-a6ac60b64d9f tempest-VolumesGetTest-907870811 None] Volume volume-bdd83c01-41e8-477c-a000-f12b869d786f (bdd83c01-41e8-477c-a000-f12b869d786f): created successfully Nov 03 07:35:04 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0c373618-332f-43f1-9c39-a6ac60b64d9f tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ca3dd5a-0a94-49f3-96a8-59d290781fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:04 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0c373618-332f-43f1-9c39-a6ac60b64d9f tempest-VolumesGetTest-907870811 None] Flow 'volume_create_manager' (4f4cd88a-58d7-4db3-ac53-565b1a88c264) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:35:04 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-0c373618-332f-43f1-9c39-a6ac60b64d9f tempest-VolumesGetTest-907870811 None] Created volume successfully. Nov 03 07:35:05 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-732202f2-4e3c-4790-bde3-0fcb29736719 tempest-VolumesGetTest-907870811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:35:05 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-732202f2-4e3c-4790-bde3-0fcb29736719 tempest-VolumesGetTest-907870811 None] Flow 'volume_create_manager' (3cca0340-a8ea-4bd6-ad2e-1ea351b4dd0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:35:05 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-732202f2-4e3c-4790-bde3-0fcb29736719 tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2d4100e-33ed-45d8-b59b-a6cead39cd94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-732202f2-4e3c-4790-bde3-0fcb29736719 tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2d4100e-33ed-45d8-b59b-a6cead39cd94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:35:05Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1279521575',display_name='tempest-VolumesGetTest-Volume-657196767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d1ab7df-767b-408f-be73-3f5201aae4cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22222170fcf741d7a736bc82b75e21f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:35:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:35:06Z,use_quota=True,user_id='39c2f1663cad426498e6fc266f9b70dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-732202f2-4e3c-4790-bde3-0fcb29736719 tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79351547-b293-4301-8170-fdb766e81ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-732202f2-4e3c-4790-bde3-0fcb29736719 tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79351547-b293-4301-8170-fdb766e81ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-732202f2-4e3c-4790-bde3-0fcb29736719 tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a15f4569-971f-4ffb-afc2-1909434a2f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-732202f2-4e3c-4790-bde3-0fcb29736719 tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a15f4569-971f-4ffb-afc2-1909434a2f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d1ab7df-767b-408f-be73-3f5201aae4cf', 'volume_name': 'volume-9d1ab7df-767b-408f-be73-3f5201aae4cf', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-732202f2-4e3c-4790-bde3-0fcb29736719 tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d42257e4-966c-414f-8ae5-2a98dccb9880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-732202f2-4e3c-4790-bde3-0fcb29736719 tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d42257e4-966c-414f-8ae5-2a98dccb9880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-732202f2-4e3c-4790-bde3-0fcb29736719 tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (973988fe-3586-490f-9d31-8c1607e825a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:06 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-732202f2-4e3c-4790-bde3-0fcb29736719 tempest-VolumesGetTest-907870811 None] Volume 9d1ab7df-767b-408f-be73-3f5201aae4cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d1ab7df-767b-408f-be73-3f5201aae4cf', 'volume_size': 1} Nov 03 07:35:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-732202f2-4e3c-4790-bde3-0fcb29736719 tempest-VolumesGetTest-907870811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:35:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-732202f2-4e3c-4790-bde3-0fcb29736719 tempest-VolumesGetTest-907870811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:35:06 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-732202f2-4e3c-4790-bde3-0fcb29736719 tempest-VolumesGetTest-907870811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:35:05Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1279521575',display_name='tempest-VolumesGetTest-Volume-657196767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d1ab7df-767b-408f-be73-3f5201aae4cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22222170fcf741d7a736bc82b75e21f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:35:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:35:06Z,use_quota=True,user_id='39c2f1663cad426498e6fc266f9b70dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:35:06 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-732202f2-4e3c-4790-bde3-0fcb29736719 tempest-VolumesGetTest-907870811 None] Creating volume 9d1ab7df-767b-408f-be73-3f5201aae4cf {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:35:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-732202f2-4e3c-4790-bde3-0fcb29736719 tempest-VolumesGetTest-907870811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:35:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-732202f2-4e3c-4790-bde3-0fcb29736719 tempest-VolumesGetTest-907870811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:35:06 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-732202f2-4e3c-4790-bde3-0fcb29736719 tempest-VolumesGetTest-907870811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:35:06 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-732202f2-4e3c-4790-bde3-0fcb29736719 tempest-VolumesGetTest-907870811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:35:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-732202f2-4e3c-4790-bde3-0fcb29736719 tempest-VolumesGetTest-907870811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:35:06 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-732202f2-4e3c-4790-bde3-0fcb29736719 tempest-VolumesGetTest-907870811 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:35:06 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-732202f2-4e3c-4790-bde3-0fcb29736719 tempest-VolumesGetTest-907870811 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:35:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-732202f2-4e3c-4790-bde3-0fcb29736719 tempest-VolumesGetTest-907870811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9d1ab7df-767b-408f-be73-3f5201aae4cf 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:06 devstack sudo[95351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9d1ab7df-767b-408f-be73-3f5201aae4cf 1073741824 Nov 03 07:35:06 devstack sudo[95351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:06 devstack sudo[95351]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-732202f2-4e3c-4790-bde3-0fcb29736719 tempest-VolumesGetTest-907870811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9d1ab7df-767b-408f-be73-3f5201aae4cf 1073741824" returned: 0 in 0.588s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-732202f2-4e3c-4790-bde3-0fcb29736719 tempest-VolumesGetTest-907870811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9d1ab7df-767b-408f-be73-3f5201aae4cf {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:06 devstack sudo[95357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9d1ab7df-767b-408f-be73-3f5201aae4cf Nov 03 07:35:06 devstack sudo[95357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:07 devstack sudo[95357]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-732202f2-4e3c-4790-bde3-0fcb29736719 tempest-VolumesGetTest-907870811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9d1ab7df-767b-408f-be73-3f5201aae4cf" returned: 0 in 0.329s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:07 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-732202f2-4e3c-4790-bde3-0fcb29736719 tempest-VolumesGetTest-907870811 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:35:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-732202f2-4e3c-4790-bde3-0fcb29736719 tempest-VolumesGetTest-907870811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:35:07 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-732202f2-4e3c-4790-bde3-0fcb29736719 tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (973988fe-3586-490f-9d31-8c1607e825a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d1ab7df-767b-408f-be73-3f5201aae4cf', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:07 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-732202f2-4e3c-4790-bde3-0fcb29736719 tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3deafa9a-8d42-45ad-bff7-45b4210eb909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:07 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-732202f2-4e3c-4790-bde3-0fcb29736719 tempest-VolumesGetTest-907870811 None] Volume volume-9d1ab7df-767b-408f-be73-3f5201aae4cf (9d1ab7df-767b-408f-be73-3f5201aae4cf): created successfully Nov 03 07:35:07 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-732202f2-4e3c-4790-bde3-0fcb29736719 tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3deafa9a-8d42-45ad-bff7-45b4210eb909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:07 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-732202f2-4e3c-4790-bde3-0fcb29736719 tempest-VolumesGetTest-907870811 None] Flow 'volume_create_manager' (3cca0340-a8ea-4bd6-ad2e-1ea351b4dd0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:35:07 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-732202f2-4e3c-4790-bde3-0fcb29736719 tempest-VolumesGetTest-907870811 None] Created volume successfully. Nov 03 07:35:08 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-62b8f6b0-fc2c-4d71-bf08-0a809abd90d4 tempest-VolumesGetTest-907870811 None] Acquiring lock "cinder-9d1ab7df-767b-408f-be73-3f5201aae4cf-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:35:08 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-62b8f6b0-fc2c-4d71-bf08-0a809abd90d4 tempest-VolumesGetTest-907870811 None] Lock "cinder-9d1ab7df-767b-408f-be73-3f5201aae4cf-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:35:08 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-62b8f6b0-fc2c-4d71-bf08-0a809abd90d4 tempest-VolumesGetTest-907870811 None] Acquiring lock "cinder-quobyte-9d1ab7df-767b-408f-be73-3f5201aae4cf" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:35:08 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-62b8f6b0-fc2c-4d71-bf08-0a809abd90d4 tempest-VolumesGetTest-907870811 None] Lock "cinder-quobyte-9d1ab7df-767b-408f-be73-3f5201aae4cf" acquired by "delete_volume" :: waited 0.058s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:35:08 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[34fd5927-eade-4548-aba2-ad6946f98699]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:35:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-62b8f6b0-fc2c-4d71-bf08-0a809abd90d4 tempest-VolumesGetTest-907870811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9d1ab7df-767b-408f-be73-3f5201aae4cf {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:09 devstack cinder-volume[86875]: INFO cinder.volume.manager [req-a4435bd4-2148-4590-a492-f6176d889955 req-8f3cc77f-74fc-4541-9e21-2532755015dd tempest-AttachVolumeNegativeTest-376242003 None] Terminate volume connection completed successfully. Nov 03 07:35:09 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-a4435bd4-2148-4590-a492-f6176d889955 req-8f3cc77f-74fc-4541-9e21-2532755015dd tempest-AttachVolumeNegativeTest-376242003 None] Deleting attachment fbefebec-46a3-484c-8794-9f09c32a1e52. {{(pid=86875) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:35:09 devstack sudo[95421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9d1ab7df-767b-408f-be73-3f5201aae4cf Nov 03 07:35:09 devstack sudo[95421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:09 devstack sudo[95421]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-62b8f6b0-fc2c-4d71-bf08-0a809abd90d4 tempest-VolumesGetTest-907870811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9d1ab7df-767b-408f-be73-3f5201aae4cf" returned: 0 in 0.951s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-62b8f6b0-fc2c-4d71-bf08-0a809abd90d4 tempest-VolumesGetTest-907870811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9d1ab7df-767b-408f-be73-3f5201aae4cf {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:09 devstack sudo[95437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9d1ab7df-767b-408f-be73-3f5201aae4cf Nov 03 07:35:09 devstack sudo[95437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:10 devstack sudo[95437]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-62b8f6b0-fc2c-4d71-bf08-0a809abd90d4 tempest-VolumesGetTest-907870811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9d1ab7df-767b-408f-be73-3f5201aae4cf" returned: 0 in 0.473s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:10 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-62b8f6b0-fc2c-4d71-bf08-0a809abd90d4 tempest-VolumesGetTest-907870811 None] Lock "cinder-quobyte-9d1ab7df-767b-408f-be73-3f5201aae4cf" released by "delete_volume" :: held 1.565s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:35:10 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-62b8f6b0-fc2c-4d71-bf08-0a809abd90d4 tempest-VolumesGetTest-907870811 None] Created reservations ['dd88f2ad-3bad-4dff-938f-3441aba56458', 'e75aa712-fef5-4eec-9f7d-0efd703da533', '4d26cef9-aae0-4d66-a30d-d3049df2cda4', '00ee96d8-c95a-4c37-88a2-552f212fd292'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:35:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-62b8f6b0-fc2c-4d71-bf08-0a809abd90d4 tempest-VolumesGetTest-907870811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:35:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-62b8f6b0-fc2c-4d71-bf08-0a809abd90d4 tempest-VolumesGetTest-907870811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:35:10 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-62b8f6b0-fc2c-4d71-bf08-0a809abd90d4 tempest-VolumesGetTest-907870811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:35:10 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-62b8f6b0-fc2c-4d71-bf08-0a809abd90d4 tempest-VolumesGetTest-907870811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:35:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-62b8f6b0-fc2c-4d71-bf08-0a809abd90d4 tempest-VolumesGetTest-907870811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:35:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-62b8f6b0-fc2c-4d71-bf08-0a809abd90d4 tempest-VolumesGetTest-907870811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:10 devstack sudo[95444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:35:10 devstack sudo[95444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:11 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-34752f83-2967-4866-acca-90dff00e6211 tempest-VolumesGetTest-907870811 None] Acquiring lock "cinder-bdd83c01-41e8-477c-a000-f12b869d786f-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:35:11 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-34752f83-2967-4866-acca-90dff00e6211 tempest-VolumesGetTest-907870811 None] Lock "cinder-bdd83c01-41e8-477c-a000-f12b869d786f-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:35:11 devstack sudo[95444]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-62b8f6b0-fc2c-4d71-bf08-0a809abd90d4 tempest-VolumesGetTest-907870811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.990s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:11 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-62b8f6b0-fc2c-4d71-bf08-0a809abd90d4 tempest-VolumesGetTest-907870811 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:35:11 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-62b8f6b0-fc2c-4d71-bf08-0a809abd90d4 tempest-VolumesGetTest-907870811 None] Deleted volume successfully. Nov 03 07:35:11 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-34752f83-2967-4866-acca-90dff00e6211 tempest-VolumesGetTest-907870811 None] Acquiring lock "cinder-quobyte-bdd83c01-41e8-477c-a000-f12b869d786f" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:35:11 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-62b8f6b0-fc2c-4d71-bf08-0a809abd90d4 tempest-VolumesGetTest-907870811 None] Lock "cinder-9d1ab7df-767b-408f-be73-3f5201aae4cf-delete_volume" released by "delete_volume" :: held 3.142s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:35:11 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-34752f83-2967-4866-acca-90dff00e6211 tempest-VolumesGetTest-907870811 None] Lock "cinder-quobyte-bdd83c01-41e8-477c-a000-f12b869d786f" acquired by "delete_volume" :: waited 0.037s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:35:11 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c35ff47-ce4b-4d87-80c6-78c73f492f96]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:35:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-34752f83-2967-4866-acca-90dff00e6211 tempest-VolumesGetTest-907870811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bdd83c01-41e8-477c-a000-f12b869d786f {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:12 devstack sudo[95465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bdd83c01-41e8-477c-a000-f12b869d786f Nov 03 07:35:12 devstack sudo[95465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:12 devstack sudo[95465]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:12 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-34752f83-2967-4866-acca-90dff00e6211 tempest-VolumesGetTest-907870811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bdd83c01-41e8-477c-a000-f12b869d786f" returned: 0 in 0.489s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:12 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-34752f83-2967-4866-acca-90dff00e6211 tempest-VolumesGetTest-907870811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bdd83c01-41e8-477c-a000-f12b869d786f {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:12 devstack sudo[95472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bdd83c01-41e8-477c-a000-f12b869d786f Nov 03 07:35:12 devstack sudo[95472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:12 devstack sudo[95472]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:12 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-34752f83-2967-4866-acca-90dff00e6211 tempest-VolumesGetTest-907870811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bdd83c01-41e8-477c-a000-f12b869d786f" returned: 0 in 0.413s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:12 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-34752f83-2967-4866-acca-90dff00e6211 tempest-VolumesGetTest-907870811 None] Lock "cinder-quobyte-bdd83c01-41e8-477c-a000-f12b869d786f" released by "delete_volume" :: held 1.053s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:35:12 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-34752f83-2967-4866-acca-90dff00e6211 tempest-VolumesGetTest-907870811 None] Created reservations ['b79a86ee-28fd-4bc8-b245-7e327bcb6aba', '43148eee-42d9-423b-8d65-a002055f50e6', 'b8113e82-a065-4866-b034-3bc911461de5', '1346335b-cf70-476f-963b-8a302ca2a52c'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:35:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-34752f83-2967-4866-acca-90dff00e6211 tempest-VolumesGetTest-907870811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:35:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-34752f83-2967-4866-acca-90dff00e6211 tempest-VolumesGetTest-907870811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:35:13 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-34752f83-2967-4866-acca-90dff00e6211 tempest-VolumesGetTest-907870811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:35:13 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-34752f83-2967-4866-acca-90dff00e6211 tempest-VolumesGetTest-907870811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:35:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-34752f83-2967-4866-acca-90dff00e6211 tempest-VolumesGetTest-907870811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:35:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-34752f83-2967-4866-acca-90dff00e6211 tempest-VolumesGetTest-907870811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:13 devstack sudo[95475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:35:13 devstack sudo[95475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:13 devstack sudo[95475]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-34752f83-2967-4866-acca-90dff00e6211 tempest-VolumesGetTest-907870811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.498s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:13 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-34752f83-2967-4866-acca-90dff00e6211 tempest-VolumesGetTest-907870811 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:35:13 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-34752f83-2967-4866-acca-90dff00e6211 tempest-VolumesGetTest-907870811 None] Deleted volume successfully. Nov 03 07:35:13 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-34752f83-2967-4866-acca-90dff00e6211 tempest-VolumesGetTest-907870811 None] Lock "cinder-bdd83c01-41e8-477c-a000-f12b869d786f-delete_volume" released by "delete_volume" :: held 2.071s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:35:15 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-5810a56a-46bf-404e-ab2b-a99e87404a83 tempest-VolumesGetTest-907870811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:35:15 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5810a56a-46bf-404e-ab2b-a99e87404a83 tempest-VolumesGetTest-907870811 None] Flow 'volume_create_manager' (fb20c02e-9a2e-47de-a21f-af96ea19da97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:35:15 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5810a56a-46bf-404e-ab2b-a99e87404a83 tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (005da197-07d9-4bb4-aa1e-8121875de82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:15 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5810a56a-46bf-404e-ab2b-a99e87404a83 tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (005da197-07d9-4bb4-aa1e-8121875de82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:35:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1914647058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=490916f1-15c4-4f05-a7d6-53c82e0495b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22222170fcf741d7a736bc82b75e21f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:35:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:35:16Z,use_quota=True,user_id='39c2f1663cad426498e6fc266f9b70dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:15 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5810a56a-46bf-404e-ab2b-a99e87404a83 tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fae6d9bf-910e-4678-b8a1-b2f072a9566c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:15 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5810a56a-46bf-404e-ab2b-a99e87404a83 tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fae6d9bf-910e-4678-b8a1-b2f072a9566c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:15 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5810a56a-46bf-404e-ab2b-a99e87404a83 tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (184472a4-0615-4814-a482-3e39d2e8afc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:15 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5810a56a-46bf-404e-ab2b-a99e87404a83 tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (184472a4-0615-4814-a482-3e39d2e8afc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '490916f1-15c4-4f05-a7d6-53c82e0495b9', 'volume_name': 'volume-490916f1-15c4-4f05-a7d6-53c82e0495b9', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:15 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5810a56a-46bf-404e-ab2b-a99e87404a83 tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e9922c8-66a5-4c4e-bbf9-55323712d581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:15 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5810a56a-46bf-404e-ab2b-a99e87404a83 tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e9922c8-66a5-4c4e-bbf9-55323712d581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:15 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5810a56a-46bf-404e-ab2b-a99e87404a83 tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d174c5d0-e92b-4991-ac2e-f5024c6fe1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:15 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-5810a56a-46bf-404e-ab2b-a99e87404a83 tempest-VolumesGetTest-907870811 None] Volume 490916f1-15c4-4f05-a7d6-53c82e0495b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-490916f1-15c4-4f05-a7d6-53c82e0495b9', 'volume_size': 1} Nov 03 07:35:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-5810a56a-46bf-404e-ab2b-a99e87404a83 tempest-VolumesGetTest-907870811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:35:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-5810a56a-46bf-404e-ab2b-a99e87404a83 tempest-VolumesGetTest-907870811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:35:15 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-5810a56a-46bf-404e-ab2b-a99e87404a83 tempest-VolumesGetTest-907870811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:35:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1914647058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=490916f1-15c4-4f05-a7d6-53c82e0495b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22222170fcf741d7a736bc82b75e21f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:35:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:35:16Z,use_quota=True,user_id='39c2f1663cad426498e6fc266f9b70dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:35:15 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-5810a56a-46bf-404e-ab2b-a99e87404a83 tempest-VolumesGetTest-907870811 None] Creating volume 490916f1-15c4-4f05-a7d6-53c82e0495b9 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:35:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-5810a56a-46bf-404e-ab2b-a99e87404a83 tempest-VolumesGetTest-907870811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:35:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-5810a56a-46bf-404e-ab2b-a99e87404a83 tempest-VolumesGetTest-907870811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:35:15 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-5810a56a-46bf-404e-ab2b-a99e87404a83 tempest-VolumesGetTest-907870811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:35:15 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-5810a56a-46bf-404e-ab2b-a99e87404a83 tempest-VolumesGetTest-907870811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:35:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-5810a56a-46bf-404e-ab2b-a99e87404a83 tempest-VolumesGetTest-907870811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:35:15 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-5810a56a-46bf-404e-ab2b-a99e87404a83 tempest-VolumesGetTest-907870811 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:35:15 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-5810a56a-46bf-404e-ab2b-a99e87404a83 tempest-VolumesGetTest-907870811 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:35:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5810a56a-46bf-404e-ab2b-a99e87404a83 tempest-VolumesGetTest-907870811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-490916f1-15c4-4f05-a7d6-53c82e0495b9 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:15 devstack sudo[95517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-490916f1-15c4-4f05-a7d6-53c82e0495b9 1073741824 Nov 03 07:35:15 devstack sudo[95517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:16 devstack sudo[95517]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5810a56a-46bf-404e-ab2b-a99e87404a83 tempest-VolumesGetTest-907870811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-490916f1-15c4-4f05-a7d6-53c82e0495b9 1073741824" returned: 0 in 1.010s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5810a56a-46bf-404e-ab2b-a99e87404a83 tempest-VolumesGetTest-907870811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-490916f1-15c4-4f05-a7d6-53c82e0495b9 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:16 devstack sudo[95529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-490916f1-15c4-4f05-a7d6-53c82e0495b9 Nov 03 07:35:16 devstack sudo[95529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:17 devstack sudo[95529]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5810a56a-46bf-404e-ab2b-a99e87404a83 tempest-VolumesGetTest-907870811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-490916f1-15c4-4f05-a7d6-53c82e0495b9" returned: 0 in 0.382s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:17 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-5810a56a-46bf-404e-ab2b-a99e87404a83 tempest-VolumesGetTest-907870811 None] <== create_volume: return (1487ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:35:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-5810a56a-46bf-404e-ab2b-a99e87404a83 tempest-VolumesGetTest-907870811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.497s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:35:17 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5810a56a-46bf-404e-ab2b-a99e87404a83 tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d174c5d0-e92b-4991-ac2e-f5024c6fe1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-490916f1-15c4-4f05-a7d6-53c82e0495b9', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:17 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5810a56a-46bf-404e-ab2b-a99e87404a83 tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3534df83-f011-4eff-8746-6fcc7aec8b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:17 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-5810a56a-46bf-404e-ab2b-a99e87404a83 tempest-VolumesGetTest-907870811 None] Volume volume-490916f1-15c4-4f05-a7d6-53c82e0495b9 (490916f1-15c4-4f05-a7d6-53c82e0495b9): created successfully Nov 03 07:35:17 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5810a56a-46bf-404e-ab2b-a99e87404a83 tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3534df83-f011-4eff-8746-6fcc7aec8b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:17 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5810a56a-46bf-404e-ab2b-a99e87404a83 tempest-VolumesGetTest-907870811 None] Flow 'volume_create_manager' (fb20c02e-9a2e-47de-a21f-af96ea19da97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:35:17 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-4131b1ed-4e12-4149-84d5-9aa1d616b305 tempest-TestMinimumBasicScenario-1160398710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:35:17 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4131b1ed-4e12-4149-84d5-9aa1d616b305 tempest-TestMinimumBasicScenario-1160398710 None] Flow 'volume_create_manager' (428492ed-3b1e-48ee-89db-439a4ebc6e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:35:17 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4131b1ed-4e12-4149-84d5-9aa1d616b305 tempest-TestMinimumBasicScenario-1160398710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (999af49f-23a4-4897-99af-01191ea5b3f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:17 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-5810a56a-46bf-404e-ab2b-a99e87404a83 tempest-VolumesGetTest-907870811 None] Created volume successfully. Nov 03 07:35:17 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4131b1ed-4e12-4149-84d5-9aa1d616b305 tempest-TestMinimumBasicScenario-1160398710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (999af49f-23a4-4897-99af-01191ea5b3f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:35:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1622690373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bd6ffd3-c633-40e4-9b14-76840174c32b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afe76b4e09c448149e05661457fa31e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:35:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:35:17Z,use_quota=True,user_id='44a100bc85d44bbda74cb35a03000d4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:17 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4131b1ed-4e12-4149-84d5-9aa1d616b305 tempest-TestMinimumBasicScenario-1160398710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a4b064d-54ab-4a30-8d35-2f3d89f503dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:17 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4131b1ed-4e12-4149-84d5-9aa1d616b305 tempest-TestMinimumBasicScenario-1160398710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a4b064d-54ab-4a30-8d35-2f3d89f503dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:17 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4131b1ed-4e12-4149-84d5-9aa1d616b305 tempest-TestMinimumBasicScenario-1160398710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b90d66a5-6511-45af-897c-8dcd438a0615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:17 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4131b1ed-4e12-4149-84d5-9aa1d616b305 tempest-TestMinimumBasicScenario-1160398710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b90d66a5-6511-45af-897c-8dcd438a0615) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bd6ffd3-c633-40e4-9b14-76840174c32b', 'volume_name': 'volume-9bd6ffd3-c633-40e4-9b14-76840174c32b', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:17 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4131b1ed-4e12-4149-84d5-9aa1d616b305 tempest-TestMinimumBasicScenario-1160398710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (554ab791-db3b-4147-a002-39ac4af60487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:17 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4131b1ed-4e12-4149-84d5-9aa1d616b305 tempest-TestMinimumBasicScenario-1160398710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (554ab791-db3b-4147-a002-39ac4af60487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:17 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4131b1ed-4e12-4149-84d5-9aa1d616b305 tempest-TestMinimumBasicScenario-1160398710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65337f02-75cf-47d9-90d5-2b3faf7d3c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:17 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-4131b1ed-4e12-4149-84d5-9aa1d616b305 tempest-TestMinimumBasicScenario-1160398710 None] Volume 9bd6ffd3-c633-40e4-9b14-76840174c32b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bd6ffd3-c633-40e4-9b14-76840174c32b', 'volume_size': 1} Nov 03 07:35:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-4131b1ed-4e12-4149-84d5-9aa1d616b305 tempest-TestMinimumBasicScenario-1160398710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:35:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-4131b1ed-4e12-4149-84d5-9aa1d616b305 tempest-TestMinimumBasicScenario-1160398710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:35:17 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-4131b1ed-4e12-4149-84d5-9aa1d616b305 tempest-TestMinimumBasicScenario-1160398710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:35:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1622690373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bd6ffd3-c633-40e4-9b14-76840174c32b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afe76b4e09c448149e05661457fa31e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:35:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:35:17Z,use_quota=True,user_id='44a100bc85d44bbda74cb35a03000d4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:35:17 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-4131b1ed-4e12-4149-84d5-9aa1d616b305 tempest-TestMinimumBasicScenario-1160398710 None] Creating volume 9bd6ffd3-c633-40e4-9b14-76840174c32b {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:35:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-4131b1ed-4e12-4149-84d5-9aa1d616b305 tempest-TestMinimumBasicScenario-1160398710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:35:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-4131b1ed-4e12-4149-84d5-9aa1d616b305 tempest-TestMinimumBasicScenario-1160398710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:35:17 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-4131b1ed-4e12-4149-84d5-9aa1d616b305 tempest-TestMinimumBasicScenario-1160398710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:35:17 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-4131b1ed-4e12-4149-84d5-9aa1d616b305 tempest-TestMinimumBasicScenario-1160398710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:35:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-4131b1ed-4e12-4149-84d5-9aa1d616b305 tempest-TestMinimumBasicScenario-1160398710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:35:17 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-4131b1ed-4e12-4149-84d5-9aa1d616b305 tempest-TestMinimumBasicScenario-1160398710 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:35:17 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-4131b1ed-4e12-4149-84d5-9aa1d616b305 tempest-TestMinimumBasicScenario-1160398710 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:35:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4131b1ed-4e12-4149-84d5-9aa1d616b305 tempest-TestMinimumBasicScenario-1160398710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9bd6ffd3-c633-40e4-9b14-76840174c32b 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:17 devstack sudo[95533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9bd6ffd3-c633-40e4-9b14-76840174c32b 1073741824 Nov 03 07:35:17 devstack sudo[95533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:18 devstack sudo[95533]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:18 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4131b1ed-4e12-4149-84d5-9aa1d616b305 tempest-TestMinimumBasicScenario-1160398710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9bd6ffd3-c633-40e4-9b14-76840174c32b 1073741824" returned: 0 in 0.633s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:18 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:UPDATE=52,cinder:SELECT=45,cinder:DELETE=7,cinder:INSERT=11 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:35:18 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4131b1ed-4e12-4149-84d5-9aa1d616b305 tempest-TestMinimumBasicScenario-1160398710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9bd6ffd3-c633-40e4-9b14-76840174c32b {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:18 devstack sudo[95539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9bd6ffd3-c633-40e4-9b14-76840174c32b Nov 03 07:35:18 devstack sudo[95539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:18 devstack sudo[95539]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:18 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4131b1ed-4e12-4149-84d5-9aa1d616b305 tempest-TestMinimumBasicScenario-1160398710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9bd6ffd3-c633-40e4-9b14-76840174c32b" returned: 0 in 0.376s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:18 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-4131b1ed-4e12-4149-84d5-9aa1d616b305 tempest-TestMinimumBasicScenario-1160398710 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:35:18 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-4131b1ed-4e12-4149-84d5-9aa1d616b305 tempest-TestMinimumBasicScenario-1160398710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:35:18 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4131b1ed-4e12-4149-84d5-9aa1d616b305 tempest-TestMinimumBasicScenario-1160398710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65337f02-75cf-47d9-90d5-2b3faf7d3c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bd6ffd3-c633-40e4-9b14-76840174c32b', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:18 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4131b1ed-4e12-4149-84d5-9aa1d616b305 tempest-TestMinimumBasicScenario-1160398710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd40d917-4de2-47f4-99e0-edd0224722d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:18 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-4131b1ed-4e12-4149-84d5-9aa1d616b305 tempest-TestMinimumBasicScenario-1160398710 None] Volume volume-9bd6ffd3-c633-40e4-9b14-76840174c32b (9bd6ffd3-c633-40e4-9b14-76840174c32b): created successfully Nov 03 07:35:18 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4131b1ed-4e12-4149-84d5-9aa1d616b305 tempest-TestMinimumBasicScenario-1160398710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd40d917-4de2-47f4-99e0-edd0224722d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:18 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4131b1ed-4e12-4149-84d5-9aa1d616b305 tempest-TestMinimumBasicScenario-1160398710 None] Flow 'volume_create_manager' (428492ed-3b1e-48ee-89db-439a4ebc6e7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:35:18 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-4131b1ed-4e12-4149-84d5-9aa1d616b305 tempest-TestMinimumBasicScenario-1160398710 None] Created volume successfully. Nov 03 07:35:19 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:35:19 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] Flow 'volume_create_manager' (fb94ad15-29ea-4f80-b263-d13b377fb7e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:35:19 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4a83679-44bf-42bf-9e2b-f45c5b5e8aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:19 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4a83679-44bf-42bf-9e2b-f45c5b5e8aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:35:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2139877360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63af63be-bb6a-47a5-bd0b-86a3527fde10,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='22222170fcf741d7a736bc82b75e21f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:35:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=490916f1-15c4-4f05-a7d6-53c82e0495b9,status='creating',terminated_at=None,updated_at=2026-11-03T06:35:20Z,use_quota=True,user_id='39c2f1663cad426498e6fc266f9b70dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:19 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cc081e4-c80b-48c7-ad79-aca68200da05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:19 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cc081e4-c80b-48c7-ad79-aca68200da05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:19 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0c1978f-669d-40d9-a070-641dc73d53b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:19 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0c1978f-669d-40d9-a070-641dc73d53b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '63af63be-bb6a-47a5-bd0b-86a3527fde10', 'volume_name': 'volume-63af63be-bb6a-47a5-bd0b-86a3527fde10', 'volume_size': 1, 'source_volid': '490916f1-15c4-4f05-a7d6-53c82e0495b9', 'source_volstatus': 'available'}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:19 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3500cb44-637f-4735-a416-3ee0d03089b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:19 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3500cb44-637f-4735-a416-3ee0d03089b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:19 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (747cd9ec-42ee-4292-be18-9a831b69cddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:19 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] Volume 63af63be-bb6a-47a5-bd0b-86a3527fde10: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-63af63be-bb6a-47a5-bd0b-86a3527fde10', 'volume_size': 1, 'source_volid': '490916f1-15c4-4f05-a7d6-53c82e0495b9', 'source_volstatus': 'available'} Nov 03 07:35:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:35:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:35:20 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] Cloning volume 490916f1-15c4-4f05-a7d6-53c82e0495b9 to volume 63af63be-bb6a-47a5-bd0b-86a3527fde10 Nov 03 07:35:20 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] Creating offline snapshot 4d3314f0-07ab-46f0-ad34-557360265cd5 of volume 490916f1-15c4-4f05-a7d6-53c82e0495b9 {{(pid=86875) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:35:20 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa74562b-f1ea-4a3b-8270-094efa118691]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:35:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-490916f1-15c4-4f05-a7d6-53c82e0495b9 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:20 devstack sudo[95548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-490916f1-15c4-4f05-a7d6-53c82e0495b9 Nov 03 07:35:20 devstack sudo[95548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:20 devstack sudo[95548]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-490916f1-15c4-4f05-a7d6-53c82e0495b9" returned: 0 in 0.570s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-490916f1-15c4-4f05-a7d6-53c82e0495b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-490916f1-15c4-4f05-a7d6-53c82e0495b9.4d3314f0-07ab-46f0-ad34-557360265cd5 1G {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:20 devstack sudo[95553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-490916f1-15c4-4f05-a7d6-53c82e0495b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-490916f1-15c4-4f05-a7d6-53c82e0495b9.4d3314f0-07ab-46f0-ad34-557360265cd5 1G Nov 03 07:35:20 devstack sudo[95553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:21 devstack sudo[95553]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-490916f1-15c4-4f05-a7d6-53c82e0495b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-490916f1-15c4-4f05-a7d6-53c82e0495b9.4d3314f0-07ab-46f0-ad34-557360265cd5 1G" returned: 0 in 0.844s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-490916f1-15c4-4f05-a7d6-53c82e0495b9 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-490916f1-15c4-4f05-a7d6-53c82e0495b9.4d3314f0-07ab-46f0-ad34-557360265cd5 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:21 devstack sudo[95569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-490916f1-15c4-4f05-a7d6-53c82e0495b9 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-490916f1-15c4-4f05-a7d6-53c82e0495b9.4d3314f0-07ab-46f0-ad34-557360265cd5 Nov 03 07:35:21 devstack sudo[95569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-8e9584df-6a80-4b06-92cd-1ac326b8ce0b req-833804d2-4f4a-45f4-8e1d-4f2f1d6cb9de tempest-TestMinimumBasicScenario-1160398710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:35:22 devstack sudo[95569]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-490916f1-15c4-4f05-a7d6-53c82e0495b9 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-490916f1-15c4-4f05-a7d6-53c82e0495b9.4d3314f0-07ab-46f0-ad34-557360265cd5" returned: 0 in 0.476s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:22 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-490916f1-15c4-4f05-a7d6-53c82e0495b9.4d3314f0-07ab-46f0-ad34-557360265cd5 is being set with open permissions: ugo+rw Nov 03 07:35:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-490916f1-15c4-4f05-a7d6-53c82e0495b9.4d3314f0-07ab-46f0-ad34-557360265cd5 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:22 devstack sudo[95577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-490916f1-15c4-4f05-a7d6-53c82e0495b9.4d3314f0-07ab-46f0-ad34-557360265cd5 Nov 03 07:35:22 devstack sudo[95577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:22 devstack sudo[95577]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-490916f1-15c4-4f05-a7d6-53c82e0495b9.4d3314f0-07ab-46f0-ad34-557360265cd5" returned: 0 in 0.412s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-490916f1-15c4-4f05-a7d6-53c82e0495b9.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:22 devstack sudo[95580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-490916f1-15c4-4f05-a7d6-53c82e0495b9.info Nov 03 07:35:22 devstack sudo[95580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:22 devstack sudo[95580]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-490916f1-15c4-4f05-a7d6-53c82e0495b9.info" returned: 0 in 0.443s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:22 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-490916f1-15c4-4f05-a7d6-53c82e0495b9.info is being set with open permissions: ugo+rw Nov 03 07:35:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-490916f1-15c4-4f05-a7d6-53c82e0495b9.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:22 devstack sudo[95583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-490916f1-15c4-4f05-a7d6-53c82e0495b9.info Nov 03 07:35:22 devstack sudo[95583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:23 devstack sudo[95583]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-490916f1-15c4-4f05-a7d6-53c82e0495b9.info" returned: 0 in 0.536s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:23 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] Acquiring lock "cinder-quobyte-63af63be-bb6a-47a5-bd0b-86a3527fde10" by "_copy_volume_from_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:35:23 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] Lock "cinder-quobyte-63af63be-bb6a-47a5-bd0b-86a3527fde10" acquired by "_copy_volume_from_snapshot" :: waited 0.054s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:35:23 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] snapshot: 4d3314f0-07ab-46f0-ad34-557360265cd5, volume: 63af63be-bb6a-47a5-bd0b-86a3527fde10, {{(pid=86875) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 07:35:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:35:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:35:23 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:35:23 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:35:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:35:23 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11b0302-66e9-4da2-b7e3-6944abbe7850]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:35:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-490916f1-15c4-4f05-a7d6-53c82e0495b9.4d3314f0-07ab-46f0-ad34-557360265cd5 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:23 devstack sudo[95609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-490916f1-15c4-4f05-a7d6-53c82e0495b9.4d3314f0-07ab-46f0-ad34-557360265cd5 Nov 03 07:35:23 devstack sudo[95609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:24 devstack sudo[95609]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-490916f1-15c4-4f05-a7d6-53c82e0495b9.4d3314f0-07ab-46f0-ad34-557360265cd5" returned: 0 in 0.523s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:24 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-490916f1-15c4-4f05-a7d6-53c82e0495b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:35:24 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[25126c7f-daa9-4b9c-b06d-5b080661da15]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:35:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-490916f1-15c4-4f05-a7d6-53c82e0495b9 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:24 devstack sudo[95614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-490916f1-15c4-4f05-a7d6-53c82e0495b9 Nov 03 07:35:24 devstack sudo[95614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:24 devstack sudo[95614]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-490916f1-15c4-4f05-a7d6-53c82e0495b9" returned: 0 in 0.453s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:24 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] will copy from snapshot at /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-490916f1-15c4-4f05-a7d6-53c82e0495b9 {{(pid=86875) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 07:35:24 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] Creating direct copy from snapshot {{(pid=86875) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 07:35:24 devstack cinder-volume[86875]: DEBUG cinder.utils [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] Path /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-63af63be-bb6a-47a5-bd0b-86a3527fde10 not found in is_blk_device check {{(pid=86875) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 07:35:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-490916f1-15c4-4f05-a7d6-53c82e0495b9 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-63af63be-bb6a-47a5-bd0b-86a3527fde10 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:24 devstack sudo[95620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-490916f1-15c4-4f05-a7d6-53c82e0495b9 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-63af63be-bb6a-47a5-bd0b-86a3527fde10 Nov 03 07:35:24 devstack sudo[95620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:32 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:UPDATE=1,cinder:SELECT=6,cinder:INSERT=1 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:35:32 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:UPDATE=38,cinder:SELECT=22,cinder:DELETE=4,cinder:INSERT=8 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:35:36 devstack sudo[95620]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:36 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-490916f1-15c4-4f05-a7d6-53c82e0495b9 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-63af63be-bb6a-47a5-bd0b-86a3527fde10" returned: 0 in 11.592s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:36 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] Image conversion details: src /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-490916f1-15c4-4f05-a7d6-53c82e0495b9, size 1024.00 MB, duration 11.59 sec, destination /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-63af63be-bb6a-47a5-bd0b-86a3527fde10 {{(pid=86875) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:35:36 devstack cinder-volume[86875]: INFO cinder.image.image_utils [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] Converted 1024.00 MB image at 88.33 MB/s Nov 03 07:35:36 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-63af63be-bb6a-47a5-bd0b-86a3527fde10 is being set with open permissions: ugo+rw Nov 03 07:35:36 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-63af63be-bb6a-47a5-bd0b-86a3527fde10 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:36 devstack sudo[95726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-63af63be-bb6a-47a5-bd0b-86a3527fde10 Nov 03 07:35:36 devstack sudo[95726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:36 devstack sudo[95726]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:36 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-63af63be-bb6a-47a5-bd0b-86a3527fde10" returned: 0 in 0.391s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:36 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] Lock "cinder-quobyte-63af63be-bb6a-47a5-bd0b-86a3527fde10" released by "_copy_volume_from_snapshot" :: held 13.134s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:35:36 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] Acquiring lock "cinder-quobyte-4d3314f0-07ab-46f0-ad34-557360265cd5" by "_delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:35:36 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] Lock "cinder-quobyte-4d3314f0-07ab-46f0-ad34-557360265cd5" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:35:36 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] Deleting offline snapshot 4d3314f0-07ab-46f0-ad34-557360265cd5 of volume 490916f1-15c4-4f05-a7d6-53c82e0495b9 {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:35:36 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] snapshot_file for this snap is: volume-490916f1-15c4-4f05-a7d6-53c82e0495b9.4d3314f0-07ab-46f0-ad34-557360265cd5 {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:35:36 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7a50a9-2942-48f5-bad2-8c96fcf97c32]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:35:36 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-490916f1-15c4-4f05-a7d6-53c82e0495b9.4d3314f0-07ab-46f0-ad34-557360265cd5 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:36 devstack sudo[95729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-490916f1-15c4-4f05-a7d6-53c82e0495b9.4d3314f0-07ab-46f0-ad34-557360265cd5 Nov 03 07:35:36 devstack sudo[95729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:37 devstack sudo[95729]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-490916f1-15c4-4f05-a7d6-53c82e0495b9.4d3314f0-07ab-46f0-ad34-557360265cd5" returned: 0 in 0.383s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:37 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-490916f1-15c4-4f05-a7d6-53c82e0495b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:35:37 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee910e63-afb9-4dc7-a4cc-5620d423659e]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:35:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-490916f1-15c4-4f05-a7d6-53c82e0495b9 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:37 devstack sudo[95737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-490916f1-15c4-4f05-a7d6-53c82e0495b9 Nov 03 07:35:37 devstack sudo[95737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:37 devstack sudo[95737]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-490916f1-15c4-4f05-a7d6-53c82e0495b9" returned: 0 in 0.612s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-490916f1-15c4-4f05-a7d6-53c82e0495b9.4d3314f0-07ab-46f0-ad34-557360265cd5 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:37 devstack sudo[95742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-490916f1-15c4-4f05-a7d6-53c82e0495b9.4d3314f0-07ab-46f0-ad34-557360265cd5 Nov 03 07:35:37 devstack sudo[95742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:38 devstack sudo[95742]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-490916f1-15c4-4f05-a7d6-53c82e0495b9.4d3314f0-07ab-46f0-ad34-557360265cd5" returned: 0 in 0.360s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-490916f1-15c4-4f05-a7d6-53c82e0495b9.4d3314f0-07ab-46f0-ad34-557360265cd5 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:38 devstack sudo[95747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-490916f1-15c4-4f05-a7d6-53c82e0495b9.4d3314f0-07ab-46f0-ad34-557360265cd5 Nov 03 07:35:38 devstack sudo[95747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:38 devstack sudo[95747]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-490916f1-15c4-4f05-a7d6-53c82e0495b9.4d3314f0-07ab-46f0-ad34-557360265cd5" returned: 0 in 0.305s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:38 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] Lock "cinder-quobyte-4d3314f0-07ab-46f0-ad34-557360265cd5" released by "_delete_snapshot" :: held 1.794s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:35:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.606s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:35:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-8e9584df-6a80-4b06-92cd-1ac326b8ce0b req-833804d2-4f4a-45f4-8e1d-4f2f1d6cb9de tempest-TestMinimumBasicScenario-1160398710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 16.873s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:35:38 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (747cd9ec-42ee-4292-be18-9a831b69cddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63af63be-bb6a-47a5-bd0b-86a3527fde10', 'volume_size': 1, 'source_volid': '490916f1-15c4-4f05-a7d6-53c82e0495b9', 'source_volstatus': 'available'}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:38 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32c340cc-1fa3-4f98-a2da-bfb3ce66478c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-8e9584df-6a80-4b06-92cd-1ac326b8ce0b req-833804d2-4f4a-45f4-8e1d-4f2f1d6cb9de tempest-TestMinimumBasicScenario-1160398710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.048s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:35:38 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] Volume volume-63af63be-bb6a-47a5-bd0b-86a3527fde10 (63af63be-bb6a-47a5-bd0b-86a3527fde10): created successfully Nov 03 07:35:38 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32c340cc-1fa3-4f98-a2da-bfb3ce66478c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:38 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] Flow 'volume_create_manager' (fb94ad15-29ea-4f80-b263-d13b377fb7e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:35:38 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-dc1edae6-8dcf-48c2-82b3-287d7f3c3857 tempest-VolumesGetTest-907870811 None] Created volume successfully. Nov 03 07:35:38 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-8e9584df-6a80-4b06-92cd-1ac326b8ce0b req-833804d2-4f4a-45f4-8e1d-4f2f1d6cb9de tempest-TestMinimumBasicScenario-1160398710 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1', 'name': 'volume-9bd6ffd3-c633-40e4-9b14-76840174c32b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '32769fd5-d407-489c-ad14-ab5118c76212', 'enforce_multipath': True} {{(pid=86875) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:35:38 devstack cinder-volume[86875]: INFO cinder.volume.manager [req-8e9584df-6a80-4b06-92cd-1ac326b8ce0b req-833804d2-4f4a-45f4-8e1d-4f2f1d6cb9de tempest-TestMinimumBasicScenario-1160398710 None] attachment_update completed successfully. Nov 03 07:35:41 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ffb53f3-69cf-4a0c-8e5b-af9c1fd09e6c tempest-VolumesGetTest-907870811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:35:41 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5ffb53f3-69cf-4a0c-8e5b-af9c1fd09e6c tempest-VolumesGetTest-907870811 None] Flow 'volume_create_manager' (9915d09b-de29-4da6-9e50-5e45dfbfa7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:35:41 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5ffb53f3-69cf-4a0c-8e5b-af9c1fd09e6c tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00f1eb31-2585-453c-b01b-8ec6ae395501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:41 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5ffb53f3-69cf-4a0c-8e5b-af9c1fd09e6c tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00f1eb31-2585-453c-b01b-8ec6ae395501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:35:41Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1164712284',display_name='tempest-VolumesGetTest-Volume-1486531222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d224ee1-60ab-4102-aa9d-7a2cdb1419a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22222170fcf741d7a736bc82b75e21f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:35:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:35:41Z,use_quota=True,user_id='39c2f1663cad426498e6fc266f9b70dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:41 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5ffb53f3-69cf-4a0c-8e5b-af9c1fd09e6c tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0a3d16e-0eba-4c70-9639-ef77432350df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:41 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5ffb53f3-69cf-4a0c-8e5b-af9c1fd09e6c tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0a3d16e-0eba-4c70-9639-ef77432350df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:41 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5ffb53f3-69cf-4a0c-8e5b-af9c1fd09e6c tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71d11983-4f6f-48c4-b0b2-2836badecb45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:41 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5ffb53f3-69cf-4a0c-8e5b-af9c1fd09e6c tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71d11983-4f6f-48c4-b0b2-2836badecb45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d224ee1-60ab-4102-aa9d-7a2cdb1419a2', 'volume_name': 'volume-6d224ee1-60ab-4102-aa9d-7a2cdb1419a2', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:41 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5ffb53f3-69cf-4a0c-8e5b-af9c1fd09e6c tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45ddcfa3-986e-4c85-8798-3363e503866b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:41 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5ffb53f3-69cf-4a0c-8e5b-af9c1fd09e6c tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45ddcfa3-986e-4c85-8798-3363e503866b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:41 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5ffb53f3-69cf-4a0c-8e5b-af9c1fd09e6c tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01daacbc-0a2e-4ad9-972d-14335f4af56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:41 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-5ffb53f3-69cf-4a0c-8e5b-af9c1fd09e6c tempest-VolumesGetTest-907870811 None] Volume 6d224ee1-60ab-4102-aa9d-7a2cdb1419a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d224ee1-60ab-4102-aa9d-7a2cdb1419a2', 'volume_size': 1} Nov 03 07:35:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-5ffb53f3-69cf-4a0c-8e5b-af9c1fd09e6c tempest-VolumesGetTest-907870811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:35:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-5ffb53f3-69cf-4a0c-8e5b-af9c1fd09e6c tempest-VolumesGetTest-907870811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:35:41 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-5ffb53f3-69cf-4a0c-8e5b-af9c1fd09e6c tempest-VolumesGetTest-907870811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:35:41Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1164712284',display_name='tempest-VolumesGetTest-Volume-1486531222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d224ee1-60ab-4102-aa9d-7a2cdb1419a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22222170fcf741d7a736bc82b75e21f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:35:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:35:41Z,use_quota=True,user_id='39c2f1663cad426498e6fc266f9b70dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:35:41 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-5ffb53f3-69cf-4a0c-8e5b-af9c1fd09e6c tempest-VolumesGetTest-907870811 None] Creating volume 6d224ee1-60ab-4102-aa9d-7a2cdb1419a2 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:35:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-5ffb53f3-69cf-4a0c-8e5b-af9c1fd09e6c tempest-VolumesGetTest-907870811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:35:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-5ffb53f3-69cf-4a0c-8e5b-af9c1fd09e6c tempest-VolumesGetTest-907870811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:35:41 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-5ffb53f3-69cf-4a0c-8e5b-af9c1fd09e6c tempest-VolumesGetTest-907870811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:35:41 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-5ffb53f3-69cf-4a0c-8e5b-af9c1fd09e6c tempest-VolumesGetTest-907870811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:35:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-5ffb53f3-69cf-4a0c-8e5b-af9c1fd09e6c tempest-VolumesGetTest-907870811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:35:41 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-5ffb53f3-69cf-4a0c-8e5b-af9c1fd09e6c tempest-VolumesGetTest-907870811 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:35:41 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-5ffb53f3-69cf-4a0c-8e5b-af9c1fd09e6c tempest-VolumesGetTest-907870811 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:35:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5ffb53f3-69cf-4a0c-8e5b-af9c1fd09e6c tempest-VolumesGetTest-907870811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6d224ee1-60ab-4102-aa9d-7a2cdb1419a2 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:41 devstack sudo[96168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6d224ee1-60ab-4102-aa9d-7a2cdb1419a2 1073741824 Nov 03 07:35:41 devstack sudo[96168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:42 devstack sudo[96168]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5ffb53f3-69cf-4a0c-8e5b-af9c1fd09e6c tempest-VolumesGetTest-907870811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6d224ee1-60ab-4102-aa9d-7a2cdb1419a2 1073741824" returned: 0 in 0.783s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5ffb53f3-69cf-4a0c-8e5b-af9c1fd09e6c tempest-VolumesGetTest-907870811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6d224ee1-60ab-4102-aa9d-7a2cdb1419a2 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:42 devstack sudo[96175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6d224ee1-60ab-4102-aa9d-7a2cdb1419a2 Nov 03 07:35:42 devstack sudo[96175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:42 devstack sudo[96175]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5ffb53f3-69cf-4a0c-8e5b-af9c1fd09e6c tempest-VolumesGetTest-907870811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6d224ee1-60ab-4102-aa9d-7a2cdb1419a2" returned: 0 in 0.368s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:42 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-5ffb53f3-69cf-4a0c-8e5b-af9c1fd09e6c tempest-VolumesGetTest-907870811 None] <== create_volume: return (1247ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:35:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-5ffb53f3-69cf-4a0c-8e5b-af9c1fd09e6c tempest-VolumesGetTest-907870811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.250s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:35:42 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5ffb53f3-69cf-4a0c-8e5b-af9c1fd09e6c tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01daacbc-0a2e-4ad9-972d-14335f4af56f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d224ee1-60ab-4102-aa9d-7a2cdb1419a2', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:42 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5ffb53f3-69cf-4a0c-8e5b-af9c1fd09e6c tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1728f7e-6225-494b-bc19-74ba708c9eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:42 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-5ffb53f3-69cf-4a0c-8e5b-af9c1fd09e6c tempest-VolumesGetTest-907870811 None] Volume volume-6d224ee1-60ab-4102-aa9d-7a2cdb1419a2 (6d224ee1-60ab-4102-aa9d-7a2cdb1419a2): created successfully Nov 03 07:35:42 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5ffb53f3-69cf-4a0c-8e5b-af9c1fd09e6c tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1728f7e-6225-494b-bc19-74ba708c9eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:42 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5ffb53f3-69cf-4a0c-8e5b-af9c1fd09e6c tempest-VolumesGetTest-907870811 None] Flow 'volume_create_manager' (9915d09b-de29-4da6-9e50-5e45dfbfa7d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:35:43 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-5ffb53f3-69cf-4a0c-8e5b-af9c1fd09e6c tempest-VolumesGetTest-907870811 None] Created volume successfully. Nov 03 07:35:43 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-2a955735-f165-4468-921d-d4df2574b736 tempest-VolumesGetTest-907870811 None] Acquiring lock "cinder-6d224ee1-60ab-4102-aa9d-7a2cdb1419a2-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:35:43 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-2a955735-f165-4468-921d-d4df2574b736 tempest-VolumesGetTest-907870811 None] Lock "cinder-6d224ee1-60ab-4102-aa9d-7a2cdb1419a2-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:35:44 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-2a955735-f165-4468-921d-d4df2574b736 tempest-VolumesGetTest-907870811 None] Acquiring lock "cinder-quobyte-6d224ee1-60ab-4102-aa9d-7a2cdb1419a2" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:35:44 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-2a955735-f165-4468-921d-d4df2574b736 tempest-VolumesGetTest-907870811 None] Lock "cinder-quobyte-6d224ee1-60ab-4102-aa9d-7a2cdb1419a2" acquired by "delete_volume" :: waited 0.041s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:35:44 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[7990c253-69f4-42a6-bc00-2a30357b3781]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:35:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2a955735-f165-4468-921d-d4df2574b736 tempest-VolumesGetTest-907870811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6d224ee1-60ab-4102-aa9d-7a2cdb1419a2 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:44 devstack sudo[96179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6d224ee1-60ab-4102-aa9d-7a2cdb1419a2 Nov 03 07:35:44 devstack sudo[96179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:44 devstack sudo[96179]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2a955735-f165-4468-921d-d4df2574b736 tempest-VolumesGetTest-907870811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6d224ee1-60ab-4102-aa9d-7a2cdb1419a2" returned: 0 in 0.577s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2a955735-f165-4468-921d-d4df2574b736 tempest-VolumesGetTest-907870811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6d224ee1-60ab-4102-aa9d-7a2cdb1419a2 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:44 devstack sudo[96184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6d224ee1-60ab-4102-aa9d-7a2cdb1419a2 Nov 03 07:35:44 devstack sudo[96184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:45 devstack sudo[96184]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2a955735-f165-4468-921d-d4df2574b736 tempest-VolumesGetTest-907870811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6d224ee1-60ab-4102-aa9d-7a2cdb1419a2" returned: 0 in 0.382s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:45 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-2a955735-f165-4468-921d-d4df2574b736 tempest-VolumesGetTest-907870811 None] Lock "cinder-quobyte-6d224ee1-60ab-4102-aa9d-7a2cdb1419a2" released by "delete_volume" :: held 1.035s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:35:45 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-2a955735-f165-4468-921d-d4df2574b736 tempest-VolumesGetTest-907870811 None] Created reservations ['b091cca9-6871-4058-bea9-d8ca4bebd6c4', '7f4c4b91-2d20-4e78-b6d3-c6a763cb5107', '82640dff-f370-42e2-910b-3716c4c87fbc', 'fd92bf6e-b809-41f8-b226-5d57bd01089c'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:35:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-2a955735-f165-4468-921d-d4df2574b736 tempest-VolumesGetTest-907870811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:35:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-2a955735-f165-4468-921d-d4df2574b736 tempest-VolumesGetTest-907870811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:35:45 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-2a955735-f165-4468-921d-d4df2574b736 tempest-VolumesGetTest-907870811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:35:45 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-2a955735-f165-4468-921d-d4df2574b736 tempest-VolumesGetTest-907870811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:35:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-2a955735-f165-4468-921d-d4df2574b736 tempest-VolumesGetTest-907870811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:35:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2a955735-f165-4468-921d-d4df2574b736 tempest-VolumesGetTest-907870811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:45 devstack sudo[96187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:35:45 devstack sudo[96187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:45 devstack sudo[96187]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2a955735-f165-4468-921d-d4df2574b736 tempest-VolumesGetTest-907870811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.395s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:45 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-2a955735-f165-4468-921d-d4df2574b736 tempest-VolumesGetTest-907870811 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:35:45 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-2a955735-f165-4468-921d-d4df2574b736 tempest-VolumesGetTest-907870811 None] Deleted volume successfully. Nov 03 07:35:45 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-2a955735-f165-4468-921d-d4df2574b736 tempest-VolumesGetTest-907870811 None] Lock "cinder-6d224ee1-60ab-4102-aa9d-7a2cdb1419a2-delete_volume" released by "delete_volume" :: held 1.827s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:35:46 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ee631512-2c86-4eb1-ad59-5d2aebd148c1 tempest-VolumesGetTest-907870811 None] Acquiring lock "cinder-63af63be-bb6a-47a5-bd0b-86a3527fde10-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:35:46 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ee631512-2c86-4eb1-ad59-5d2aebd148c1 tempest-VolumesGetTest-907870811 None] Lock "cinder-63af63be-bb6a-47a5-bd0b-86a3527fde10-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:35:46 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ee631512-2c86-4eb1-ad59-5d2aebd148c1 tempest-VolumesGetTest-907870811 None] Acquiring lock "cinder-quobyte-63af63be-bb6a-47a5-bd0b-86a3527fde10" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:35:46 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ee631512-2c86-4eb1-ad59-5d2aebd148c1 tempest-VolumesGetTest-907870811 None] Lock "cinder-quobyte-63af63be-bb6a-47a5-bd0b-86a3527fde10" acquired by "delete_volume" :: waited 0.052s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:35:46 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[91bcada6-5fab-4185-8368-f81ca886845a]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:35:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ee631512-2c86-4eb1-ad59-5d2aebd148c1 tempest-VolumesGetTest-907870811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-63af63be-bb6a-47a5-bd0b-86a3527fde10 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:46 devstack sudo[96191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-63af63be-bb6a-47a5-bd0b-86a3527fde10 Nov 03 07:35:46 devstack sudo[96191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:47 devstack sudo[96191]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:47 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ee631512-2c86-4eb1-ad59-5d2aebd148c1 tempest-VolumesGetTest-907870811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-63af63be-bb6a-47a5-bd0b-86a3527fde10" returned: 0 in 0.651s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:47 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ee631512-2c86-4eb1-ad59-5d2aebd148c1 tempest-VolumesGetTest-907870811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-63af63be-bb6a-47a5-bd0b-86a3527fde10 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:47 devstack sudo[96198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-63af63be-bb6a-47a5-bd0b-86a3527fde10 Nov 03 07:35:47 devstack sudo[96198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:47 devstack sudo[96198]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:47 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ee631512-2c86-4eb1-ad59-5d2aebd148c1 tempest-VolumesGetTest-907870811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-63af63be-bb6a-47a5-bd0b-86a3527fde10" returned: 0 in 0.559s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:47 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ee631512-2c86-4eb1-ad59-5d2aebd148c1 tempest-VolumesGetTest-907870811 None] Lock "cinder-quobyte-63af63be-bb6a-47a5-bd0b-86a3527fde10" released by "delete_volume" :: held 1.303s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:35:47 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-ee631512-2c86-4eb1-ad59-5d2aebd148c1 tempest-VolumesGetTest-907870811 None] Created reservations ['10b30f72-62e0-45b4-8279-3cf9c2f422e7', '4b95881e-6ba6-4825-a8a3-72cb88086217', '8c72d05a-e132-4c43-a021-003c4954bee2', '480e6595-9ffc-46e4-93dc-05ae0dc09417'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:35:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-ee631512-2c86-4eb1-ad59-5d2aebd148c1 tempest-VolumesGetTest-907870811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:35:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-ee631512-2c86-4eb1-ad59-5d2aebd148c1 tempest-VolumesGetTest-907870811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:35:48 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-ee631512-2c86-4eb1-ad59-5d2aebd148c1 tempest-VolumesGetTest-907870811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:35:48 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-ee631512-2c86-4eb1-ad59-5d2aebd148c1 tempest-VolumesGetTest-907870811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:35:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-ee631512-2c86-4eb1-ad59-5d2aebd148c1 tempest-VolumesGetTest-907870811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:35:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ee631512-2c86-4eb1-ad59-5d2aebd148c1 tempest-VolumesGetTest-907870811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:48 devstack sudo[96201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:35:48 devstack sudo[96201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:48 devstack sudo[96201]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ee631512-2c86-4eb1-ad59-5d2aebd148c1 tempest-VolumesGetTest-907870811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.523s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:48 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-ee631512-2c86-4eb1-ad59-5d2aebd148c1 tempest-VolumesGetTest-907870811 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:35:48 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-ee631512-2c86-4eb1-ad59-5d2aebd148c1 tempest-VolumesGetTest-907870811 None] Deleted volume successfully. Nov 03 07:35:48 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ee631512-2c86-4eb1-ad59-5d2aebd148c1 tempest-VolumesGetTest-907870811 None] Lock "cinder-63af63be-bb6a-47a5-bd0b-86a3527fde10-delete_volume" released by "delete_volume" :: held 2.338s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:35:49 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-01d1b7e3-4c4d-4394-8fe5-9e9fe46cf772 tempest-VolumesGetTest-907870811 None] Acquiring lock "cinder-490916f1-15c4-4f05-a7d6-53c82e0495b9-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:35:49 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-01d1b7e3-4c4d-4394-8fe5-9e9fe46cf772 tempest-VolumesGetTest-907870811 None] Lock "cinder-490916f1-15c4-4f05-a7d6-53c82e0495b9-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:35:49 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-01d1b7e3-4c4d-4394-8fe5-9e9fe46cf772 tempest-VolumesGetTest-907870811 None] Acquiring lock "cinder-quobyte-490916f1-15c4-4f05-a7d6-53c82e0495b9" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:35:49 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-01d1b7e3-4c4d-4394-8fe5-9e9fe46cf772 tempest-VolumesGetTest-907870811 None] Lock "cinder-quobyte-490916f1-15c4-4f05-a7d6-53c82e0495b9" acquired by "delete_volume" :: waited 0.032s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:35:49 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabd3c13-93ee-498a-a6a4-30f137c41fc5]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:35:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-01d1b7e3-4c4d-4394-8fe5-9e9fe46cf772 tempest-VolumesGetTest-907870811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-490916f1-15c4-4f05-a7d6-53c82e0495b9 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:49 devstack sudo[96204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-490916f1-15c4-4f05-a7d6-53c82e0495b9 Nov 03 07:35:49 devstack sudo[96204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:49 devstack sudo[96204]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-01d1b7e3-4c4d-4394-8fe5-9e9fe46cf772 tempest-VolumesGetTest-907870811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-490916f1-15c4-4f05-a7d6-53c82e0495b9" returned: 0 in 0.636s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-01d1b7e3-4c4d-4394-8fe5-9e9fe46cf772 tempest-VolumesGetTest-907870811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-490916f1-15c4-4f05-a7d6-53c82e0495b9 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:49 devstack sudo[96210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-490916f1-15c4-4f05-a7d6-53c82e0495b9 Nov 03 07:35:49 devstack sudo[96210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:50 devstack sudo[96210]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-01d1b7e3-4c4d-4394-8fe5-9e9fe46cf772 tempest-VolumesGetTest-907870811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-490916f1-15c4-4f05-a7d6-53c82e0495b9" returned: 0 in 0.439s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:50 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-01d1b7e3-4c4d-4394-8fe5-9e9fe46cf772 tempest-VolumesGetTest-907870811 None] Lock "cinder-quobyte-490916f1-15c4-4f05-a7d6-53c82e0495b9" released by "delete_volume" :: held 1.178s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:35:50 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-01d1b7e3-4c4d-4394-8fe5-9e9fe46cf772 tempest-VolumesGetTest-907870811 None] Created reservations ['126f05f8-94c9-4bd9-8b8f-77b28cb482bc', '890f24d4-5c42-4056-96d9-0d733db80b22', '3065f0c6-f9a7-4807-be5c-05ce71d7e38f', 'c8573bbb-5151-45bb-a00e-2b01a2790802'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:35:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-01d1b7e3-4c4d-4394-8fe5-9e9fe46cf772 tempest-VolumesGetTest-907870811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:35:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-01d1b7e3-4c4d-4394-8fe5-9e9fe46cf772 tempest-VolumesGetTest-907870811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:35:50 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-01d1b7e3-4c4d-4394-8fe5-9e9fe46cf772 tempest-VolumesGetTest-907870811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:35:50 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-01d1b7e3-4c4d-4394-8fe5-9e9fe46cf772 tempest-VolumesGetTest-907870811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:35:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-01d1b7e3-4c4d-4394-8fe5-9e9fe46cf772 tempest-VolumesGetTest-907870811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:35:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-01d1b7e3-4c4d-4394-8fe5-9e9fe46cf772 tempest-VolumesGetTest-907870811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:50 devstack sudo[96215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:35:50 devstack sudo[96215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:50 devstack sudo[96215]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-01d1b7e3-4c4d-4394-8fe5-9e9fe46cf772 tempest-VolumesGetTest-907870811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.364s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:50 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-01d1b7e3-4c4d-4394-8fe5-9e9fe46cf772 tempest-VolumesGetTest-907870811 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:35:50 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-01d1b7e3-4c4d-4394-8fe5-9e9fe46cf772 tempest-VolumesGetTest-907870811 None] Deleted volume successfully. Nov 03 07:35:50 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-01d1b7e3-4c4d-4394-8fe5-9e9fe46cf772 tempest-VolumesGetTest-907870811 None] Lock "cinder-490916f1-15c4-4f05-a7d6-53c82e0495b9-delete_volume" released by "delete_volume" :: held 1.928s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:35:53 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-9954f93d-6cf8-4f50-81f7-961b3af3d442 tempest-VolumesGetTest-907870811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:35:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-9954f93d-6cf8-4f50-81f7-961b3af3d442 tempest-VolumesGetTest-907870811 None] Flow 'volume_create_manager' (754296d3-2332-4e79-a6e2-f11fc8d9eb2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:35:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-9954f93d-6cf8-4f50-81f7-961b3af3d442 tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78c072a1-1467-4369-9831-edca4f6cdf25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-9954f93d-6cf8-4f50-81f7-961b3af3d442 tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78c072a1-1467-4369-9831-edca4f6cdf25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:35:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-915281798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c14eb62-7ee5-4585-9382-ef1dbc171b2f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='22222170fcf741d7a736bc82b75e21f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:35:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:35:53Z,use_quota=True,user_id='39c2f1663cad426498e6fc266f9b70dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-9954f93d-6cf8-4f50-81f7-961b3af3d442 tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5196362e-cf91-41c9-8efd-604956d6b948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-9954f93d-6cf8-4f50-81f7-961b3af3d442 tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5196362e-cf91-41c9-8efd-604956d6b948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-9954f93d-6cf8-4f50-81f7-961b3af3d442 tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e10667af-f2e3-4669-8d5c-9f6b5e16490a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:53 devstack cinder-volume[86875]: DEBUG cinder.image.glance [None req-9954f93d-6cf8-4f50-81f7-961b3af3d442 tempest-VolumesGetTest-907870811 None] Creating Keystone auth plugin from conf {{(pid=86875) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 07:35:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-9954f93d-6cf8-4f50-81f7-961b3af3d442 tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e10667af-f2e3-4669-8d5c-9f6b5e16490a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7c14eb62-7ee5-4585-9382-ef1dbc171b2f', 'volume_name': 'volume-7c14eb62-7ee5-4585-9382-ef1dbc171b2f', 'volume_size': 1, 'image_id': 'eb68a148-0c9c-4237-9d8d-94a6a7cd87d9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eb68a148-0c9c-4237-9d8d-94a6a7cd87d9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c9ace38ee46b42979b3d4c79532bd66e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eb68a148-0c9c-4237-9d8d-94a6a7cd87d9', 'created_at': datetime.datetime(2026, 11, 3, 6, 21, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 21, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eb68a148-0c9c-4237-9d8d-94a6a7cd87d9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-9954f93d-6cf8-4f50-81f7-961b3af3d442 tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c430bff-194d-4bae-a001-d0068abf0299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-9954f93d-6cf8-4f50-81f7-961b3af3d442 tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c430bff-194d-4bae-a001-d0068abf0299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:35:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-9954f93d-6cf8-4f50-81f7-961b3af3d442 tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e80ea0c-1605-4bb8-bd91-a7601c8ae9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:35:53 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-9954f93d-6cf8-4f50-81f7-961b3af3d442 tempest-VolumesGetTest-907870811 None] Volume 7c14eb62-7ee5-4585-9382-ef1dbc171b2f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7c14eb62-7ee5-4585-9382-ef1dbc171b2f', 'volume_size': 1, 'image_id': 'eb68a148-0c9c-4237-9d8d-94a6a7cd87d9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eb68a148-0c9c-4237-9d8d-94a6a7cd87d9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c9ace38ee46b42979b3d4c79532bd66e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eb68a148-0c9c-4237-9d8d-94a6a7cd87d9', 'created_at': datetime.datetime(2026, 11, 3, 6, 21, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 21, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eb68a148-0c9c-4237-9d8d-94a6a7cd87d9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 03 07:35:53 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-9954f93d-6cf8-4f50-81f7-961b3af3d442 tempest-VolumesGetTest-907870811 None] Trying to clone 7c14eb62-7ee5-4585-9382-ef1dbc171b2f from image eb68a148-0c9c-4237-9d8d-94a6a7cd87d9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/eb68a148-0c9c-4237-9d8d-94a6a7cd87d9', 'metadata': {}}]). {{(pid=86875) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 07:35:54 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-9954f93d-6cf8-4f50-81f7-961b3af3d442 tempest-VolumesGetTest-907870811 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_j5rkqpm1devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86875) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 07:35:54 devstack cinder-volume[86875]: INFO cinder.image.image_utils [None req-9954f93d-6cf8-4f50-81f7-961b3af3d442 tempest-VolumesGetTest-907870811 None] Image download 20.69 MB at 20.69 MB/s Nov 03 07:35:55 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[691d3e6f-3777-4f96-ab3d-6e6b1e20bfd3]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:35:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9954f93d-6cf8-4f50-81f7-961b3af3d442 tempest-VolumesGetTest-907870811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_j5rkqpm1devstack@QuobyteHD {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:55 devstack sudo[96244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_j5rkqpm1devstack@QuobyteHD Nov 03 07:35:55 devstack sudo[96244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:55 devstack sudo[96244]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9954f93d-6cf8-4f50-81f7-961b3af3d442 tempest-VolumesGetTest-907870811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_j5rkqpm1devstack@QuobyteHD" returned: 0 in 0.531s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:55 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-9954f93d-6cf8-4f50-81f7-961b3af3d442 tempest-VolumesGetTest-907870811 None] Temporary image eb68a148-0c9c-4237-9d8d-94a6a7cd87d9 is fetched for user 39c2f1663cad426498e6fc266f9b70dc. {{(pid=86875) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 07:35:55 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbac6bdb-da9c-4951-82eb-573800d8b78e]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:35:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9954f93d-6cf8-4f50-81f7-961b3af3d442 tempest-VolumesGetTest-907870811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_j5rkqpm1devstack@QuobyteHD {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:55 devstack sudo[96261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_j5rkqpm1devstack@QuobyteHD Nov 03 07:35:55 devstack sudo[96261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:56 devstack sudo[96261]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9954f93d-6cf8-4f50-81f7-961b3af3d442 tempest-VolumesGetTest-907870811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_j5rkqpm1devstack@QuobyteHD" returned: 0 in 0.459s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-9954f93d-6cf8-4f50-81f7-961b3af3d442 tempest-VolumesGetTest-907870811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:35:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-9954f93d-6cf8-4f50-81f7-961b3af3d442 tempest-VolumesGetTest-907870811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:35:56 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-9954f93d-6cf8-4f50-81f7-961b3af3d442 tempest-VolumesGetTest-907870811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:35:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-915281798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c14eb62-7ee5-4585-9382-ef1dbc171b2f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='22222170fcf741d7a736bc82b75e21f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:35:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:35:53Z,use_quota=True,user_id='39c2f1663cad426498e6fc266f9b70dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:35:56 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-9954f93d-6cf8-4f50-81f7-961b3af3d442 tempest-VolumesGetTest-907870811 None] Creating volume 7c14eb62-7ee5-4585-9382-ef1dbc171b2f {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:35:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-9954f93d-6cf8-4f50-81f7-961b3af3d442 tempest-VolumesGetTest-907870811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:35:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-9954f93d-6cf8-4f50-81f7-961b3af3d442 tempest-VolumesGetTest-907870811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:35:56 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-9954f93d-6cf8-4f50-81f7-961b3af3d442 tempest-VolumesGetTest-907870811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:35:56 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-9954f93d-6cf8-4f50-81f7-961b3af3d442 tempest-VolumesGetTest-907870811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:35:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-9954f93d-6cf8-4f50-81f7-961b3af3d442 tempest-VolumesGetTest-907870811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:35:56 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-9954f93d-6cf8-4f50-81f7-961b3af3d442 tempest-VolumesGetTest-907870811 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:35:56 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-9954f93d-6cf8-4f50-81f7-961b3af3d442 tempest-VolumesGetTest-907870811 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:35:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9954f93d-6cf8-4f50-81f7-961b3af3d442 tempest-VolumesGetTest-907870811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7c14eb62-7ee5-4585-9382-ef1dbc171b2f 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:56 devstack sudo[96266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7c14eb62-7ee5-4585-9382-ef1dbc171b2f 1073741824 Nov 03 07:35:56 devstack sudo[96266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:56 devstack sudo[96266]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9954f93d-6cf8-4f50-81f7-961b3af3d442 tempest-VolumesGetTest-907870811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7c14eb62-7ee5-4585-9382-ef1dbc171b2f 1073741824" returned: 0 in 0.568s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9954f93d-6cf8-4f50-81f7-961b3af3d442 tempest-VolumesGetTest-907870811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7c14eb62-7ee5-4585-9382-ef1dbc171b2f {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:56 devstack sudo[96271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7c14eb62-7ee5-4585-9382-ef1dbc171b2f Nov 03 07:35:56 devstack sudo[96271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:57 devstack sudo[96271]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9954f93d-6cf8-4f50-81f7-961b3af3d442 tempest-VolumesGetTest-907870811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7c14eb62-7ee5-4585-9382-ef1dbc171b2f" returned: 0 in 0.277s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:57 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-9954f93d-6cf8-4f50-81f7-961b3af3d442 tempest-VolumesGetTest-907870811 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:35:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-9954f93d-6cf8-4f50-81f7-961b3af3d442 tempest-VolumesGetTest-907870811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:35:57 devstack cinder-volume[86875]: DEBUG cinder.volume.volume_utils [None req-9954f93d-6cf8-4f50-81f7-961b3af3d442 tempest-VolumesGetTest-907870811 None] Attempting download of eb68a148-0c9c-4237-9d8d-94a6a7cd87d9 ((None, [{'url': 'file:///opt/stack/data/glance/images/eb68a148-0c9c-4237-9d8d-94a6a7cd87d9', 'metadata': {}}])) to volume 7c14eb62-7ee5-4585-9382-ef1dbc171b2f. {{(pid=86875) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 07:35:57 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[76449231-5743-419d-8825-7ff45014a200]: (4, 'raw') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:35:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9954f93d-6cf8-4f50-81f7-961b3af3d442 tempest-VolumesGetTest-907870811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_iafymtg1 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:57 devstack sudo[96274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_iafymtg1 Nov 03 07:35:57 devstack sudo[96274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:57 devstack sudo[96274]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9954f93d-6cf8-4f50-81f7-961b3af3d442 tempest-VolumesGetTest-907870811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_iafymtg1" returned: 0 in 0.426s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9954f93d-6cf8-4f50-81f7-961b3af3d442 tempest-VolumesGetTest-907870811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_iafymtg1 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:57 devstack sudo[96279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_iafymtg1 Nov 03 07:35:57 devstack sudo[96279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:57 devstack sudo[96279]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9954f93d-6cf8-4f50-81f7-961b3af3d442 tempest-VolumesGetTest-907870811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_iafymtg1" returned: 1 in 0.468s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9954f93d-6cf8-4f50-81f7-961b3af3d442 tempest-VolumesGetTest-907870811 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_iafymtg1' failed. Not Retrying. {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:35:58 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[3039781b-2fa5-4354-8915-3813329f0053]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:35:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9954f93d-6cf8-4f50-81f7-961b3af3d442 tempest-VolumesGetTest-907870811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_j5rkqpm1devstack@QuobyteHD {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:58 devstack sudo[96284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_j5rkqpm1devstack@QuobyteHD Nov 03 07:35:58 devstack sudo[96284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:35:58 devstack sudo[96284]: pam_unix(sudo:session): session closed for user root Nov 03 07:35:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9954f93d-6cf8-4f50-81f7-961b3af3d442 tempest-VolumesGetTest-907870811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_j5rkqpm1devstack@QuobyteHD" returned: 0 in 0.662s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:35:58 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-9954f93d-6cf8-4f50-81f7-961b3af3d442 tempest-VolumesGetTest-907870811 None] eb68a148-0c9c-4237-9d8d-94a6a7cd87d9 was qcow2, converting to qcow2 {{(pid=86875) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 07:35:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9954f93d-6cf8-4f50-81f7-961b3af3d442 tempest-VolumesGetTest-907870811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_j5rkqpm1devstack@QuobyteHD /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7c14eb62-7ee5-4585-9382-ef1dbc171b2f {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:35:58 devstack sudo[96302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_j5rkqpm1devstack@QuobyteHD /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7c14eb62-7ee5-4585-9382-ef1dbc171b2f Nov 03 07:35:58 devstack sudo[96302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:02 devstack sudo[96302]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9954f93d-6cf8-4f50-81f7-961b3af3d442 tempest-VolumesGetTest-907870811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_j5rkqpm1devstack@QuobyteHD /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7c14eb62-7ee5-4585-9382-ef1dbc171b2f" returned: 0 in 3.591s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:02 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-9954f93d-6cf8-4f50-81f7-961b3af3d442 tempest-VolumesGetTest-907870811 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_j5rkqpm1devstack@QuobyteHD, size 112.00 MB, duration 3.59 sec, destination /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7c14eb62-7ee5-4585-9382-ef1dbc171b2f {{(pid=86875) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:36:02 devstack cinder-volume[86875]: INFO cinder.image.image_utils [None req-9954f93d-6cf8-4f50-81f7-961b3af3d442 tempest-VolumesGetTest-907870811 None] Converted 112.00 MB image at 31.18 MB/s Nov 03 07:36:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9954f93d-6cf8-4f50-81f7-961b3af3d442 tempest-VolumesGetTest-907870811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7c14eb62-7ee5-4585-9382-ef1dbc171b2f 1G {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:02 devstack sudo[96415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7c14eb62-7ee5-4585-9382-ef1dbc171b2f 1G Nov 03 07:36:02 devstack sudo[96415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:02 devstack sudo[96415]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9954f93d-6cf8-4f50-81f7-961b3af3d442 tempest-VolumesGetTest-907870811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7c14eb62-7ee5-4585-9382-ef1dbc171b2f 1G" returned: 0 in 0.677s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:02 devstack cinder-volume[86875]: DEBUG cinder.volume.volume_utils [None req-9954f93d-6cf8-4f50-81f7-961b3af3d442 tempest-VolumesGetTest-907870811 None] Downloaded image eb68a148-0c9c-4237-9d8d-94a6a7cd87d9 ((None, [{'url': 'file:///opt/stack/data/glance/images/eb68a148-0c9c-4237-9d8d-94a6a7cd87d9', 'metadata': {}}])) to volume 7c14eb62-7ee5-4585-9382-ef1dbc171b2f successfully. {{(pid=86875) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 07:36:02 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-9954f93d-6cf8-4f50-81f7-961b3af3d442 tempest-VolumesGetTest-907870811 None] Temporary image eb68a148-0c9c-4237-9d8d-94a6a7cd87d9 for user 39c2f1663cad426498e6fc266f9b70dc is deleted. {{(pid=86875) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 07:36:02 devstack cinder-volume[86875]: DEBUG cinder.volume.volume_utils [None req-9954f93d-6cf8-4f50-81f7-961b3af3d442 tempest-VolumesGetTest-907870811 None] Marking volume 7c14eb62-7ee5-4585-9382-ef1dbc171b2f as bootable. {{(pid=86875) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 07:36:03 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-9954f93d-6cf8-4f50-81f7-961b3af3d442 tempest-VolumesGetTest-907870811 None] Copying metadata from image eb68a148-0c9c-4237-9d8d-94a6a7cd87d9 to 7c14eb62-7ee5-4585-9382-ef1dbc171b2f. {{(pid=86875) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 07:36:03 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-9954f93d-6cf8-4f50-81f7-961b3af3d442 tempest-VolumesGetTest-907870811 None] Creating volume glance metadata for volume 7c14eb62-7ee5-4585-9382-ef1dbc171b2f backed by image eb68a148-0c9c-4237-9d8d-94a6a7cd87d9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'eb68a148-0c9c-4237-9d8d-94a6a7cd87d9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86875) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 07:36:03 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-9954f93d-6cf8-4f50-81f7-961b3af3d442 tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e80ea0c-1605-4bb8-bd91-a7601c8ae9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c14eb62-7ee5-4585-9382-ef1dbc171b2f', 'volume_size': 1, 'image_id': 'eb68a148-0c9c-4237-9d8d-94a6a7cd87d9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eb68a148-0c9c-4237-9d8d-94a6a7cd87d9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c9ace38ee46b42979b3d4c79532bd66e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eb68a148-0c9c-4237-9d8d-94a6a7cd87d9', 'created_at': datetime.datetime(2026, 11, 3, 6, 21, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 21, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eb68a148-0c9c-4237-9d8d-94a6a7cd87d9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:03 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-9954f93d-6cf8-4f50-81f7-961b3af3d442 tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4b40989-fc19-47ad-bdb3-4d34df2376ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:03 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-9954f93d-6cf8-4f50-81f7-961b3af3d442 tempest-VolumesGetTest-907870811 None] Volume volume-7c14eb62-7ee5-4585-9382-ef1dbc171b2f (7c14eb62-7ee5-4585-9382-ef1dbc171b2f): created successfully Nov 03 07:36:03 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-9954f93d-6cf8-4f50-81f7-961b3af3d442 tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4b40989-fc19-47ad-bdb3-4d34df2376ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:03 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-9954f93d-6cf8-4f50-81f7-961b3af3d442 tempest-VolumesGetTest-907870811 None] Flow 'volume_create_manager' (754296d3-2332-4e79-a6e2-f11fc8d9eb2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:36:03 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-9954f93d-6cf8-4f50-81f7-961b3af3d442 tempest-VolumesGetTest-907870811 None] Created volume successfully. Nov 03 07:36:03 devstack cinder-volume[86875]: DEBUG oslo_service.periodic_task [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86875) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:36:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:36:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:36:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:36:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:36:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:36:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:03 devstack sudo[96423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:36:03 devstack sudo[96423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:04 devstack sudo[96423]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.651s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:04 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:36:04 devstack cinder-volume[86875]: DEBUG oslo_service.periodic_task [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running periodic task VolumeManager._thread_info {{(pid=86875) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:36:04 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] thread count: 28 {{(pid=86875) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:36:04 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] thread info: [<_MainThread(MainThread, started 125626325639296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86875) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:36:05 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a973bee-c2a2-4943-bfbb-620bfd4beb75 tempest-VolumesGetTest-907870811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:36:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0a973bee-c2a2-4943-bfbb-620bfd4beb75 tempest-VolumesGetTest-907870811 None] Flow 'volume_create_manager' (b052eeb3-f2f7-46c0-b3b4-35b91f8bbdb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:36:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0a973bee-c2a2-4943-bfbb-620bfd4beb75 tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3292ad9f-433e-4dc6-8641-92b53ad37a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0a973bee-c2a2-4943-bfbb-620bfd4beb75 tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3292ad9f-433e-4dc6-8641-92b53ad37a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:36:05Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1499661191',display_name='tempest-VolumesGetTest-Volume-989394109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a77409d4-d2fe-4bad-a369-39e8beabe78e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22222170fcf741d7a736bc82b75e21f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:36:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:36:06Z,use_quota=True,user_id='39c2f1663cad426498e6fc266f9b70dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0a973bee-c2a2-4943-bfbb-620bfd4beb75 tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2aecf5c-038e-4fca-8fd1-5edaf6f93a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0a973bee-c2a2-4943-bfbb-620bfd4beb75 tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2aecf5c-038e-4fca-8fd1-5edaf6f93a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0a973bee-c2a2-4943-bfbb-620bfd4beb75 tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c65d3e14-caa3-49bb-af9d-7a5879a93a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0a973bee-c2a2-4943-bfbb-620bfd4beb75 tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c65d3e14-caa3-49bb-af9d-7a5879a93a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a77409d4-d2fe-4bad-a369-39e8beabe78e', 'volume_name': 'volume-a77409d4-d2fe-4bad-a369-39e8beabe78e', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0a973bee-c2a2-4943-bfbb-620bfd4beb75 tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5827dd2b-49b7-42c0-9094-cd03a56bbf80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0a973bee-c2a2-4943-bfbb-620bfd4beb75 tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5827dd2b-49b7-42c0-9094-cd03a56bbf80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0a973bee-c2a2-4943-bfbb-620bfd4beb75 tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62bbfcce-c04d-4f1e-aab5-4af444227377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:06 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-0a973bee-c2a2-4943-bfbb-620bfd4beb75 tempest-VolumesGetTest-907870811 None] Volume a77409d4-d2fe-4bad-a369-39e8beabe78e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a77409d4-d2fe-4bad-a369-39e8beabe78e', 'volume_size': 1} Nov 03 07:36:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0a973bee-c2a2-4943-bfbb-620bfd4beb75 tempest-VolumesGetTest-907870811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:36:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0a973bee-c2a2-4943-bfbb-620bfd4beb75 tempest-VolumesGetTest-907870811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:36:06 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-0a973bee-c2a2-4943-bfbb-620bfd4beb75 tempest-VolumesGetTest-907870811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:36:05Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1499661191',display_name='tempest-VolumesGetTest-Volume-989394109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a77409d4-d2fe-4bad-a369-39e8beabe78e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22222170fcf741d7a736bc82b75e21f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:36:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:36:06Z,use_quota=True,user_id='39c2f1663cad426498e6fc266f9b70dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:36:06 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-0a973bee-c2a2-4943-bfbb-620bfd4beb75 tempest-VolumesGetTest-907870811 None] Creating volume a77409d4-d2fe-4bad-a369-39e8beabe78e {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:36:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0a973bee-c2a2-4943-bfbb-620bfd4beb75 tempest-VolumesGetTest-907870811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:36:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0a973bee-c2a2-4943-bfbb-620bfd4beb75 tempest-VolumesGetTest-907870811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:36:06 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-0a973bee-c2a2-4943-bfbb-620bfd4beb75 tempest-VolumesGetTest-907870811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:36:06 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-0a973bee-c2a2-4943-bfbb-620bfd4beb75 tempest-VolumesGetTest-907870811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:36:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0a973bee-c2a2-4943-bfbb-620bfd4beb75 tempest-VolumesGetTest-907870811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:36:06 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-0a973bee-c2a2-4943-bfbb-620bfd4beb75 tempest-VolumesGetTest-907870811 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:36:06 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-0a973bee-c2a2-4943-bfbb-620bfd4beb75 tempest-VolumesGetTest-907870811 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:36:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0a973bee-c2a2-4943-bfbb-620bfd4beb75 tempest-VolumesGetTest-907870811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a77409d4-d2fe-4bad-a369-39e8beabe78e 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:06 devstack sudo[96431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a77409d4-d2fe-4bad-a369-39e8beabe78e 1073741824 Nov 03 07:36:06 devstack sudo[96431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:06 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-266f7646-a193-4e28-9cde-b1283caa8742 tempest-AttachVolumeNegativeTest-376242003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:36:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-266f7646-a193-4e28-9cde-b1283caa8742 tempest-AttachVolumeNegativeTest-376242003 None] Flow 'volume_create_manager' (12a56100-a68a-49ea-9c50-7c4d9188aa8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:36:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-266f7646-a193-4e28-9cde-b1283caa8742 tempest-AttachVolumeNegativeTest-376242003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f34df780-e6a8-4259-b37f-1f98efc3638f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-266f7646-a193-4e28-9cde-b1283caa8742 tempest-AttachVolumeNegativeTest-376242003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f34df780-e6a8-4259-b37f-1f98efc3638f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:36:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-952906573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8233617-9f01-4aa5-afe5-08a0654c2e1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60564972953a439ba57e1761dfc75f41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:36:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:36:06Z,use_quota=True,user_id='822a51fff8714448872da499e2386447',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-266f7646-a193-4e28-9cde-b1283caa8742 tempest-AttachVolumeNegativeTest-376242003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df55f917-def3-4d2e-8400-8eafd8e7d501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-266f7646-a193-4e28-9cde-b1283caa8742 tempest-AttachVolumeNegativeTest-376242003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df55f917-def3-4d2e-8400-8eafd8e7d501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-266f7646-a193-4e28-9cde-b1283caa8742 tempest-AttachVolumeNegativeTest-376242003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (168495e2-7d16-46e7-93c1-9e7ff06d9220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-266f7646-a193-4e28-9cde-b1283caa8742 tempest-AttachVolumeNegativeTest-376242003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (168495e2-7d16-46e7-93c1-9e7ff06d9220) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8233617-9f01-4aa5-afe5-08a0654c2e1b', 'volume_name': 'volume-a8233617-9f01-4aa5-afe5-08a0654c2e1b', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-266f7646-a193-4e28-9cde-b1283caa8742 tempest-AttachVolumeNegativeTest-376242003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31867016-80db-4e25-91db-d1776cf98358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-266f7646-a193-4e28-9cde-b1283caa8742 tempest-AttachVolumeNegativeTest-376242003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31867016-80db-4e25-91db-d1776cf98358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-266f7646-a193-4e28-9cde-b1283caa8742 tempest-AttachVolumeNegativeTest-376242003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (531dcc70-98c3-467c-91bd-861ec851031f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:06 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-266f7646-a193-4e28-9cde-b1283caa8742 tempest-AttachVolumeNegativeTest-376242003 None] Volume a8233617-9f01-4aa5-afe5-08a0654c2e1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8233617-9f01-4aa5-afe5-08a0654c2e1b', 'volume_size': 1} Nov 03 07:36:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-266f7646-a193-4e28-9cde-b1283caa8742 tempest-AttachVolumeNegativeTest-376242003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:36:07 devstack sudo[96431]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0a973bee-c2a2-4943-bfbb-620bfd4beb75 tempest-VolumesGetTest-907870811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a77409d4-d2fe-4bad-a369-39e8beabe78e 1073741824" returned: 0 in 1.113s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0a973bee-c2a2-4943-bfbb-620bfd4beb75 tempest-VolumesGetTest-907870811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a77409d4-d2fe-4bad-a369-39e8beabe78e {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:07 devstack sudo[96438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a77409d4-d2fe-4bad-a369-39e8beabe78e Nov 03 07:36:07 devstack sudo[96438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:08 devstack sudo[96438]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0a973bee-c2a2-4943-bfbb-620bfd4beb75 tempest-VolumesGetTest-907870811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a77409d4-d2fe-4bad-a369-39e8beabe78e" returned: 0 in 0.785s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:08 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-0a973bee-c2a2-4943-bfbb-620bfd4beb75 tempest-VolumesGetTest-907870811 None] <== create_volume: return (2034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:36:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0a973bee-c2a2-4943-bfbb-620bfd4beb75 tempest-VolumesGetTest-907870811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.047s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:36:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-266f7646-a193-4e28-9cde-b1283caa8742 tempest-AttachVolumeNegativeTest-376242003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.628s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:36:08 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-266f7646-a193-4e28-9cde-b1283caa8742 tempest-AttachVolumeNegativeTest-376242003 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:36:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-952906573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8233617-9f01-4aa5-afe5-08a0654c2e1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60564972953a439ba57e1761dfc75f41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:36:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:36:06Z,use_quota=True,user_id='822a51fff8714448872da499e2386447',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:36:08 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-266f7646-a193-4e28-9cde-b1283caa8742 tempest-AttachVolumeNegativeTest-376242003 None] Creating volume a8233617-9f01-4aa5-afe5-08a0654c2e1b {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:36:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-266f7646-a193-4e28-9cde-b1283caa8742 tempest-AttachVolumeNegativeTest-376242003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:36:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-266f7646-a193-4e28-9cde-b1283caa8742 tempest-AttachVolumeNegativeTest-376242003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:36:08 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-266f7646-a193-4e28-9cde-b1283caa8742 tempest-AttachVolumeNegativeTest-376242003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:36:08 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-266f7646-a193-4e28-9cde-b1283caa8742 tempest-AttachVolumeNegativeTest-376242003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:36:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-266f7646-a193-4e28-9cde-b1283caa8742 tempest-AttachVolumeNegativeTest-376242003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:36:08 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-266f7646-a193-4e28-9cde-b1283caa8742 tempest-AttachVolumeNegativeTest-376242003 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:36:08 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-266f7646-a193-4e28-9cde-b1283caa8742 tempest-AttachVolumeNegativeTest-376242003 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:36:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-266f7646-a193-4e28-9cde-b1283caa8742 tempest-AttachVolumeNegativeTest-376242003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a8233617-9f01-4aa5-afe5-08a0654c2e1b 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:08 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0a973bee-c2a2-4943-bfbb-620bfd4beb75 tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62bbfcce-c04d-4f1e-aab5-4af444227377) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a77409d4-d2fe-4bad-a369-39e8beabe78e', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:08 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0a973bee-c2a2-4943-bfbb-620bfd4beb75 tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17a0520c-440b-4605-b6f9-4e488a85c6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:08 devstack sudo[96454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a8233617-9f01-4aa5-afe5-08a0654c2e1b 1073741824 Nov 03 07:36:08 devstack sudo[96454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:08 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-0a973bee-c2a2-4943-bfbb-620bfd4beb75 tempest-VolumesGetTest-907870811 None] Volume volume-a77409d4-d2fe-4bad-a369-39e8beabe78e (a77409d4-d2fe-4bad-a369-39e8beabe78e): created successfully Nov 03 07:36:08 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0a973bee-c2a2-4943-bfbb-620bfd4beb75 tempest-VolumesGetTest-907870811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17a0520c-440b-4605-b6f9-4e488a85c6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:08 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0a973bee-c2a2-4943-bfbb-620bfd4beb75 tempest-VolumesGetTest-907870811 None] Flow 'volume_create_manager' (b052eeb3-f2f7-46c0-b3b4-35b91f8bbdb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:36:08 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-0a973bee-c2a2-4943-bfbb-620bfd4beb75 tempest-VolumesGetTest-907870811 None] Created volume successfully. Nov 03 07:36:09 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-7a4e5173-4aa8-4533-8dfb-e9a10d542668 tempest-VolumesGetTest-907870811 None] Acquiring lock "cinder-a77409d4-d2fe-4bad-a369-39e8beabe78e-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:36:09 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-7a4e5173-4aa8-4533-8dfb-e9a10d542668 tempest-VolumesGetTest-907870811 None] Lock "cinder-a77409d4-d2fe-4bad-a369-39e8beabe78e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:36:09 devstack sudo[96454]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:09 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-7a4e5173-4aa8-4533-8dfb-e9a10d542668 tempest-VolumesGetTest-907870811 None] Acquiring lock "cinder-quobyte-a77409d4-d2fe-4bad-a369-39e8beabe78e" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:36:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-266f7646-a193-4e28-9cde-b1283caa8742 tempest-AttachVolumeNegativeTest-376242003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a8233617-9f01-4aa5-afe5-08a0654c2e1b 1073741824" returned: 0 in 1.225s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:09 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-7a4e5173-4aa8-4533-8dfb-e9a10d542668 tempest-VolumesGetTest-907870811 None] Lock "cinder-quobyte-a77409d4-d2fe-4bad-a369-39e8beabe78e" acquired by "delete_volume" :: waited 0.042s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:36:09 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[6110f0df-81a6-4d15-9fea-75ea30289d74]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:36:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7a4e5173-4aa8-4533-8dfb-e9a10d542668 tempest-VolumesGetTest-907870811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a77409d4-d2fe-4bad-a369-39e8beabe78e {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-266f7646-a193-4e28-9cde-b1283caa8742 tempest-AttachVolumeNegativeTest-376242003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a8233617-9f01-4aa5-afe5-08a0654c2e1b {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:09 devstack sudo[96462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a8233617-9f01-4aa5-afe5-08a0654c2e1b Nov 03 07:36:09 devstack sudo[96462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:09 devstack sudo[96461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a77409d4-d2fe-4bad-a369-39e8beabe78e Nov 03 07:36:09 devstack sudo[96461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:10 devstack sudo[96462]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-266f7646-a193-4e28-9cde-b1283caa8742 tempest-AttachVolumeNegativeTest-376242003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a8233617-9f01-4aa5-afe5-08a0654c2e1b" returned: 0 in 0.459s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:10 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-266f7646-a193-4e28-9cde-b1283caa8742 tempest-AttachVolumeNegativeTest-376242003 None] <== create_volume: return (1796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:36:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-266f7646-a193-4e28-9cde-b1283caa8742 tempest-AttachVolumeNegativeTest-376242003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.810s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:36:10 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-266f7646-a193-4e28-9cde-b1283caa8742 tempest-AttachVolumeNegativeTest-376242003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (531dcc70-98c3-467c-91bd-861ec851031f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8233617-9f01-4aa5-afe5-08a0654c2e1b', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:10 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-266f7646-a193-4e28-9cde-b1283caa8742 tempest-AttachVolumeNegativeTest-376242003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (635182e7-fda4-4663-aab2-0a589fd92a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:10 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-266f7646-a193-4e28-9cde-b1283caa8742 tempest-AttachVolumeNegativeTest-376242003 None] Volume volume-a8233617-9f01-4aa5-afe5-08a0654c2e1b (a8233617-9f01-4aa5-afe5-08a0654c2e1b): created successfully Nov 03 07:36:10 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-266f7646-a193-4e28-9cde-b1283caa8742 tempest-AttachVolumeNegativeTest-376242003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (635182e7-fda4-4663-aab2-0a589fd92a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:10 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-266f7646-a193-4e28-9cde-b1283caa8742 tempest-AttachVolumeNegativeTest-376242003 None] Flow 'volume_create_manager' (12a56100-a68a-49ea-9c50-7c4d9188aa8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:36:10 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-266f7646-a193-4e28-9cde-b1283caa8742 tempest-AttachVolumeNegativeTest-376242003 None] Created volume successfully. Nov 03 07:36:10 devstack sudo[96461]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7a4e5173-4aa8-4533-8dfb-e9a10d542668 tempest-VolumesGetTest-907870811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a77409d4-d2fe-4bad-a369-39e8beabe78e" returned: 0 in 0.757s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7a4e5173-4aa8-4533-8dfb-e9a10d542668 tempest-VolumesGetTest-907870811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a77409d4-d2fe-4bad-a369-39e8beabe78e {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:10 devstack sudo[96469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a77409d4-d2fe-4bad-a369-39e8beabe78e Nov 03 07:36:10 devstack sudo[96469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:10 devstack sudo[96469]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7a4e5173-4aa8-4533-8dfb-e9a10d542668 tempest-VolumesGetTest-907870811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a77409d4-d2fe-4bad-a369-39e8beabe78e" returned: 0 in 0.390s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:10 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-7a4e5173-4aa8-4533-8dfb-e9a10d542668 tempest-VolumesGetTest-907870811 None] Lock "cinder-quobyte-a77409d4-d2fe-4bad-a369-39e8beabe78e" released by "delete_volume" :: held 1.221s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:36:10 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-7a4e5173-4aa8-4533-8dfb-e9a10d542668 tempest-VolumesGetTest-907870811 None] Created reservations ['123edde2-37ff-49fb-83dc-a96df26fa10a', '24109c30-7e58-44e6-b052-e1e66a9f5bfa', '93a7d180-acb3-4a8c-b489-50cb255743da', '1f3699e3-40f3-4aa5-945f-81f921f1382d'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:36:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7a4e5173-4aa8-4533-8dfb-e9a10d542668 tempest-VolumesGetTest-907870811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:36:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7a4e5173-4aa8-4533-8dfb-e9a10d542668 tempest-VolumesGetTest-907870811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:36:11 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-7a4e5173-4aa8-4533-8dfb-e9a10d542668 tempest-VolumesGetTest-907870811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:36:11 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-7a4e5173-4aa8-4533-8dfb-e9a10d542668 tempest-VolumesGetTest-907870811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:36:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7a4e5173-4aa8-4533-8dfb-e9a10d542668 tempest-VolumesGetTest-907870811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:36:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7a4e5173-4aa8-4533-8dfb-e9a10d542668 tempest-VolumesGetTest-907870811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:11 devstack sudo[96475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:36:11 devstack sudo[96475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:11 devstack sudo[96475]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7a4e5173-4aa8-4533-8dfb-e9a10d542668 tempest-VolumesGetTest-907870811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.803s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:11 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-7a4e5173-4aa8-4533-8dfb-e9a10d542668 tempest-VolumesGetTest-907870811 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:36:11 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-7a4e5173-4aa8-4533-8dfb-e9a10d542668 tempest-VolumesGetTest-907870811 None] Deleted volume successfully. Nov 03 07:36:12 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-46b60bb7-0569-4059-943e-2b2282df354c tempest-VolumesGetTest-907870811 None] Acquiring lock "cinder-7c14eb62-7ee5-4585-9382-ef1dbc171b2f-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:36:12 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-7a4e5173-4aa8-4533-8dfb-e9a10d542668 tempest-VolumesGetTest-907870811 None] Lock "cinder-a77409d4-d2fe-4bad-a369-39e8beabe78e-delete_volume" released by "delete_volume" :: held 2.672s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:36:12 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-62ad41d4-8247-4d58-8a57-4c672cb03808 req-2387a4c7-317e-4000-b1d6-8b807e04ca1d tempest-AttachVolumeNegativeTest-376242003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:36:12 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-62ad41d4-8247-4d58-8a57-4c672cb03808 req-2387a4c7-317e-4000-b1d6-8b807e04ca1d tempest-AttachVolumeNegativeTest-376242003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.008s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:36:12 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-46b60bb7-0569-4059-943e-2b2282df354c tempest-VolumesGetTest-907870811 None] Lock "cinder-7c14eb62-7ee5-4585-9382-ef1dbc171b2f-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:36:12 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-62ad41d4-8247-4d58-8a57-4c672cb03808 req-2387a4c7-317e-4000-b1d6-8b807e04ca1d tempest-AttachVolumeNegativeTest-376242003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:36:12 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-46b60bb7-0569-4059-943e-2b2282df354c tempest-VolumesGetTest-907870811 None] Acquiring lock "cinder-quobyte-7c14eb62-7ee5-4585-9382-ef1dbc171b2f" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:36:12 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-62ad41d4-8247-4d58-8a57-4c672cb03808 req-2387a4c7-317e-4000-b1d6-8b807e04ca1d tempest-AttachVolumeNegativeTest-376242003 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1', 'name': 'volume-a8233617-9f01-4aa5-afe5-08a0654c2e1b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'db789e4b-c2ee-4c3e-be3b-3b9f2c063a73', 'enforce_multipath': True} {{(pid=86875) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:36:12 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-46b60bb7-0569-4059-943e-2b2282df354c tempest-VolumesGetTest-907870811 None] Lock "cinder-quobyte-7c14eb62-7ee5-4585-9382-ef1dbc171b2f" acquired by "delete_volume" :: waited 0.063s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:36:12 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb14a9b6-c216-4a32-abba-8610bdf4378a]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:36:12 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-46b60bb7-0569-4059-943e-2b2282df354c tempest-VolumesGetTest-907870811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7c14eb62-7ee5-4585-9382-ef1dbc171b2f {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:12 devstack cinder-volume[86875]: INFO cinder.volume.manager [req-62ad41d4-8247-4d58-8a57-4c672cb03808 req-2387a4c7-317e-4000-b1d6-8b807e04ca1d tempest-AttachVolumeNegativeTest-376242003 None] attachment_update completed successfully. Nov 03 07:36:12 devstack sudo[96488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7c14eb62-7ee5-4585-9382-ef1dbc171b2f Nov 03 07:36:12 devstack sudo[96488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:13 devstack sudo[96488]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-46b60bb7-0569-4059-943e-2b2282df354c tempest-VolumesGetTest-907870811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7c14eb62-7ee5-4585-9382-ef1dbc171b2f" returned: 0 in 1.210s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-46b60bb7-0569-4059-943e-2b2282df354c tempest-VolumesGetTest-907870811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7c14eb62-7ee5-4585-9382-ef1dbc171b2f {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:13 devstack sudo[96510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7c14eb62-7ee5-4585-9382-ef1dbc171b2f Nov 03 07:36:13 devstack sudo[96510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:14 devstack sudo[96510]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:14 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-46b60bb7-0569-4059-943e-2b2282df354c tempest-VolumesGetTest-907870811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7c14eb62-7ee5-4585-9382-ef1dbc171b2f" returned: 0 in 1.016s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:14 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-46b60bb7-0569-4059-943e-2b2282df354c tempest-VolumesGetTest-907870811 None] Lock "cinder-quobyte-7c14eb62-7ee5-4585-9382-ef1dbc171b2f" released by "delete_volume" :: held 2.381s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:36:14 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-46b60bb7-0569-4059-943e-2b2282df354c tempest-VolumesGetTest-907870811 None] Created reservations ['4ad5e146-5100-4c8d-899b-9e757c59aa0f', 'dc399c52-50e8-41e0-aca5-dae498a04539', 'c33bd1ff-68b5-484b-9854-22e26048588c', '0b65894a-114c-4233-8872-ad5d05526c02'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:36:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-46b60bb7-0569-4059-943e-2b2282df354c tempest-VolumesGetTest-907870811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:36:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-46b60bb7-0569-4059-943e-2b2282df354c tempest-VolumesGetTest-907870811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:36:15 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-46b60bb7-0569-4059-943e-2b2282df354c tempest-VolumesGetTest-907870811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:36:15 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-46b60bb7-0569-4059-943e-2b2282df354c tempest-VolumesGetTest-907870811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:36:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-46b60bb7-0569-4059-943e-2b2282df354c tempest-VolumesGetTest-907870811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:36:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-46b60bb7-0569-4059-943e-2b2282df354c tempest-VolumesGetTest-907870811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:15 devstack sudo[96540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:36:15 devstack sudo[96540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:15 devstack sudo[96540]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-46b60bb7-0569-4059-943e-2b2282df354c tempest-VolumesGetTest-907870811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.559s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:15 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-46b60bb7-0569-4059-943e-2b2282df354c tempest-VolumesGetTest-907870811 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:36:15 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-46b60bb7-0569-4059-943e-2b2282df354c tempest-VolumesGetTest-907870811 None] Deleted volume successfully. Nov 03 07:36:15 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-46b60bb7-0569-4059-943e-2b2282df354c tempest-VolumesGetTest-907870811 None] Lock "cinder-7c14eb62-7ee5-4585-9382-ef1dbc171b2f-delete_volume" released by "delete_volume" :: held 3.718s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:36:17 devstack cinder-volume[86875]: INFO cinder.volume.manager [req-3e54fee6-e74c-4080-90ee-ef790698a49c req-883cb2bc-7457-47cc-ad9a-0736878433fd tempest-AttachVolumeNegativeTest-376242003 None] Terminate volume connection completed successfully. Nov 03 07:36:17 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-3e54fee6-e74c-4080-90ee-ef790698a49c req-883cb2bc-7457-47cc-ad9a-0736878433fd tempest-AttachVolumeNegativeTest-376242003 None] Deleting attachment db789e4b-c2ee-4c3e-be3b-3b9f2c063a73. {{(pid=86875) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:36:24 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd9dd57e-f119-4ff3-89b2-3cc59f20128a tempest-ServersNegativeTestJSON-1740610352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:36:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fd9dd57e-f119-4ff3-89b2-3cc59f20128a tempest-ServersNegativeTestJSON-1740610352 None] Flow 'volume_create_manager' (4c9e0e36-89f4-4b0c-8a6d-cb292dc10f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:36:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fd9dd57e-f119-4ff3-89b2-3cc59f20128a tempest-ServersNegativeTestJSON-1740610352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c139c88b-45f1-4678-a9d0-b31a3c35b7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fd9dd57e-f119-4ff3-89b2-3cc59f20128a tempest-ServersNegativeTestJSON-1740610352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c139c88b-45f1-4678-a9d0-b31a3c35b7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1728182920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f5d74d6-70a7-4001-bff1-565cecfd512e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a649947de7f54ccd95060b717b9d1a2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:36:24Z,use_quota=True,user_id='71ca36b1f6ad42f292f52a4ffe1c934b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fd9dd57e-f119-4ff3-89b2-3cc59f20128a tempest-ServersNegativeTestJSON-1740610352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d2af723-f84b-4fd2-aa4d-6e386ab323d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fd9dd57e-f119-4ff3-89b2-3cc59f20128a tempest-ServersNegativeTestJSON-1740610352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d2af723-f84b-4fd2-aa4d-6e386ab323d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fd9dd57e-f119-4ff3-89b2-3cc59f20128a tempest-ServersNegativeTestJSON-1740610352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f664cbf3-6593-4bf1-8f76-cf92fe409828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fd9dd57e-f119-4ff3-89b2-3cc59f20128a tempest-ServersNegativeTestJSON-1740610352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f664cbf3-6593-4bf1-8f76-cf92fe409828) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f5d74d6-70a7-4001-bff1-565cecfd512e', 'volume_name': 'volume-6f5d74d6-70a7-4001-bff1-565cecfd512e', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fd9dd57e-f119-4ff3-89b2-3cc59f20128a tempest-ServersNegativeTestJSON-1740610352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (958fd11f-5fe5-4c48-b628-8026ffaa3454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fd9dd57e-f119-4ff3-89b2-3cc59f20128a tempest-ServersNegativeTestJSON-1740610352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (958fd11f-5fe5-4c48-b628-8026ffaa3454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fd9dd57e-f119-4ff3-89b2-3cc59f20128a tempest-ServersNegativeTestJSON-1740610352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67d081df-dfb3-4772-8e08-46dcc88a3252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:24 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-fd9dd57e-f119-4ff3-89b2-3cc59f20128a tempest-ServersNegativeTestJSON-1740610352 None] Volume 6f5d74d6-70a7-4001-bff1-565cecfd512e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f5d74d6-70a7-4001-bff1-565cecfd512e', 'volume_size': 1} Nov 03 07:36:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-fd9dd57e-f119-4ff3-89b2-3cc59f20128a tempest-ServersNegativeTestJSON-1740610352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:36:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-fd9dd57e-f119-4ff3-89b2-3cc59f20128a tempest-ServersNegativeTestJSON-1740610352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:36:24 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-fd9dd57e-f119-4ff3-89b2-3cc59f20128a tempest-ServersNegativeTestJSON-1740610352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1728182920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f5d74d6-70a7-4001-bff1-565cecfd512e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a649947de7f54ccd95060b717b9d1a2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:36:24Z,use_quota=True,user_id='71ca36b1f6ad42f292f52a4ffe1c934b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:36:24 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-fd9dd57e-f119-4ff3-89b2-3cc59f20128a tempest-ServersNegativeTestJSON-1740610352 None] Creating volume 6f5d74d6-70a7-4001-bff1-565cecfd512e {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:36:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-fd9dd57e-f119-4ff3-89b2-3cc59f20128a tempest-ServersNegativeTestJSON-1740610352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:36:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-fd9dd57e-f119-4ff3-89b2-3cc59f20128a tempest-ServersNegativeTestJSON-1740610352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:36:24 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-fd9dd57e-f119-4ff3-89b2-3cc59f20128a tempest-ServersNegativeTestJSON-1740610352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:36:24 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-fd9dd57e-f119-4ff3-89b2-3cc59f20128a tempest-ServersNegativeTestJSON-1740610352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:36:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-fd9dd57e-f119-4ff3-89b2-3cc59f20128a tempest-ServersNegativeTestJSON-1740610352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:36:24 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-fd9dd57e-f119-4ff3-89b2-3cc59f20128a tempest-ServersNegativeTestJSON-1740610352 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:36:24 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-fd9dd57e-f119-4ff3-89b2-3cc59f20128a tempest-ServersNegativeTestJSON-1740610352 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:36:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fd9dd57e-f119-4ff3-89b2-3cc59f20128a tempest-ServersNegativeTestJSON-1740610352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6f5d74d6-70a7-4001-bff1-565cecfd512e 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:24 devstack sudo[96676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6f5d74d6-70a7-4001-bff1-565cecfd512e 1073741824 Nov 03 07:36:24 devstack sudo[96676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:25 devstack sudo[96676]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fd9dd57e-f119-4ff3-89b2-3cc59f20128a tempest-ServersNegativeTestJSON-1740610352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6f5d74d6-70a7-4001-bff1-565cecfd512e 1073741824" returned: 0 in 0.622s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fd9dd57e-f119-4ff3-89b2-3cc59f20128a tempest-ServersNegativeTestJSON-1740610352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6f5d74d6-70a7-4001-bff1-565cecfd512e {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:25 devstack sudo[96682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6f5d74d6-70a7-4001-bff1-565cecfd512e Nov 03 07:36:25 devstack sudo[96682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:25 devstack sudo[96682]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fd9dd57e-f119-4ff3-89b2-3cc59f20128a tempest-ServersNegativeTestJSON-1740610352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6f5d74d6-70a7-4001-bff1-565cecfd512e" returned: 0 in 0.439s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:25 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-fd9dd57e-f119-4ff3-89b2-3cc59f20128a tempest-ServersNegativeTestJSON-1740610352 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:36:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-fd9dd57e-f119-4ff3-89b2-3cc59f20128a tempest-ServersNegativeTestJSON-1740610352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:36:25 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fd9dd57e-f119-4ff3-89b2-3cc59f20128a tempest-ServersNegativeTestJSON-1740610352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67d081df-dfb3-4772-8e08-46dcc88a3252) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f5d74d6-70a7-4001-bff1-565cecfd512e', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:25 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fd9dd57e-f119-4ff3-89b2-3cc59f20128a tempest-ServersNegativeTestJSON-1740610352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d636181-ecde-4446-addd-364224070dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:25 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-fd9dd57e-f119-4ff3-89b2-3cc59f20128a tempest-ServersNegativeTestJSON-1740610352 None] Volume volume-6f5d74d6-70a7-4001-bff1-565cecfd512e (6f5d74d6-70a7-4001-bff1-565cecfd512e): created successfully Nov 03 07:36:25 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fd9dd57e-f119-4ff3-89b2-3cc59f20128a tempest-ServersNegativeTestJSON-1740610352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d636181-ecde-4446-addd-364224070dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:25 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fd9dd57e-f119-4ff3-89b2-3cc59f20128a tempest-ServersNegativeTestJSON-1740610352 None] Flow 'volume_create_manager' (4c9e0e36-89f4-4b0c-8a6d-cb292dc10f46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:36:25 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-fd9dd57e-f119-4ff3-89b2-3cc59f20128a tempest-ServersNegativeTestJSON-1740610352 None] Created volume successfully. Nov 03 07:36:30 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-51fc319d-56ec-48dd-b0e8-22dfdacb4df8 tempest-ServersNegativeTestJSON-1740610352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:36:30 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-51fc319d-56ec-48dd-b0e8-22dfdacb4df8 tempest-ServersNegativeTestJSON-1740610352 None] Flow 'volume_create_manager' (57fee174-72f3-4d0a-a309-390b72140fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:36:30 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-51fc319d-56ec-48dd-b0e8-22dfdacb4df8 tempest-ServersNegativeTestJSON-1740610352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c0ef88b-c4c3-408d-9a5e-9fc7efd9edb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:30 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-51fc319d-56ec-48dd-b0e8-22dfdacb4df8 tempest-ServersNegativeTestJSON-1740610352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c0ef88b-c4c3-408d-9a5e-9fc7efd9edb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:36:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1763603774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4440dff7-5ff3-4279-9416-33e76c93f4aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a649947de7f54ccd95060b717b9d1a2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:36:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:36:30Z,use_quota=True,user_id='71ca36b1f6ad42f292f52a4ffe1c934b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:30 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-51fc319d-56ec-48dd-b0e8-22dfdacb4df8 tempest-ServersNegativeTestJSON-1740610352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bf77e82-e6ae-4a33-b9da-e247e8ae38c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:30 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-51fc319d-56ec-48dd-b0e8-22dfdacb4df8 tempest-ServersNegativeTestJSON-1740610352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bf77e82-e6ae-4a33-b9da-e247e8ae38c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:30 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-51fc319d-56ec-48dd-b0e8-22dfdacb4df8 tempest-ServersNegativeTestJSON-1740610352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (347ebceb-866b-4b6b-b53c-02a45e02ee01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:30 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-51fc319d-56ec-48dd-b0e8-22dfdacb4df8 tempest-ServersNegativeTestJSON-1740610352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (347ebceb-866b-4b6b-b53c-02a45e02ee01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4440dff7-5ff3-4279-9416-33e76c93f4aa', 'volume_name': 'volume-4440dff7-5ff3-4279-9416-33e76c93f4aa', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:30 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-51fc319d-56ec-48dd-b0e8-22dfdacb4df8 tempest-ServersNegativeTestJSON-1740610352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21d2c119-d0aa-4eae-b4ee-2daa9aa7920e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:30 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-51fc319d-56ec-48dd-b0e8-22dfdacb4df8 tempest-ServersNegativeTestJSON-1740610352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21d2c119-d0aa-4eae-b4ee-2daa9aa7920e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:30 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-51fc319d-56ec-48dd-b0e8-22dfdacb4df8 tempest-ServersNegativeTestJSON-1740610352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be4fe086-004e-4478-986c-2e4f14fd780b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:30 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-51fc319d-56ec-48dd-b0e8-22dfdacb4df8 tempest-ServersNegativeTestJSON-1740610352 None] Volume 4440dff7-5ff3-4279-9416-33e76c93f4aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4440dff7-5ff3-4279-9416-33e76c93f4aa', 'volume_size': 1} Nov 03 07:36:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-51fc319d-56ec-48dd-b0e8-22dfdacb4df8 tempest-ServersNegativeTestJSON-1740610352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:36:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-51fc319d-56ec-48dd-b0e8-22dfdacb4df8 tempest-ServersNegativeTestJSON-1740610352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:36:30 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-51fc319d-56ec-48dd-b0e8-22dfdacb4df8 tempest-ServersNegativeTestJSON-1740610352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:36:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1763603774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4440dff7-5ff3-4279-9416-33e76c93f4aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a649947de7f54ccd95060b717b9d1a2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:36:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:36:30Z,use_quota=True,user_id='71ca36b1f6ad42f292f52a4ffe1c934b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:36:30 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-51fc319d-56ec-48dd-b0e8-22dfdacb4df8 tempest-ServersNegativeTestJSON-1740610352 None] Creating volume 4440dff7-5ff3-4279-9416-33e76c93f4aa {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:36:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-51fc319d-56ec-48dd-b0e8-22dfdacb4df8 tempest-ServersNegativeTestJSON-1740610352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:36:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-51fc319d-56ec-48dd-b0e8-22dfdacb4df8 tempest-ServersNegativeTestJSON-1740610352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:36:30 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-51fc319d-56ec-48dd-b0e8-22dfdacb4df8 tempest-ServersNegativeTestJSON-1740610352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:36:30 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-51fc319d-56ec-48dd-b0e8-22dfdacb4df8 tempest-ServersNegativeTestJSON-1740610352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:36:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-51fc319d-56ec-48dd-b0e8-22dfdacb4df8 tempest-ServersNegativeTestJSON-1740610352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:36:30 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-51fc319d-56ec-48dd-b0e8-22dfdacb4df8 tempest-ServersNegativeTestJSON-1740610352 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:36:30 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-51fc319d-56ec-48dd-b0e8-22dfdacb4df8 tempest-ServersNegativeTestJSON-1740610352 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:36:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-51fc319d-56ec-48dd-b0e8-22dfdacb4df8 tempest-ServersNegativeTestJSON-1740610352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4440dff7-5ff3-4279-9416-33e76c93f4aa 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:30 devstack sudo[96689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4440dff7-5ff3-4279-9416-33e76c93f4aa 1073741824 Nov 03 07:36:30 devstack sudo[96689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:30 devstack sudo[96689]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-51fc319d-56ec-48dd-b0e8-22dfdacb4df8 tempest-ServersNegativeTestJSON-1740610352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4440dff7-5ff3-4279-9416-33e76c93f4aa 1073741824" returned: 0 in 0.663s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-51fc319d-56ec-48dd-b0e8-22dfdacb4df8 tempest-ServersNegativeTestJSON-1740610352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4440dff7-5ff3-4279-9416-33e76c93f4aa {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:31 devstack sudo[96694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4440dff7-5ff3-4279-9416-33e76c93f4aa Nov 03 07:36:31 devstack sudo[96694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:31 devstack sudo[96694]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-51fc319d-56ec-48dd-b0e8-22dfdacb4df8 tempest-ServersNegativeTestJSON-1740610352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4440dff7-5ff3-4279-9416-33e76c93f4aa" returned: 0 in 0.515s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:31 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-51fc319d-56ec-48dd-b0e8-22dfdacb4df8 tempest-ServersNegativeTestJSON-1740610352 None] <== create_volume: return (1243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:36:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-51fc319d-56ec-48dd-b0e8-22dfdacb4df8 tempest-ServersNegativeTestJSON-1740610352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.247s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:36:31 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-51fc319d-56ec-48dd-b0e8-22dfdacb4df8 tempest-ServersNegativeTestJSON-1740610352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be4fe086-004e-4478-986c-2e4f14fd780b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4440dff7-5ff3-4279-9416-33e76c93f4aa', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:31 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-51fc319d-56ec-48dd-b0e8-22dfdacb4df8 tempest-ServersNegativeTestJSON-1740610352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c6c0442-3e8c-4502-8d0a-9ae590a3439a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:31 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-51fc319d-56ec-48dd-b0e8-22dfdacb4df8 tempest-ServersNegativeTestJSON-1740610352 None] Volume volume-4440dff7-5ff3-4279-9416-33e76c93f4aa (4440dff7-5ff3-4279-9416-33e76c93f4aa): created successfully Nov 03 07:36:31 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-51fc319d-56ec-48dd-b0e8-22dfdacb4df8 tempest-ServersNegativeTestJSON-1740610352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c6c0442-3e8c-4502-8d0a-9ae590a3439a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:31 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-51fc319d-56ec-48dd-b0e8-22dfdacb4df8 tempest-ServersNegativeTestJSON-1740610352 None] Flow 'volume_create_manager' (57fee174-72f3-4d0a-a309-390b72140fdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:36:31 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-51fc319d-56ec-48dd-b0e8-22dfdacb4df8 tempest-ServersNegativeTestJSON-1740610352 None] Created volume successfully. Nov 03 07:36:33 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-0891e4d2-be49-4fbe-96e5-3aef0ae8074b tempest-ServersNegativeTestJSON-1740610352 None] Acquiring lock "cinder-4440dff7-5ff3-4279-9416-33e76c93f4aa-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:36:33 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-0891e4d2-be49-4fbe-96e5-3aef0ae8074b tempest-ServersNegativeTestJSON-1740610352 None] Lock "cinder-4440dff7-5ff3-4279-9416-33e76c93f4aa-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:36:33 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:UPDATE=60,cinder:SELECT=57,cinder:INSERT=23,cinder:DELETE=5 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:36:33 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:UPDATE=74,cinder:SELECT=62,cinder:DELETE=7,cinder:INSERT=17 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:36:33 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-0891e4d2-be49-4fbe-96e5-3aef0ae8074b tempest-ServersNegativeTestJSON-1740610352 None] Acquiring lock "cinder-quobyte-4440dff7-5ff3-4279-9416-33e76c93f4aa" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:36:33 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-0891e4d2-be49-4fbe-96e5-3aef0ae8074b tempest-ServersNegativeTestJSON-1740610352 None] Lock "cinder-quobyte-4440dff7-5ff3-4279-9416-33e76c93f4aa" acquired by "delete_volume" :: waited 0.026s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:36:33 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b797ed-2fa4-4887-8c64-42571826107e]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:36:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0891e4d2-be49-4fbe-96e5-3aef0ae8074b tempest-ServersNegativeTestJSON-1740610352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4440dff7-5ff3-4279-9416-33e76c93f4aa {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:33 devstack sudo[96734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4440dff7-5ff3-4279-9416-33e76c93f4aa Nov 03 07:36:33 devstack sudo[96734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:34 devstack sudo[96734]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0891e4d2-be49-4fbe-96e5-3aef0ae8074b tempest-ServersNegativeTestJSON-1740610352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4440dff7-5ff3-4279-9416-33e76c93f4aa" returned: 0 in 0.480s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0891e4d2-be49-4fbe-96e5-3aef0ae8074b tempest-ServersNegativeTestJSON-1740610352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4440dff7-5ff3-4279-9416-33e76c93f4aa {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:34 devstack sudo[96739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4440dff7-5ff3-4279-9416-33e76c93f4aa Nov 03 07:36:34 devstack sudo[96739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:34 devstack sudo[96739]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0891e4d2-be49-4fbe-96e5-3aef0ae8074b tempest-ServersNegativeTestJSON-1740610352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4440dff7-5ff3-4279-9416-33e76c93f4aa" returned: 0 in 0.319s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:34 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-0891e4d2-be49-4fbe-96e5-3aef0ae8074b tempest-ServersNegativeTestJSON-1740610352 None] Lock "cinder-quobyte-4440dff7-5ff3-4279-9416-33e76c93f4aa" released by "delete_volume" :: held 0.869s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:36:34 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-0891e4d2-be49-4fbe-96e5-3aef0ae8074b tempest-ServersNegativeTestJSON-1740610352 None] Created reservations ['899ee357-f42e-48d1-a2b5-6eafded25f28', '1ba666df-f2f0-43b7-a7b6-11ad9a331065', '0e24c95e-8be8-4d13-96b1-7164da1b6d3f', '56e1fbfc-2354-462e-9766-6674eb5848f8'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:36:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0891e4d2-be49-4fbe-96e5-3aef0ae8074b tempest-ServersNegativeTestJSON-1740610352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:36:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0891e4d2-be49-4fbe-96e5-3aef0ae8074b tempest-ServersNegativeTestJSON-1740610352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:36:34 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-0891e4d2-be49-4fbe-96e5-3aef0ae8074b tempest-ServersNegativeTestJSON-1740610352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:36:34 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-0891e4d2-be49-4fbe-96e5-3aef0ae8074b tempest-ServersNegativeTestJSON-1740610352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:36:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0891e4d2-be49-4fbe-96e5-3aef0ae8074b tempest-ServersNegativeTestJSON-1740610352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:36:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0891e4d2-be49-4fbe-96e5-3aef0ae8074b tempest-ServersNegativeTestJSON-1740610352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:34 devstack sudo[96743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:36:34 devstack sudo[96743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:34 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-bad2f8e4-a1a7-4fec-a1e7-dcbb4f508e70 tempest-ServersNegativeTestJSON-1740610352 None] Acquiring lock "cinder-6f5d74d6-70a7-4001-bff1-565cecfd512e-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:36:34 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-bad2f8e4-a1a7-4fec-a1e7-dcbb4f508e70 tempest-ServersNegativeTestJSON-1740610352 None] Lock "cinder-6f5d74d6-70a7-4001-bff1-565cecfd512e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:36:34 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-bad2f8e4-a1a7-4fec-a1e7-dcbb4f508e70 tempest-ServersNegativeTestJSON-1740610352 None] Acquiring lock "cinder-quobyte-6f5d74d6-70a7-4001-bff1-565cecfd512e" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:36:34 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-bad2f8e4-a1a7-4fec-a1e7-dcbb4f508e70 tempest-ServersNegativeTestJSON-1740610352 None] Lock "cinder-quobyte-6f5d74d6-70a7-4001-bff1-565cecfd512e" acquired by "delete_volume" :: waited 0.020s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:36:34 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[686f4dd5-5035-4808-a222-9c0972230960]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:36:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-bad2f8e4-a1a7-4fec-a1e7-dcbb4f508e70 tempest-ServersNegativeTestJSON-1740610352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6f5d74d6-70a7-4001-bff1-565cecfd512e {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:34 devstack sudo[96745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6f5d74d6-70a7-4001-bff1-565cecfd512e Nov 03 07:36:34 devstack sudo[96745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:34 devstack sudo[96743]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0891e4d2-be49-4fbe-96e5-3aef0ae8074b tempest-ServersNegativeTestJSON-1740610352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.394s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:34 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-0891e4d2-be49-4fbe-96e5-3aef0ae8074b tempest-ServersNegativeTestJSON-1740610352 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:36:34 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-0891e4d2-be49-4fbe-96e5-3aef0ae8074b tempest-ServersNegativeTestJSON-1740610352 None] Deleted volume successfully. Nov 03 07:36:35 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-0891e4d2-be49-4fbe-96e5-3aef0ae8074b tempest-ServersNegativeTestJSON-1740610352 None] Lock "cinder-4440dff7-5ff3-4279-9416-33e76c93f4aa-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:36:35 devstack sudo[96745]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-bad2f8e4-a1a7-4fec-a1e7-dcbb4f508e70 tempest-ServersNegativeTestJSON-1740610352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6f5d74d6-70a7-4001-bff1-565cecfd512e" returned: 0 in 0.609s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-bad2f8e4-a1a7-4fec-a1e7-dcbb4f508e70 tempest-ServersNegativeTestJSON-1740610352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6f5d74d6-70a7-4001-bff1-565cecfd512e {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:35 devstack sudo[96751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6f5d74d6-70a7-4001-bff1-565cecfd512e Nov 03 07:36:35 devstack sudo[96751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:35 devstack sudo[96751]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-bad2f8e4-a1a7-4fec-a1e7-dcbb4f508e70 tempest-ServersNegativeTestJSON-1740610352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6f5d74d6-70a7-4001-bff1-565cecfd512e" returned: 0 in 0.348s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:35 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-bad2f8e4-a1a7-4fec-a1e7-dcbb4f508e70 tempest-ServersNegativeTestJSON-1740610352 None] Lock "cinder-quobyte-6f5d74d6-70a7-4001-bff1-565cecfd512e" released by "delete_volume" :: held 1.031s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:36:35 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-bad2f8e4-a1a7-4fec-a1e7-dcbb4f508e70 tempest-ServersNegativeTestJSON-1740610352 None] Created reservations ['2d454b23-7c6c-4ee3-b113-7c0435768c5e', 'f8a0b822-59b7-4728-9163-4b51958b4970', '01cd9b94-205d-48ae-894c-ab1d9c37ab3d', '2a62eafd-fe20-4697-8f85-270c57ad2b13'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:36:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-bad2f8e4-a1a7-4fec-a1e7-dcbb4f508e70 tempest-ServersNegativeTestJSON-1740610352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:36:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-bad2f8e4-a1a7-4fec-a1e7-dcbb4f508e70 tempest-ServersNegativeTestJSON-1740610352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:36:35 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-bad2f8e4-a1a7-4fec-a1e7-dcbb4f508e70 tempest-ServersNegativeTestJSON-1740610352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:36:35 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-bad2f8e4-a1a7-4fec-a1e7-dcbb4f508e70 tempest-ServersNegativeTestJSON-1740610352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:36:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-bad2f8e4-a1a7-4fec-a1e7-dcbb4f508e70 tempest-ServersNegativeTestJSON-1740610352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:36:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-bad2f8e4-a1a7-4fec-a1e7-dcbb4f508e70 tempest-ServersNegativeTestJSON-1740610352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:35 devstack sudo[96754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:36:35 devstack sudo[96754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:36 devstack sudo[96754]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:36 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-bad2f8e4-a1a7-4fec-a1e7-dcbb4f508e70 tempest-ServersNegativeTestJSON-1740610352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.303s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:36 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-bad2f8e4-a1a7-4fec-a1e7-dcbb4f508e70 tempest-ServersNegativeTestJSON-1740610352 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:36:36 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-bad2f8e4-a1a7-4fec-a1e7-dcbb4f508e70 tempest-ServersNegativeTestJSON-1740610352 None] Deleted volume successfully. Nov 03 07:36:36 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-bad2f8e4-a1a7-4fec-a1e7-dcbb4f508e70 tempest-ServersNegativeTestJSON-1740610352 None] Lock "cinder-6f5d74d6-70a7-4001-bff1-565cecfd512e-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:36:40 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-95159e8d-8021-4542-8ee3-048d5b9ee420 tempest-VolumesSnapshotTestJSON-1431891046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:36:40 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-95159e8d-8021-4542-8ee3-048d5b9ee420 tempest-VolumesSnapshotTestJSON-1431891046 None] Flow 'volume_create_manager' (e1c0f87a-046a-48ad-a388-d0745bc285cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:36:40 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-95159e8d-8021-4542-8ee3-048d5b9ee420 tempest-VolumesSnapshotTestJSON-1431891046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4401ed31-a73b-42f5-8f55-55c2bf7bdc6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:40 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-95159e8d-8021-4542-8ee3-048d5b9ee420 tempest-VolumesSnapshotTestJSON-1431891046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4401ed31-a73b-42f5-8f55-55c2bf7bdc6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1492939282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72425850-6981-4edc-b5b8-9b0b46417a12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb83551fe0a4f9d86ec8819326c943b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:36:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:36:40Z,use_quota=True,user_id='2e03928097b24a51b19fc04bea3933bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:40 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-95159e8d-8021-4542-8ee3-048d5b9ee420 tempest-VolumesSnapshotTestJSON-1431891046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (027cdbb9-632d-409b-bdc8-7f5b9ddacc1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:40 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-95159e8d-8021-4542-8ee3-048d5b9ee420 tempest-VolumesSnapshotTestJSON-1431891046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (027cdbb9-632d-409b-bdc8-7f5b9ddacc1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:40 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-95159e8d-8021-4542-8ee3-048d5b9ee420 tempest-VolumesSnapshotTestJSON-1431891046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eedd4eb8-61a6-43a9-8cec-2a47418bab84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:40 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-95159e8d-8021-4542-8ee3-048d5b9ee420 tempest-VolumesSnapshotTestJSON-1431891046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eedd4eb8-61a6-43a9-8cec-2a47418bab84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72425850-6981-4edc-b5b8-9b0b46417a12', 'volume_name': 'volume-72425850-6981-4edc-b5b8-9b0b46417a12', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:40 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-95159e8d-8021-4542-8ee3-048d5b9ee420 tempest-VolumesSnapshotTestJSON-1431891046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a288585-3e2b-4a1e-a469-ec3d89581e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:40 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-95159e8d-8021-4542-8ee3-048d5b9ee420 tempest-VolumesSnapshotTestJSON-1431891046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a288585-3e2b-4a1e-a469-ec3d89581e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:40 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-95159e8d-8021-4542-8ee3-048d5b9ee420 tempest-VolumesSnapshotTestJSON-1431891046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a54a9ce-92d8-4d76-aa47-88ea6518cd3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:40 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-95159e8d-8021-4542-8ee3-048d5b9ee420 tempest-VolumesSnapshotTestJSON-1431891046 None] Volume 72425850-6981-4edc-b5b8-9b0b46417a12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72425850-6981-4edc-b5b8-9b0b46417a12', 'volume_size': 1} Nov 03 07:36:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-95159e8d-8021-4542-8ee3-048d5b9ee420 tempest-VolumesSnapshotTestJSON-1431891046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:36:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-95159e8d-8021-4542-8ee3-048d5b9ee420 tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:36:40 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-95159e8d-8021-4542-8ee3-048d5b9ee420 tempest-VolumesSnapshotTestJSON-1431891046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1492939282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72425850-6981-4edc-b5b8-9b0b46417a12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb83551fe0a4f9d86ec8819326c943b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:36:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:36:40Z,use_quota=True,user_id='2e03928097b24a51b19fc04bea3933bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:36:40 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-95159e8d-8021-4542-8ee3-048d5b9ee420 tempest-VolumesSnapshotTestJSON-1431891046 None] Creating volume 72425850-6981-4edc-b5b8-9b0b46417a12 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:36:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-95159e8d-8021-4542-8ee3-048d5b9ee420 tempest-VolumesSnapshotTestJSON-1431891046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:36:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-95159e8d-8021-4542-8ee3-048d5b9ee420 tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:36:40 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-95159e8d-8021-4542-8ee3-048d5b9ee420 tempest-VolumesSnapshotTestJSON-1431891046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:36:40 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-95159e8d-8021-4542-8ee3-048d5b9ee420 tempest-VolumesSnapshotTestJSON-1431891046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:36:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-95159e8d-8021-4542-8ee3-048d5b9ee420 tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:36:40 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-95159e8d-8021-4542-8ee3-048d5b9ee420 tempest-VolumesSnapshotTestJSON-1431891046 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:36:40 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-95159e8d-8021-4542-8ee3-048d5b9ee420 tempest-VolumesSnapshotTestJSON-1431891046 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:36:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-95159e8d-8021-4542-8ee3-048d5b9ee420 tempest-VolumesSnapshotTestJSON-1431891046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72425850-6981-4edc-b5b8-9b0b46417a12 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:40 devstack sudo[96849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72425850-6981-4edc-b5b8-9b0b46417a12 1073741824 Nov 03 07:36:40 devstack sudo[96849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:41 devstack sudo[96849]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-95159e8d-8021-4542-8ee3-048d5b9ee420 tempest-VolumesSnapshotTestJSON-1431891046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72425850-6981-4edc-b5b8-9b0b46417a12 1073741824" returned: 0 in 0.732s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-95159e8d-8021-4542-8ee3-048d5b9ee420 tempest-VolumesSnapshotTestJSON-1431891046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72425850-6981-4edc-b5b8-9b0b46417a12 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:41 devstack sudo[96855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72425850-6981-4edc-b5b8-9b0b46417a12 Nov 03 07:36:41 devstack sudo[96855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:41 devstack sudo[96855]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-95159e8d-8021-4542-8ee3-048d5b9ee420 tempest-VolumesSnapshotTestJSON-1431891046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72425850-6981-4edc-b5b8-9b0b46417a12" returned: 0 in 0.271s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:41 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-95159e8d-8021-4542-8ee3-048d5b9ee420 tempest-VolumesSnapshotTestJSON-1431891046 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:36:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-95159e8d-8021-4542-8ee3-048d5b9ee420 tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:36:41 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-95159e8d-8021-4542-8ee3-048d5b9ee420 tempest-VolumesSnapshotTestJSON-1431891046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a54a9ce-92d8-4d76-aa47-88ea6518cd3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72425850-6981-4edc-b5b8-9b0b46417a12', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:41 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-95159e8d-8021-4542-8ee3-048d5b9ee420 tempest-VolumesSnapshotTestJSON-1431891046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a96e8d8-716b-4dad-ab79-ac65f9567915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:41 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-95159e8d-8021-4542-8ee3-048d5b9ee420 tempest-VolumesSnapshotTestJSON-1431891046 None] Volume volume-72425850-6981-4edc-b5b8-9b0b46417a12 (72425850-6981-4edc-b5b8-9b0b46417a12): created successfully Nov 03 07:36:41 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-95159e8d-8021-4542-8ee3-048d5b9ee420 tempest-VolumesSnapshotTestJSON-1431891046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a96e8d8-716b-4dad-ab79-ac65f9567915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:41 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-95159e8d-8021-4542-8ee3-048d5b9ee420 tempest-VolumesSnapshotTestJSON-1431891046 None] Flow 'volume_create_manager' (e1c0f87a-046a-48ad-a388-d0745bc285cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:36:41 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-95159e8d-8021-4542-8ee3-048d5b9ee420 tempest-VolumesSnapshotTestJSON-1431891046 None] Created volume successfully. Nov 03 07:36:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-d8268c29-95e9-4c15-bda8-2f875d3501ad tempest-VolumesSnapshotTestJSON-1431891046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:36:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-d8268c29-95e9-4c15-bda8-2f875d3501ad tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:36:42 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-d8268c29-95e9-4c15-bda8-2f875d3501ad tempest-VolumesSnapshotTestJSON-1431891046 None] Creating offline snapshot 66529b38-41f8-41a6-9440-521563799ece of volume 72425850-6981-4edc-b5b8-9b0b46417a12 {{(pid=86875) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:36:42 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f9a233-a3f8-4469-9ae9-1f422794a84f]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:36:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d8268c29-95e9-4c15-bda8-2f875d3501ad tempest-VolumesSnapshotTestJSON-1431891046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72425850-6981-4edc-b5b8-9b0b46417a12 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:43 devstack sudo[96864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72425850-6981-4edc-b5b8-9b0b46417a12 Nov 03 07:36:43 devstack sudo[96864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:43 devstack sudo[96864]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:43 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d8268c29-95e9-4c15-bda8-2f875d3501ad tempest-VolumesSnapshotTestJSON-1431891046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72425850-6981-4edc-b5b8-9b0b46417a12" returned: 0 in 0.690s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:43 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d8268c29-95e9-4c15-bda8-2f875d3501ad tempest-VolumesSnapshotTestJSON-1431891046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72425850-6981-4edc-b5b8-9b0b46417a12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72425850-6981-4edc-b5b8-9b0b46417a12.66529b38-41f8-41a6-9440-521563799ece 1G {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:43 devstack sudo[96869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72425850-6981-4edc-b5b8-9b0b46417a12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72425850-6981-4edc-b5b8-9b0b46417a12.66529b38-41f8-41a6-9440-521563799ece 1G Nov 03 07:36:43 devstack sudo[96869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:44 devstack sudo[96869]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d8268c29-95e9-4c15-bda8-2f875d3501ad tempest-VolumesSnapshotTestJSON-1431891046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72425850-6981-4edc-b5b8-9b0b46417a12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72425850-6981-4edc-b5b8-9b0b46417a12.66529b38-41f8-41a6-9440-521563799ece 1G" returned: 0 in 0.811s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d8268c29-95e9-4c15-bda8-2f875d3501ad tempest-VolumesSnapshotTestJSON-1431891046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72425850-6981-4edc-b5b8-9b0b46417a12 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72425850-6981-4edc-b5b8-9b0b46417a12.66529b38-41f8-41a6-9440-521563799ece {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:44 devstack sudo[96876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72425850-6981-4edc-b5b8-9b0b46417a12 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72425850-6981-4edc-b5b8-9b0b46417a12.66529b38-41f8-41a6-9440-521563799ece Nov 03 07:36:44 devstack sudo[96876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:45 devstack sudo[96876]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d8268c29-95e9-4c15-bda8-2f875d3501ad tempest-VolumesSnapshotTestJSON-1431891046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72425850-6981-4edc-b5b8-9b0b46417a12 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72425850-6981-4edc-b5b8-9b0b46417a12.66529b38-41f8-41a6-9440-521563799ece" returned: 0 in 0.603s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:45 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-d8268c29-95e9-4c15-bda8-2f875d3501ad tempest-VolumesSnapshotTestJSON-1431891046 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72425850-6981-4edc-b5b8-9b0b46417a12.66529b38-41f8-41a6-9440-521563799ece is being set with open permissions: ugo+rw Nov 03 07:36:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d8268c29-95e9-4c15-bda8-2f875d3501ad tempest-VolumesSnapshotTestJSON-1431891046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72425850-6981-4edc-b5b8-9b0b46417a12.66529b38-41f8-41a6-9440-521563799ece {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:45 devstack sudo[96882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72425850-6981-4edc-b5b8-9b0b46417a12.66529b38-41f8-41a6-9440-521563799ece Nov 03 07:36:45 devstack sudo[96882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:45 devstack sudo[96882]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d8268c29-95e9-4c15-bda8-2f875d3501ad tempest-VolumesSnapshotTestJSON-1431891046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72425850-6981-4edc-b5b8-9b0b46417a12.66529b38-41f8-41a6-9440-521563799ece" returned: 0 in 0.374s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d8268c29-95e9-4c15-bda8-2f875d3501ad tempest-VolumesSnapshotTestJSON-1431891046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72425850-6981-4edc-b5b8-9b0b46417a12.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:45 devstack sudo[96885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72425850-6981-4edc-b5b8-9b0b46417a12.info Nov 03 07:36:45 devstack sudo[96885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:45 devstack sudo[96885]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d8268c29-95e9-4c15-bda8-2f875d3501ad tempest-VolumesSnapshotTestJSON-1431891046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72425850-6981-4edc-b5b8-9b0b46417a12.info" returned: 0 in 0.456s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:45 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-d8268c29-95e9-4c15-bda8-2f875d3501ad tempest-VolumesSnapshotTestJSON-1431891046 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72425850-6981-4edc-b5b8-9b0b46417a12.info is being set with open permissions: ugo+rw Nov 03 07:36:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d8268c29-95e9-4c15-bda8-2f875d3501ad tempest-VolumesSnapshotTestJSON-1431891046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72425850-6981-4edc-b5b8-9b0b46417a12.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:45 devstack sudo[96891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72425850-6981-4edc-b5b8-9b0b46417a12.info Nov 03 07:36:45 devstack sudo[96891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:46 devstack sudo[96891]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d8268c29-95e9-4c15-bda8-2f875d3501ad tempest-VolumesSnapshotTestJSON-1431891046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72425850-6981-4edc-b5b8-9b0b46417a12.info" returned: 0 in 0.569s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-d8268c29-95e9-4c15-bda8-2f875d3501ad tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.716s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:36:46 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-d8268c29-95e9-4c15-bda8-2f875d3501ad tempest-VolumesSnapshotTestJSON-1431891046 None] Create snapshot completed successfully Nov 03 07:36:47 devstack cinder-volume[86875]: INFO cinder.volume.manager [req-5283f1f5-546d-40ca-9deb-88d30e4a4b52 req-0b6592a7-d459-4c5d-aaf3-e1813291adc0 tempest-TestMinimumBasicScenario-1160398710 None] Terminate volume connection completed successfully. Nov 03 07:36:47 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-5283f1f5-546d-40ca-9deb-88d30e4a4b52 req-0b6592a7-d459-4c5d-aaf3-e1813291adc0 tempest-TestMinimumBasicScenario-1160398710 None] Deleting attachment 32769fd5-d407-489c-ad14-ab5118c76212. {{(pid=86875) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:36:47 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-0ae2ca18-584c-41a7-b216-61f713363a85 tempest-VolumesSnapshotTestJSON-1431891046 None] Acquiring lock "cinder-66529b38-41f8-41a6-9440-521563799ece-delete_snapshot" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:36:47 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-0ae2ca18-584c-41a7-b216-61f713363a85 tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "cinder-66529b38-41f8-41a6-9440-521563799ece-delete_snapshot" acquired by "delete_snapshot" :: waited 0.065s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:36:47 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-0ae2ca18-584c-41a7-b216-61f713363a85 tempest-VolumesSnapshotTestJSON-1431891046 None] Acquiring lock "cinder-quobyte-72425850-6981-4edc-b5b8-9b0b46417a12" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:36:47 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-0ae2ca18-584c-41a7-b216-61f713363a85 tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "cinder-quobyte-72425850-6981-4edc-b5b8-9b0b46417a12" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:36:47 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-0ae2ca18-584c-41a7-b216-61f713363a85 tempest-VolumesSnapshotTestJSON-1431891046 None] Acquiring lock "cinder-quobyte-66529b38-41f8-41a6-9440-521563799ece" by "_delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:36:47 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-0ae2ca18-584c-41a7-b216-61f713363a85 tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "cinder-quobyte-66529b38-41f8-41a6-9440-521563799ece" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:36:47 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-0ae2ca18-584c-41a7-b216-61f713363a85 tempest-VolumesSnapshotTestJSON-1431891046 None] Deleting offline snapshot 66529b38-41f8-41a6-9440-521563799ece of volume 72425850-6981-4edc-b5b8-9b0b46417a12 {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:36:47 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-0ae2ca18-584c-41a7-b216-61f713363a85 tempest-VolumesSnapshotTestJSON-1431891046 None] snapshot_file for this snap is: volume-72425850-6981-4edc-b5b8-9b0b46417a12.66529b38-41f8-41a6-9440-521563799ece {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:36:47 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25d69e3-fab7-44d4-af9d-d0847a89eff8]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:36:47 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0ae2ca18-584c-41a7-b216-61f713363a85 tempest-VolumesSnapshotTestJSON-1431891046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72425850-6981-4edc-b5b8-9b0b46417a12.66529b38-41f8-41a6-9440-521563799ece {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:47 devstack sudo[96898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72425850-6981-4edc-b5b8-9b0b46417a12.66529b38-41f8-41a6-9440-521563799ece Nov 03 07:36:47 devstack sudo[96898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:48 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-52c3f012-3f14-424c-ae21-aa2093db8879 tempest-TestMinimumBasicScenario-1160398710 None] Acquiring lock "cinder-9bd6ffd3-c633-40e4-9b14-76840174c32b-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:36:48 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-52c3f012-3f14-424c-ae21-aa2093db8879 tempest-TestMinimumBasicScenario-1160398710 None] Lock "cinder-9bd6ffd3-c633-40e4-9b14-76840174c32b-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:36:48 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-52c3f012-3f14-424c-ae21-aa2093db8879 tempest-TestMinimumBasicScenario-1160398710 None] Acquiring lock "cinder-quobyte-9bd6ffd3-c633-40e4-9b14-76840174c32b" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:36:48 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-52c3f012-3f14-424c-ae21-aa2093db8879 tempest-TestMinimumBasicScenario-1160398710 None] Lock "cinder-quobyte-9bd6ffd3-c633-40e4-9b14-76840174c32b" acquired by "delete_volume" :: waited 0.034s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:36:48 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a40d7db-4abf-4eb0-a44f-edd4a1c36e43]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:36:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-52c3f012-3f14-424c-ae21-aa2093db8879 tempest-TestMinimumBasicScenario-1160398710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9bd6ffd3-c633-40e4-9b14-76840174c32b {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:48 devstack sudo[96901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9bd6ffd3-c633-40e4-9b14-76840174c32b Nov 03 07:36:48 devstack sudo[96901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:48 devstack sudo[96898]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0ae2ca18-584c-41a7-b216-61f713363a85 tempest-VolumesSnapshotTestJSON-1431891046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72425850-6981-4edc-b5b8-9b0b46417a12.66529b38-41f8-41a6-9440-521563799ece" returned: 0 in 0.946s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:48 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-0ae2ca18-584c-41a7-b216-61f713363a85 tempest-VolumesSnapshotTestJSON-1431891046 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72425850-6981-4edc-b5b8-9b0b46417a12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:36:48 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbe4d4f-be79-4b04-b0e7-6517d25f4c3d]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:36:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0ae2ca18-584c-41a7-b216-61f713363a85 tempest-VolumesSnapshotTestJSON-1431891046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72425850-6981-4edc-b5b8-9b0b46417a12 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:48 devstack sudo[96906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72425850-6981-4edc-b5b8-9b0b46417a12 Nov 03 07:36:48 devstack sudo[96906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:49 devstack sudo[96901]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-52c3f012-3f14-424c-ae21-aa2093db8879 tempest-TestMinimumBasicScenario-1160398710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9bd6ffd3-c633-40e4-9b14-76840174c32b" returned: 0 in 0.745s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-52c3f012-3f14-424c-ae21-aa2093db8879 tempest-TestMinimumBasicScenario-1160398710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9bd6ffd3-c633-40e4-9b14-76840174c32b {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:49 devstack sudo[96912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9bd6ffd3-c633-40e4-9b14-76840174c32b Nov 03 07:36:49 devstack sudo[96912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:49 devstack sudo[96906]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0ae2ca18-584c-41a7-b216-61f713363a85 tempest-VolumesSnapshotTestJSON-1431891046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72425850-6981-4edc-b5b8-9b0b46417a12" returned: 0 in 0.721s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0ae2ca18-584c-41a7-b216-61f713363a85 tempest-VolumesSnapshotTestJSON-1431891046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72425850-6981-4edc-b5b8-9b0b46417a12.66529b38-41f8-41a6-9440-521563799ece {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:49 devstack sudo[96917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72425850-6981-4edc-b5b8-9b0b46417a12.66529b38-41f8-41a6-9440-521563799ece Nov 03 07:36:49 devstack sudo[96917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:49 devstack sudo[96912]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-52c3f012-3f14-424c-ae21-aa2093db8879 tempest-TestMinimumBasicScenario-1160398710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9bd6ffd3-c633-40e4-9b14-76840174c32b" returned: 0 in 0.522s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:49 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-52c3f012-3f14-424c-ae21-aa2093db8879 tempest-TestMinimumBasicScenario-1160398710 None] Lock "cinder-quobyte-9bd6ffd3-c633-40e4-9b14-76840174c32b" released by "delete_volume" :: held 1.374s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:36:49 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-52c3f012-3f14-424c-ae21-aa2093db8879 tempest-TestMinimumBasicScenario-1160398710 None] Created reservations ['f6845b24-6c32-4044-b4df-ce6a0b7ee88b', '83379823-e57c-488a-b44b-734bdc5da683', '7df5bfd1-6006-4865-876a-46f10390baab', '922c9595-1824-4384-b397-90bfebb4ac85'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:36:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-52c3f012-3f14-424c-ae21-aa2093db8879 tempest-TestMinimumBasicScenario-1160398710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:36:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-52c3f012-3f14-424c-ae21-aa2093db8879 tempest-TestMinimumBasicScenario-1160398710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:36:49 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-52c3f012-3f14-424c-ae21-aa2093db8879 tempest-TestMinimumBasicScenario-1160398710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:36:49 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-52c3f012-3f14-424c-ae21-aa2093db8879 tempest-TestMinimumBasicScenario-1160398710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:36:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-52c3f012-3f14-424c-ae21-aa2093db8879 tempest-TestMinimumBasicScenario-1160398710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:36:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-52c3f012-3f14-424c-ae21-aa2093db8879 tempest-TestMinimumBasicScenario-1160398710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:50 devstack sudo[96923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:36:50 devstack sudo[96923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:50 devstack sudo[96917]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0ae2ca18-584c-41a7-b216-61f713363a85 tempest-VolumesSnapshotTestJSON-1431891046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72425850-6981-4edc-b5b8-9b0b46417a12.66529b38-41f8-41a6-9440-521563799ece" returned: 0 in 0.791s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0ae2ca18-584c-41a7-b216-61f713363a85 tempest-VolumesSnapshotTestJSON-1431891046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72425850-6981-4edc-b5b8-9b0b46417a12.66529b38-41f8-41a6-9440-521563799ece {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:50 devstack sudo[96925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72425850-6981-4edc-b5b8-9b0b46417a12.66529b38-41f8-41a6-9440-521563799ece Nov 03 07:36:50 devstack sudo[96925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:50 devstack sudo[96923]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-52c3f012-3f14-424c-ae21-aa2093db8879 tempest-TestMinimumBasicScenario-1160398710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.404s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:50 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-52c3f012-3f14-424c-ae21-aa2093db8879 tempest-TestMinimumBasicScenario-1160398710 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:36:50 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-52c3f012-3f14-424c-ae21-aa2093db8879 tempest-TestMinimumBasicScenario-1160398710 None] Deleted volume successfully. Nov 03 07:36:50 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-52c3f012-3f14-424c-ae21-aa2093db8879 tempest-TestMinimumBasicScenario-1160398710 None] Lock "cinder-9bd6ffd3-c633-40e4-9b14-76840174c32b-delete_volume" released by "delete_volume" :: held 2.363s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:36:50 devstack sudo[96925]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0ae2ca18-584c-41a7-b216-61f713363a85 tempest-VolumesSnapshotTestJSON-1431891046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72425850-6981-4edc-b5b8-9b0b46417a12.66529b38-41f8-41a6-9440-521563799ece" returned: 0 in 0.570s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:50 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-0ae2ca18-584c-41a7-b216-61f713363a85 tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "cinder-quobyte-66529b38-41f8-41a6-9440-521563799ece" released by "_delete_snapshot" :: held 3.322s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:36:50 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-0ae2ca18-584c-41a7-b216-61f713363a85 tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "cinder-quobyte-72425850-6981-4edc-b5b8-9b0b46417a12" released by "delete_snapshot" :: held 3.374s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:36:51 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-0ae2ca18-584c-41a7-b216-61f713363a85 tempest-VolumesSnapshotTestJSON-1431891046 None] Created reservations ['7f3dfd30-6cbe-45bc-90bb-48a7a77b35d8', 'a6d3090a-aa40-4b85-9fb1-0ce41ab9e932', 'bdee1068-41c5-4635-85fc-d24d46d1d443', 'd8dc4c3a-13b5-4f96-9052-0fef0243467d'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:36:51 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-0ae2ca18-584c-41a7-b216-61f713363a85 tempest-VolumesSnapshotTestJSON-1431891046 None] Delete snapshot completed successfully. Nov 03 07:36:51 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-0ae2ca18-584c-41a7-b216-61f713363a85 tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "cinder-66529b38-41f8-41a6-9440-521563799ece-delete_snapshot" released by "delete_snapshot" :: held 3.838s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:36:53 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-69b824c0-1496-44e0-beaa-495d123ca3ab tempest-VolumesSnapshotTestJSON-1431891046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:36:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-69b824c0-1496-44e0-beaa-495d123ca3ab tempest-VolumesSnapshotTestJSON-1431891046 None] Flow 'volume_create_manager' (b33a091b-0623-4075-ba61-34cd34aaad84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:36:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-69b824c0-1496-44e0-beaa-495d123ca3ab tempest-VolumesSnapshotTestJSON-1431891046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13ff7ba7-e9a4-4ab5-b0a5-c8c63477bdf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-69b824c0-1496-44e0-beaa-495d123ca3ab tempest-VolumesSnapshotTestJSON-1431891046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13ff7ba7-e9a4-4ab5-b0a5-c8c63477bdf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:36:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-136507066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85e8c1eb-0447-4258-8390-9c9511f8ec04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb83551fe0a4f9d86ec8819326c943b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:36:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:36:53Z,use_quota=True,user_id='2e03928097b24a51b19fc04bea3933bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-69b824c0-1496-44e0-beaa-495d123ca3ab tempest-VolumesSnapshotTestJSON-1431891046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fb37101-c18a-42af-a89d-cb16980e187f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-69b824c0-1496-44e0-beaa-495d123ca3ab tempest-VolumesSnapshotTestJSON-1431891046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fb37101-c18a-42af-a89d-cb16980e187f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-69b824c0-1496-44e0-beaa-495d123ca3ab tempest-VolumesSnapshotTestJSON-1431891046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b88408a-ad65-4944-8c75-55043c271a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-69b824c0-1496-44e0-beaa-495d123ca3ab tempest-VolumesSnapshotTestJSON-1431891046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b88408a-ad65-4944-8c75-55043c271a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85e8c1eb-0447-4258-8390-9c9511f8ec04', 'volume_name': 'volume-85e8c1eb-0447-4258-8390-9c9511f8ec04', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-69b824c0-1496-44e0-beaa-495d123ca3ab tempest-VolumesSnapshotTestJSON-1431891046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc3b929a-c356-4cca-ac80-321feb7697e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-69b824c0-1496-44e0-beaa-495d123ca3ab tempest-VolumesSnapshotTestJSON-1431891046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc3b929a-c356-4cca-ac80-321feb7697e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-69b824c0-1496-44e0-beaa-495d123ca3ab tempest-VolumesSnapshotTestJSON-1431891046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c02be1f-a0c4-4d58-a2f7-c2d5bda86e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:53 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-69b824c0-1496-44e0-beaa-495d123ca3ab tempest-VolumesSnapshotTestJSON-1431891046 None] Volume 85e8c1eb-0447-4258-8390-9c9511f8ec04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85e8c1eb-0447-4258-8390-9c9511f8ec04', 'volume_size': 1} Nov 03 07:36:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-69b824c0-1496-44e0-beaa-495d123ca3ab tempest-VolumesSnapshotTestJSON-1431891046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:36:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-69b824c0-1496-44e0-beaa-495d123ca3ab tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:36:53 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-69b824c0-1496-44e0-beaa-495d123ca3ab tempest-VolumesSnapshotTestJSON-1431891046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:36:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-136507066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85e8c1eb-0447-4258-8390-9c9511f8ec04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb83551fe0a4f9d86ec8819326c943b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:36:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:36:53Z,use_quota=True,user_id='2e03928097b24a51b19fc04bea3933bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:36:53 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-69b824c0-1496-44e0-beaa-495d123ca3ab tempest-VolumesSnapshotTestJSON-1431891046 None] Creating volume 85e8c1eb-0447-4258-8390-9c9511f8ec04 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:36:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-69b824c0-1496-44e0-beaa-495d123ca3ab tempest-VolumesSnapshotTestJSON-1431891046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:36:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-69b824c0-1496-44e0-beaa-495d123ca3ab tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:36:53 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-69b824c0-1496-44e0-beaa-495d123ca3ab tempest-VolumesSnapshotTestJSON-1431891046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:36:53 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-69b824c0-1496-44e0-beaa-495d123ca3ab tempest-VolumesSnapshotTestJSON-1431891046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:36:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-69b824c0-1496-44e0-beaa-495d123ca3ab tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:36:53 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-69b824c0-1496-44e0-beaa-495d123ca3ab tempest-VolumesSnapshotTestJSON-1431891046 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:36:53 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-69b824c0-1496-44e0-beaa-495d123ca3ab tempest-VolumesSnapshotTestJSON-1431891046 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:36:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-69b824c0-1496-44e0-beaa-495d123ca3ab tempest-VolumesSnapshotTestJSON-1431891046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-85e8c1eb-0447-4258-8390-9c9511f8ec04 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:53 devstack sudo[96953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-85e8c1eb-0447-4258-8390-9c9511f8ec04 1073741824 Nov 03 07:36:53 devstack sudo[96953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:53 devstack sudo[96953]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-69b824c0-1496-44e0-beaa-495d123ca3ab tempest-VolumesSnapshotTestJSON-1431891046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-85e8c1eb-0447-4258-8390-9c9511f8ec04 1073741824" returned: 0 in 0.720s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-69b824c0-1496-44e0-beaa-495d123ca3ab tempest-VolumesSnapshotTestJSON-1431891046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-85e8c1eb-0447-4258-8390-9c9511f8ec04 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:54 devstack sudo[96961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-85e8c1eb-0447-4258-8390-9c9511f8ec04 Nov 03 07:36:54 devstack sudo[96961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:54 devstack sudo[96961]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-69b824c0-1496-44e0-beaa-495d123ca3ab tempest-VolumesSnapshotTestJSON-1431891046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-85e8c1eb-0447-4258-8390-9c9511f8ec04" returned: 0 in 0.354s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:54 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-69b824c0-1496-44e0-beaa-495d123ca3ab tempest-VolumesSnapshotTestJSON-1431891046 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:36:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-69b824c0-1496-44e0-beaa-495d123ca3ab tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:36:54 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-69b824c0-1496-44e0-beaa-495d123ca3ab tempest-VolumesSnapshotTestJSON-1431891046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c02be1f-a0c4-4d58-a2f7-c2d5bda86e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85e8c1eb-0447-4258-8390-9c9511f8ec04', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:54 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-69b824c0-1496-44e0-beaa-495d123ca3ab tempest-VolumesSnapshotTestJSON-1431891046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30ac7e95-e71b-4c14-afe7-ffcd62d02a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:54 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-69b824c0-1496-44e0-beaa-495d123ca3ab tempest-VolumesSnapshotTestJSON-1431891046 None] Volume volume-85e8c1eb-0447-4258-8390-9c9511f8ec04 (85e8c1eb-0447-4258-8390-9c9511f8ec04): created successfully Nov 03 07:36:54 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-69b824c0-1496-44e0-beaa-495d123ca3ab tempest-VolumesSnapshotTestJSON-1431891046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30ac7e95-e71b-4c14-afe7-ffcd62d02a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:54 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-69b824c0-1496-44e0-beaa-495d123ca3ab tempest-VolumesSnapshotTestJSON-1431891046 None] Flow 'volume_create_manager' (b33a091b-0623-4075-ba61-34cd34aaad84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:36:54 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-69b824c0-1496-44e0-beaa-495d123ca3ab tempest-VolumesSnapshotTestJSON-1431891046 None] Created volume successfully. Nov 03 07:36:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-99a9ad8f-e067-4518-8476-2d6df3be78ad tempest-VolumesSnapshotTestJSON-1431891046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:36:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-99a9ad8f-e067-4518-8476-2d6df3be78ad tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:36:55 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-99a9ad8f-e067-4518-8476-2d6df3be78ad tempest-VolumesSnapshotTestJSON-1431891046 None] Creating offline snapshot 1681e1b0-1caa-432d-ae01-0feb8834ce8b of volume 85e8c1eb-0447-4258-8390-9c9511f8ec04 {{(pid=86875) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:36:55 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[7022bec7-1c18-41ef-b9b7-d31274731f3d]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:36:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-99a9ad8f-e067-4518-8476-2d6df3be78ad tempest-VolumesSnapshotTestJSON-1431891046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-85e8c1eb-0447-4258-8390-9c9511f8ec04 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:55 devstack sudo[96986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-85e8c1eb-0447-4258-8390-9c9511f8ec04 Nov 03 07:36:55 devstack sudo[96986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:55 devstack sudo[96986]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-99a9ad8f-e067-4518-8476-2d6df3be78ad tempest-VolumesSnapshotTestJSON-1431891046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-85e8c1eb-0447-4258-8390-9c9511f8ec04" returned: 0 in 0.539s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-99a9ad8f-e067-4518-8476-2d6df3be78ad tempest-VolumesSnapshotTestJSON-1431891046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-85e8c1eb-0447-4258-8390-9c9511f8ec04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-85e8c1eb-0447-4258-8390-9c9511f8ec04.1681e1b0-1caa-432d-ae01-0feb8834ce8b 1G {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:55 devstack sudo[96991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-85e8c1eb-0447-4258-8390-9c9511f8ec04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-85e8c1eb-0447-4258-8390-9c9511f8ec04.1681e1b0-1caa-432d-ae01-0feb8834ce8b 1G Nov 03 07:36:55 devstack sudo[96991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:56 devstack sudo[96991]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-99a9ad8f-e067-4518-8476-2d6df3be78ad tempest-VolumesSnapshotTestJSON-1431891046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-85e8c1eb-0447-4258-8390-9c9511f8ec04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-85e8c1eb-0447-4258-8390-9c9511f8ec04.1681e1b0-1caa-432d-ae01-0feb8834ce8b 1G" returned: 0 in 0.538s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-99a9ad8f-e067-4518-8476-2d6df3be78ad tempest-VolumesSnapshotTestJSON-1431891046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85e8c1eb-0447-4258-8390-9c9511f8ec04 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-85e8c1eb-0447-4258-8390-9c9511f8ec04.1681e1b0-1caa-432d-ae01-0feb8834ce8b {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:56 devstack sudo[96997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85e8c1eb-0447-4258-8390-9c9511f8ec04 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-85e8c1eb-0447-4258-8390-9c9511f8ec04.1681e1b0-1caa-432d-ae01-0feb8834ce8b Nov 03 07:36:56 devstack sudo[96997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:56 devstack sudo[96997]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-99a9ad8f-e067-4518-8476-2d6df3be78ad tempest-VolumesSnapshotTestJSON-1431891046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85e8c1eb-0447-4258-8390-9c9511f8ec04 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-85e8c1eb-0447-4258-8390-9c9511f8ec04.1681e1b0-1caa-432d-ae01-0feb8834ce8b" returned: 0 in 0.430s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:56 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-99a9ad8f-e067-4518-8476-2d6df3be78ad tempest-VolumesSnapshotTestJSON-1431891046 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-85e8c1eb-0447-4258-8390-9c9511f8ec04.1681e1b0-1caa-432d-ae01-0feb8834ce8b is being set with open permissions: ugo+rw Nov 03 07:36:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-99a9ad8f-e067-4518-8476-2d6df3be78ad tempest-VolumesSnapshotTestJSON-1431891046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-85e8c1eb-0447-4258-8390-9c9511f8ec04.1681e1b0-1caa-432d-ae01-0feb8834ce8b {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:56 devstack sudo[97004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-85e8c1eb-0447-4258-8390-9c9511f8ec04.1681e1b0-1caa-432d-ae01-0feb8834ce8b Nov 03 07:36:56 devstack sudo[97004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:57 devstack sudo[97004]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-99a9ad8f-e067-4518-8476-2d6df3be78ad tempest-VolumesSnapshotTestJSON-1431891046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-85e8c1eb-0447-4258-8390-9c9511f8ec04.1681e1b0-1caa-432d-ae01-0feb8834ce8b" returned: 0 in 0.392s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-99a9ad8f-e067-4518-8476-2d6df3be78ad tempest-VolumesSnapshotTestJSON-1431891046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-85e8c1eb-0447-4258-8390-9c9511f8ec04.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:57 devstack sudo[97007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-85e8c1eb-0447-4258-8390-9c9511f8ec04.info Nov 03 07:36:57 devstack sudo[97007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:57 devstack sudo[97007]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-99a9ad8f-e067-4518-8476-2d6df3be78ad tempest-VolumesSnapshotTestJSON-1431891046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-85e8c1eb-0447-4258-8390-9c9511f8ec04.info" returned: 0 in 0.334s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:57 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-99a9ad8f-e067-4518-8476-2d6df3be78ad tempest-VolumesSnapshotTestJSON-1431891046 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-85e8c1eb-0447-4258-8390-9c9511f8ec04.info is being set with open permissions: ugo+rw Nov 03 07:36:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-99a9ad8f-e067-4518-8476-2d6df3be78ad tempest-VolumesSnapshotTestJSON-1431891046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-85e8c1eb-0447-4258-8390-9c9511f8ec04.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:57 devstack sudo[97011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-85e8c1eb-0447-4258-8390-9c9511f8ec04.info Nov 03 07:36:57 devstack sudo[97011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:57 devstack sudo[97011]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-99a9ad8f-e067-4518-8476-2d6df3be78ad tempest-VolumesSnapshotTestJSON-1431891046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-85e8c1eb-0447-4258-8390-9c9511f8ec04.info" returned: 0 in 0.319s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-99a9ad8f-e067-4518-8476-2d6df3be78ad tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.684s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:36:57 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-99a9ad8f-e067-4518-8476-2d6df3be78ad tempest-VolumesSnapshotTestJSON-1431891046 None] Create snapshot completed successfully Nov 03 07:36:59 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac3f7d15-c4ea-484f-b9d1-0211cfd418e7 tempest-VolumesSnapshotTestJSON-1431891046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:36:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ac3f7d15-c4ea-484f-b9d1-0211cfd418e7 tempest-VolumesSnapshotTestJSON-1431891046 None] Flow 'volume_create_manager' (ef10112d-4c55-4d93-a528-ea540e7397d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:36:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ac3f7d15-c4ea-484f-b9d1-0211cfd418e7 tempest-VolumesSnapshotTestJSON-1431891046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11d3cda9-77fc-43f0-b4bd-82d9321d662e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ac3f7d15-c4ea-484f-b9d1-0211cfd418e7 tempest-VolumesSnapshotTestJSON-1431891046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11d3cda9-77fc-43f0-b4bd-82d9321d662e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:36:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1014853393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=990e9253-0c5a-4d50-b9ca-c98ed2fe53f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb83551fe0a4f9d86ec8819326c943b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:36:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=1681e1b0-1caa-432d-ae01-0feb8834ce8b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:36:59Z,use_quota=True,user_id='2e03928097b24a51b19fc04bea3933bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ac3f7d15-c4ea-484f-b9d1-0211cfd418e7 tempest-VolumesSnapshotTestJSON-1431891046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61a8dfb5-f330-4ae2-9268-f7cc8ae140a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ac3f7d15-c4ea-484f-b9d1-0211cfd418e7 tempest-VolumesSnapshotTestJSON-1431891046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61a8dfb5-f330-4ae2-9268-f7cc8ae140a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ac3f7d15-c4ea-484f-b9d1-0211cfd418e7 tempest-VolumesSnapshotTestJSON-1431891046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3db60385-e617-45af-9f77-d71ae2a478b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ac3f7d15-c4ea-484f-b9d1-0211cfd418e7 tempest-VolumesSnapshotTestJSON-1431891046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3db60385-e617-45af-9f77-d71ae2a478b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '990e9253-0c5a-4d50-b9ca-c98ed2fe53f6', 'volume_name': 'volume-990e9253-0c5a-4d50-b9ca-c98ed2fe53f6', 'volume_size': 2, 'snapshot_id': '1681e1b0-1caa-432d-ae01-0feb8834ce8b'}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ac3f7d15-c4ea-484f-b9d1-0211cfd418e7 tempest-VolumesSnapshotTestJSON-1431891046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f84f5478-d862-4821-940b-630d0a3f4db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ac3f7d15-c4ea-484f-b9d1-0211cfd418e7 tempest-VolumesSnapshotTestJSON-1431891046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f84f5478-d862-4821-940b-630d0a3f4db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:36:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ac3f7d15-c4ea-484f-b9d1-0211cfd418e7 tempest-VolumesSnapshotTestJSON-1431891046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b603cdd-060e-47ab-a0d9-0857a1da928c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:36:59 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-ac3f7d15-c4ea-484f-b9d1-0211cfd418e7 tempest-VolumesSnapshotTestJSON-1431891046 None] Volume 990e9253-0c5a-4d50-b9ca-c98ed2fe53f6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-990e9253-0c5a-4d50-b9ca-c98ed2fe53f6', 'volume_size': 2, 'snapshot_id': '1681e1b0-1caa-432d-ae01-0feb8834ce8b'} Nov 03 07:36:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-ac3f7d15-c4ea-484f-b9d1-0211cfd418e7 tempest-VolumesSnapshotTestJSON-1431891046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:36:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-ac3f7d15-c4ea-484f-b9d1-0211cfd418e7 tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:36:59 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ac3f7d15-c4ea-484f-b9d1-0211cfd418e7 tempest-VolumesSnapshotTestJSON-1431891046 None] Acquiring lock "cinder-quobyte-1681e1b0-1caa-432d-ae01-0feb8834ce8b-990e9253-0c5a-4d50-b9ca-c98ed2fe53f6" by "_create_volume_from_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:36:59 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ac3f7d15-c4ea-484f-b9d1-0211cfd418e7 tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "cinder-quobyte-1681e1b0-1caa-432d-ae01-0feb8834ce8b-990e9253-0c5a-4d50-b9ca-c98ed2fe53f6" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:36:59 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-ac3f7d15-c4ea-484f-b9d1-0211cfd418e7 tempest-VolumesSnapshotTestJSON-1431891046 None] Creating volume 990e9253-0c5a-4d50-b9ca-c98ed2fe53f6 from snapshot 1681e1b0-1caa-432d-ae01-0feb8834ce8b {{(pid=86875) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 07:36:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-ac3f7d15-c4ea-484f-b9d1-0211cfd418e7 tempest-VolumesSnapshotTestJSON-1431891046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:36:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-ac3f7d15-c4ea-484f-b9d1-0211cfd418e7 tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:36:59 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-ac3f7d15-c4ea-484f-b9d1-0211cfd418e7 tempest-VolumesSnapshotTestJSON-1431891046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:36:59 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-ac3f7d15-c4ea-484f-b9d1-0211cfd418e7 tempest-VolumesSnapshotTestJSON-1431891046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:36:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-ac3f7d15-c4ea-484f-b9d1-0211cfd418e7 tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:36:59 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-ac3f7d15-c4ea-484f-b9d1-0211cfd418e7 tempest-VolumesSnapshotTestJSON-1431891046 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:36:59 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ac3f7d15-c4ea-484f-b9d1-0211cfd418e7 tempest-VolumesSnapshotTestJSON-1431891046 None] Acquiring lock "cinder-quobyte-990e9253-0c5a-4d50-b9ca-c98ed2fe53f6" by "_copy_volume_from_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:36:59 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ac3f7d15-c4ea-484f-b9d1-0211cfd418e7 tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "cinder-quobyte-990e9253-0c5a-4d50-b9ca-c98ed2fe53f6" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:36:59 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-ac3f7d15-c4ea-484f-b9d1-0211cfd418e7 tempest-VolumesSnapshotTestJSON-1431891046 None] snapshot: 1681e1b0-1caa-432d-ae01-0feb8834ce8b, volume: 990e9253-0c5a-4d50-b9ca-c98ed2fe53f6, {{(pid=86875) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 07:36:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-ac3f7d15-c4ea-484f-b9d1-0211cfd418e7 tempest-VolumesSnapshotTestJSON-1431891046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:36:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-ac3f7d15-c4ea-484f-b9d1-0211cfd418e7 tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:36:59 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-ac3f7d15-c4ea-484f-b9d1-0211cfd418e7 tempest-VolumesSnapshotTestJSON-1431891046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:36:59 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-ac3f7d15-c4ea-484f-b9d1-0211cfd418e7 tempest-VolumesSnapshotTestJSON-1431891046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:36:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-ac3f7d15-c4ea-484f-b9d1-0211cfd418e7 tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:36:59 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d5d953-a812-470e-b370-8007d06da8ab]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:36:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ac3f7d15-c4ea-484f-b9d1-0211cfd418e7 tempest-VolumesSnapshotTestJSON-1431891046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-85e8c1eb-0447-4258-8390-9c9511f8ec04.1681e1b0-1caa-432d-ae01-0feb8834ce8b {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:36:59 devstack sudo[97015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-85e8c1eb-0447-4258-8390-9c9511f8ec04.1681e1b0-1caa-432d-ae01-0feb8834ce8b Nov 03 07:36:59 devstack sudo[97015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:36:59 devstack sudo[97015]: pam_unix(sudo:session): session closed for user root Nov 03 07:36:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ac3f7d15-c4ea-484f-b9d1-0211cfd418e7 tempest-VolumesSnapshotTestJSON-1431891046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-85e8c1eb-0447-4258-8390-9c9511f8ec04.1681e1b0-1caa-432d-ae01-0feb8834ce8b" returned: 0 in 0.564s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:36:59 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-ac3f7d15-c4ea-484f-b9d1-0211cfd418e7 tempest-VolumesSnapshotTestJSON-1431891046 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85e8c1eb-0447-4258-8390-9c9511f8ec04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:36:59 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[b406cf24-36d8-40ca-b4e7-59d85774fe7b]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:36:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ac3f7d15-c4ea-484f-b9d1-0211cfd418e7 tempest-VolumesSnapshotTestJSON-1431891046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-85e8c1eb-0447-4258-8390-9c9511f8ec04 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:00 devstack sudo[97020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-85e8c1eb-0447-4258-8390-9c9511f8ec04 Nov 03 07:37:00 devstack sudo[97020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:00 devstack sudo[97020]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ac3f7d15-c4ea-484f-b9d1-0211cfd418e7 tempest-VolumesSnapshotTestJSON-1431891046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-85e8c1eb-0447-4258-8390-9c9511f8ec04" returned: 0 in 0.427s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:00 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-ac3f7d15-c4ea-484f-b9d1-0211cfd418e7 tempest-VolumesSnapshotTestJSON-1431891046 None] will copy from snapshot at /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-85e8c1eb-0447-4258-8390-9c9511f8ec04 {{(pid=86875) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 07:37:00 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-ac3f7d15-c4ea-484f-b9d1-0211cfd418e7 tempest-VolumesSnapshotTestJSON-1431891046 None] Creating direct copy from snapshot {{(pid=86875) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 07:37:00 devstack cinder-volume[86875]: DEBUG cinder.utils [None req-ac3f7d15-c4ea-484f-b9d1-0211cfd418e7 tempest-VolumesSnapshotTestJSON-1431891046 None] Path /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-990e9253-0c5a-4d50-b9ca-c98ed2fe53f6 not found in is_blk_device check {{(pid=86875) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 07:37:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ac3f7d15-c4ea-484f-b9d1-0211cfd418e7 tempest-VolumesSnapshotTestJSON-1431891046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-85e8c1eb-0447-4258-8390-9c9511f8ec04 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-990e9253-0c5a-4d50-b9ca-c98ed2fe53f6 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:00 devstack sudo[97025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-85e8c1eb-0447-4258-8390-9c9511f8ec04 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-990e9253-0c5a-4d50-b9ca-c98ed2fe53f6 Nov 03 07:37:00 devstack sudo[97025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:03 devstack cinder-volume[86875]: DEBUG oslo_service.periodic_task [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86875) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:37:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:37:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:37:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:37:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:37:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:37:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:03 devstack sudo[97038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:37:03 devstack sudo[97038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:04 devstack sudo[97038]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.904s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:04 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:37:04 devstack cinder-volume[86875]: DEBUG oslo_service.periodic_task [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running periodic task VolumeManager._thread_info {{(pid=86875) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:37:04 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] thread count: 28 {{(pid=86875) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:37:04 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] thread info: [<_MainThread(MainThread, started 125626325639296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86875) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:37:09 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:SELECT=34,cinder:INSERT=12,cinder:UPDATE=38,cinder:DELETE=4 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:37:09 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:SELECT=46,cinder:INSERT=8,cinder:UPDATE=40,cinder:DELETE=3 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:37:09 devstack sudo[97025]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ac3f7d15-c4ea-484f-b9d1-0211cfd418e7 tempest-VolumesSnapshotTestJSON-1431891046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-85e8c1eb-0447-4258-8390-9c9511f8ec04 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-990e9253-0c5a-4d50-b9ca-c98ed2fe53f6" returned: 0 in 9.411s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:09 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-ac3f7d15-c4ea-484f-b9d1-0211cfd418e7 tempest-VolumesSnapshotTestJSON-1431891046 None] Image conversion details: src /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-85e8c1eb-0447-4258-8390-9c9511f8ec04, size 1024.00 MB, duration 9.41 sec, destination /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-990e9253-0c5a-4d50-b9ca-c98ed2fe53f6 {{(pid=86875) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:37:09 devstack cinder-volume[86875]: INFO cinder.image.image_utils [None req-ac3f7d15-c4ea-484f-b9d1-0211cfd418e7 tempest-VolumesSnapshotTestJSON-1431891046 None] Converted 1024.00 MB image at 108.79 MB/s Nov 03 07:37:09 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-ac3f7d15-c4ea-484f-b9d1-0211cfd418e7 tempest-VolumesSnapshotTestJSON-1431891046 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-990e9253-0c5a-4d50-b9ca-c98ed2fe53f6 is being set with open permissions: ugo+rw Nov 03 07:37:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ac3f7d15-c4ea-484f-b9d1-0211cfd418e7 tempest-VolumesSnapshotTestJSON-1431891046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-990e9253-0c5a-4d50-b9ca-c98ed2fe53f6 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:09 devstack sudo[97043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-990e9253-0c5a-4d50-b9ca-c98ed2fe53f6 Nov 03 07:37:09 devstack sudo[97043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:10 devstack sudo[97043]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ac3f7d15-c4ea-484f-b9d1-0211cfd418e7 tempest-VolumesSnapshotTestJSON-1431891046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-990e9253-0c5a-4d50-b9ca-c98ed2fe53f6" returned: 0 in 0.280s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:10 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ac3f7d15-c4ea-484f-b9d1-0211cfd418e7 tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "cinder-quobyte-990e9253-0c5a-4d50-b9ca-c98ed2fe53f6" released by "_copy_volume_from_snapshot" :: held 10.815s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:37:10 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ac3f7d15-c4ea-484f-b9d1-0211cfd418e7 tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "cinder-quobyte-1681e1b0-1caa-432d-ae01-0feb8834ce8b-990e9253-0c5a-4d50-b9ca-c98ed2fe53f6" released by "_create_volume_from_snapshot" :: held 10.905s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:37:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-ac3f7d15-c4ea-484f-b9d1-0211cfd418e7 tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.926s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:37:10 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ac3f7d15-c4ea-484f-b9d1-0211cfd418e7 tempest-VolumesSnapshotTestJSON-1431891046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b603cdd-060e-47ab-a0d9-0857a1da928c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-990e9253-0c5a-4d50-b9ca-c98ed2fe53f6', 'volume_size': 2, 'snapshot_id': '1681e1b0-1caa-432d-ae01-0feb8834ce8b'}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:10 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ac3f7d15-c4ea-484f-b9d1-0211cfd418e7 tempest-VolumesSnapshotTestJSON-1431891046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd92ebcb-394a-4459-b22b-a8296ae7a638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:10 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-ac3f7d15-c4ea-484f-b9d1-0211cfd418e7 tempest-VolumesSnapshotTestJSON-1431891046 None] Volume volume-990e9253-0c5a-4d50-b9ca-c98ed2fe53f6 (990e9253-0c5a-4d50-b9ca-c98ed2fe53f6): created successfully Nov 03 07:37:10 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ac3f7d15-c4ea-484f-b9d1-0211cfd418e7 tempest-VolumesSnapshotTestJSON-1431891046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd92ebcb-394a-4459-b22b-a8296ae7a638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:10 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ac3f7d15-c4ea-484f-b9d1-0211cfd418e7 tempest-VolumesSnapshotTestJSON-1431891046 None] Flow 'volume_create_manager' (ef10112d-4c55-4d93-a528-ea540e7397d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:37:10 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-ac3f7d15-c4ea-484f-b9d1-0211cfd418e7 tempest-VolumesSnapshotTestJSON-1431891046 None] Created volume successfully. Nov 03 07:37:10 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-9b7fe476-c185-469f-af20-2fb22e792ecc tempest-VolumesSnapshotTestJSON-1431891046 None] Acquiring lock "cinder-990e9253-0c5a-4d50-b9ca-c98ed2fe53f6-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:37:10 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-9b7fe476-c185-469f-af20-2fb22e792ecc tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "cinder-990e9253-0c5a-4d50-b9ca-c98ed2fe53f6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:37:10 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-9b7fe476-c185-469f-af20-2fb22e792ecc tempest-VolumesSnapshotTestJSON-1431891046 None] Acquiring lock "cinder-quobyte-990e9253-0c5a-4d50-b9ca-c98ed2fe53f6" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:37:10 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-9b7fe476-c185-469f-af20-2fb22e792ecc tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "cinder-quobyte-990e9253-0c5a-4d50-b9ca-c98ed2fe53f6" acquired by "delete_volume" :: waited 0.025s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:37:10 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e7f8fd-3557-44a5-b1c7-3c329a95ea01]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:37:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9b7fe476-c185-469f-af20-2fb22e792ecc tempest-VolumesSnapshotTestJSON-1431891046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-990e9253-0c5a-4d50-b9ca-c98ed2fe53f6 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:11 devstack sudo[97046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-990e9253-0c5a-4d50-b9ca-c98ed2fe53f6 Nov 03 07:37:11 devstack sudo[97046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:11 devstack sudo[97046]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9b7fe476-c185-469f-af20-2fb22e792ecc tempest-VolumesSnapshotTestJSON-1431891046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-990e9253-0c5a-4d50-b9ca-c98ed2fe53f6" returned: 0 in 0.489s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9b7fe476-c185-469f-af20-2fb22e792ecc tempest-VolumesSnapshotTestJSON-1431891046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-990e9253-0c5a-4d50-b9ca-c98ed2fe53f6 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:11 devstack sudo[97051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-990e9253-0c5a-4d50-b9ca-c98ed2fe53f6 Nov 03 07:37:11 devstack sudo[97051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:11 devstack sudo[97051]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9b7fe476-c185-469f-af20-2fb22e792ecc tempest-VolumesSnapshotTestJSON-1431891046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-990e9253-0c5a-4d50-b9ca-c98ed2fe53f6" returned: 0 in 0.411s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:11 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-9b7fe476-c185-469f-af20-2fb22e792ecc tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "cinder-quobyte-990e9253-0c5a-4d50-b9ca-c98ed2fe53f6" released by "delete_volume" :: held 0.990s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:37:11 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-9b7fe476-c185-469f-af20-2fb22e792ecc tempest-VolumesSnapshotTestJSON-1431891046 None] Created reservations ['096823a0-a02a-4dc1-bf4f-df1e44d9c6d3', 'd805584d-9d5d-45b2-b833-c3a47fc7e6c1', 'de268f23-195a-464b-9f84-87c7eaa869f3', '818aab31-1fdb-437d-afeb-fe6c84421e0e'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:37:12 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-9b7fe476-c185-469f-af20-2fb22e792ecc tempest-VolumesSnapshotTestJSON-1431891046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:37:12 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-9b7fe476-c185-469f-af20-2fb22e792ecc tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:37:12 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-9b7fe476-c185-469f-af20-2fb22e792ecc tempest-VolumesSnapshotTestJSON-1431891046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:37:12 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-9b7fe476-c185-469f-af20-2fb22e792ecc tempest-VolumesSnapshotTestJSON-1431891046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:37:12 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-9b7fe476-c185-469f-af20-2fb22e792ecc tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:37:12 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9b7fe476-c185-469f-af20-2fb22e792ecc tempest-VolumesSnapshotTestJSON-1431891046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:12 devstack sudo[97056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:37:12 devstack sudo[97056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:12 devstack sudo[97056]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:12 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9b7fe476-c185-469f-af20-2fb22e792ecc tempest-VolumesSnapshotTestJSON-1431891046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.395s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:12 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-9b7fe476-c185-469f-af20-2fb22e792ecc tempest-VolumesSnapshotTestJSON-1431891046 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:37:12 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-9b7fe476-c185-469f-af20-2fb22e792ecc tempest-VolumesSnapshotTestJSON-1431891046 None] Deleted volume successfully. Nov 03 07:37:12 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-9b7fe476-c185-469f-af20-2fb22e792ecc tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "cinder-990e9253-0c5a-4d50-b9ca-c98ed2fe53f6-delete_volume" released by "delete_volume" :: held 1.791s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:37:13 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-351e5fd8-cb32-4b3a-94f2-ddc78db4dbc2 tempest-VolumesSnapshotTestJSON-1431891046 None] Acquiring lock "cinder-1681e1b0-1caa-432d-ae01-0feb8834ce8b-delete_snapshot" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:37:13 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-351e5fd8-cb32-4b3a-94f2-ddc78db4dbc2 tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "cinder-1681e1b0-1caa-432d-ae01-0feb8834ce8b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:37:13 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-351e5fd8-cb32-4b3a-94f2-ddc78db4dbc2 tempest-VolumesSnapshotTestJSON-1431891046 None] Acquiring lock "cinder-quobyte-85e8c1eb-0447-4258-8390-9c9511f8ec04" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:37:13 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-351e5fd8-cb32-4b3a-94f2-ddc78db4dbc2 tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "cinder-quobyte-85e8c1eb-0447-4258-8390-9c9511f8ec04" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:37:13 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-351e5fd8-cb32-4b3a-94f2-ddc78db4dbc2 tempest-VolumesSnapshotTestJSON-1431891046 None] Acquiring lock "cinder-quobyte-1681e1b0-1caa-432d-ae01-0feb8834ce8b" by "_delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:37:13 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-351e5fd8-cb32-4b3a-94f2-ddc78db4dbc2 tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "cinder-quobyte-1681e1b0-1caa-432d-ae01-0feb8834ce8b" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:37:13 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-351e5fd8-cb32-4b3a-94f2-ddc78db4dbc2 tempest-VolumesSnapshotTestJSON-1431891046 None] Deleting offline snapshot 1681e1b0-1caa-432d-ae01-0feb8834ce8b of volume 85e8c1eb-0447-4258-8390-9c9511f8ec04 {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:37:13 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-351e5fd8-cb32-4b3a-94f2-ddc78db4dbc2 tempest-VolumesSnapshotTestJSON-1431891046 None] snapshot_file for this snap is: volume-85e8c1eb-0447-4258-8390-9c9511f8ec04.1681e1b0-1caa-432d-ae01-0feb8834ce8b {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:37:13 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d31ef5-4a30-4987-a627-f1b43f5d5c3e]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:37:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-351e5fd8-cb32-4b3a-94f2-ddc78db4dbc2 tempest-VolumesSnapshotTestJSON-1431891046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-85e8c1eb-0447-4258-8390-9c9511f8ec04.1681e1b0-1caa-432d-ae01-0feb8834ce8b {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:13 devstack sudo[97059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-85e8c1eb-0447-4258-8390-9c9511f8ec04.1681e1b0-1caa-432d-ae01-0feb8834ce8b Nov 03 07:37:13 devstack sudo[97059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:13 devstack sudo[97059]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-351e5fd8-cb32-4b3a-94f2-ddc78db4dbc2 tempest-VolumesSnapshotTestJSON-1431891046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-85e8c1eb-0447-4258-8390-9c9511f8ec04.1681e1b0-1caa-432d-ae01-0feb8834ce8b" returned: 0 in 0.509s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:13 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-351e5fd8-cb32-4b3a-94f2-ddc78db4dbc2 tempest-VolumesSnapshotTestJSON-1431891046 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85e8c1eb-0447-4258-8390-9c9511f8ec04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:37:13 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[766a523e-72fc-49cb-b42c-fa8396f450b3]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:37:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-351e5fd8-cb32-4b3a-94f2-ddc78db4dbc2 tempest-VolumesSnapshotTestJSON-1431891046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-85e8c1eb-0447-4258-8390-9c9511f8ec04 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:14 devstack sudo[97065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-85e8c1eb-0447-4258-8390-9c9511f8ec04 Nov 03 07:37:14 devstack sudo[97065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:14 devstack sudo[97065]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:14 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-351e5fd8-cb32-4b3a-94f2-ddc78db4dbc2 tempest-VolumesSnapshotTestJSON-1431891046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-85e8c1eb-0447-4258-8390-9c9511f8ec04" returned: 0 in 0.789s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:14 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-351e5fd8-cb32-4b3a-94f2-ddc78db4dbc2 tempest-VolumesSnapshotTestJSON-1431891046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-85e8c1eb-0447-4258-8390-9c9511f8ec04.1681e1b0-1caa-432d-ae01-0feb8834ce8b {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:14 devstack sudo[97072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-85e8c1eb-0447-4258-8390-9c9511f8ec04.1681e1b0-1caa-432d-ae01-0feb8834ce8b Nov 03 07:37:14 devstack sudo[97072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:15 devstack sudo[97072]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-351e5fd8-cb32-4b3a-94f2-ddc78db4dbc2 tempest-VolumesSnapshotTestJSON-1431891046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-85e8c1eb-0447-4258-8390-9c9511f8ec04.1681e1b0-1caa-432d-ae01-0feb8834ce8b" returned: 0 in 0.487s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-351e5fd8-cb32-4b3a-94f2-ddc78db4dbc2 tempest-VolumesSnapshotTestJSON-1431891046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-85e8c1eb-0447-4258-8390-9c9511f8ec04.1681e1b0-1caa-432d-ae01-0feb8834ce8b {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:15 devstack sudo[97077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-85e8c1eb-0447-4258-8390-9c9511f8ec04.1681e1b0-1caa-432d-ae01-0feb8834ce8b Nov 03 07:37:15 devstack sudo[97077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:15 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-29dfd5ba-b836-40bf-acdb-16ebf36da897 tempest-AttachVolumeNegativeTest-376242003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:37:15 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-29dfd5ba-b836-40bf-acdb-16ebf36da897 tempest-AttachVolumeNegativeTest-376242003 None] Flow 'volume_create_manager' (8fa548b2-8cc8-4dc3-b273-57d1adbff643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:37:15 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-29dfd5ba-b836-40bf-acdb-16ebf36da897 tempest-AttachVolumeNegativeTest-376242003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df83243a-87b4-4bdf-8706-b7ea00a21eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:15 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-29dfd5ba-b836-40bf-acdb-16ebf36da897 tempest-AttachVolumeNegativeTest-376242003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df83243a-87b4-4bdf-8706-b7ea00a21eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:37:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1594900159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba62065b-3452-4db1-a973-f35706d9ba59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60564972953a439ba57e1761dfc75f41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:37:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:37:15Z,use_quota=True,user_id='822a51fff8714448872da499e2386447',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:15 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-29dfd5ba-b836-40bf-acdb-16ebf36da897 tempest-AttachVolumeNegativeTest-376242003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36c076bf-e123-4944-b7f4-d2d642f31cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:15 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-29dfd5ba-b836-40bf-acdb-16ebf36da897 tempest-AttachVolumeNegativeTest-376242003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36c076bf-e123-4944-b7f4-d2d642f31cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:15 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-29dfd5ba-b836-40bf-acdb-16ebf36da897 tempest-AttachVolumeNegativeTest-376242003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6cab623-795e-4d66-8d30-466dabeb3f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:15 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-29dfd5ba-b836-40bf-acdb-16ebf36da897 tempest-AttachVolumeNegativeTest-376242003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6cab623-795e-4d66-8d30-466dabeb3f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba62065b-3452-4db1-a973-f35706d9ba59', 'volume_name': 'volume-ba62065b-3452-4db1-a973-f35706d9ba59', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:15 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-29dfd5ba-b836-40bf-acdb-16ebf36da897 tempest-AttachVolumeNegativeTest-376242003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2b1eeb0-c598-46a8-927f-ed7076b67a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:15 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-29dfd5ba-b836-40bf-acdb-16ebf36da897 tempest-AttachVolumeNegativeTest-376242003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2b1eeb0-c598-46a8-927f-ed7076b67a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:15 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-29dfd5ba-b836-40bf-acdb-16ebf36da897 tempest-AttachVolumeNegativeTest-376242003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06ed3518-e86b-4701-85be-eb0d7295ead0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:15 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-29dfd5ba-b836-40bf-acdb-16ebf36da897 tempest-AttachVolumeNegativeTest-376242003 None] Volume ba62065b-3452-4db1-a973-f35706d9ba59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba62065b-3452-4db1-a973-f35706d9ba59', 'volume_size': 1} Nov 03 07:37:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-29dfd5ba-b836-40bf-acdb-16ebf36da897 tempest-AttachVolumeNegativeTest-376242003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:37:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-29dfd5ba-b836-40bf-acdb-16ebf36da897 tempest-AttachVolumeNegativeTest-376242003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:37:15 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-29dfd5ba-b836-40bf-acdb-16ebf36da897 tempest-AttachVolumeNegativeTest-376242003 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:37:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1594900159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba62065b-3452-4db1-a973-f35706d9ba59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60564972953a439ba57e1761dfc75f41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:37:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:37:15Z,use_quota=True,user_id='822a51fff8714448872da499e2386447',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:37:15 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-29dfd5ba-b836-40bf-acdb-16ebf36da897 tempest-AttachVolumeNegativeTest-376242003 None] Creating volume ba62065b-3452-4db1-a973-f35706d9ba59 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:37:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-29dfd5ba-b836-40bf-acdb-16ebf36da897 tempest-AttachVolumeNegativeTest-376242003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:37:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-29dfd5ba-b836-40bf-acdb-16ebf36da897 tempest-AttachVolumeNegativeTest-376242003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:37:15 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-29dfd5ba-b836-40bf-acdb-16ebf36da897 tempest-AttachVolumeNegativeTest-376242003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:37:15 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-29dfd5ba-b836-40bf-acdb-16ebf36da897 tempest-AttachVolumeNegativeTest-376242003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:37:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-29dfd5ba-b836-40bf-acdb-16ebf36da897 tempest-AttachVolumeNegativeTest-376242003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:37:15 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-29dfd5ba-b836-40bf-acdb-16ebf36da897 tempest-AttachVolumeNegativeTest-376242003 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:37:15 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-29dfd5ba-b836-40bf-acdb-16ebf36da897 tempest-AttachVolumeNegativeTest-376242003 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:37:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-29dfd5ba-b836-40bf-acdb-16ebf36da897 tempest-AttachVolumeNegativeTest-376242003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ba62065b-3452-4db1-a973-f35706d9ba59 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:15 devstack sudo[97079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ba62065b-3452-4db1-a973-f35706d9ba59 1073741824 Nov 03 07:37:15 devstack sudo[97079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:15 devstack sudo[97077]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-351e5fd8-cb32-4b3a-94f2-ddc78db4dbc2 tempest-VolumesSnapshotTestJSON-1431891046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-85e8c1eb-0447-4258-8390-9c9511f8ec04.1681e1b0-1caa-432d-ae01-0feb8834ce8b" returned: 0 in 0.394s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:15 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-351e5fd8-cb32-4b3a-94f2-ddc78db4dbc2 tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "cinder-quobyte-1681e1b0-1caa-432d-ae01-0feb8834ce8b" released by "_delete_snapshot" :: held 2.371s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:37:15 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-351e5fd8-cb32-4b3a-94f2-ddc78db4dbc2 tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "cinder-quobyte-85e8c1eb-0447-4258-8390-9c9511f8ec04" released by "delete_snapshot" :: held 2.420s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:37:15 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-351e5fd8-cb32-4b3a-94f2-ddc78db4dbc2 tempest-VolumesSnapshotTestJSON-1431891046 None] Created reservations ['4c6a4eb7-2ced-4ebe-91e5-60261eefa7f0', '3d9a69fa-a384-4a32-a0a8-a73bb6332196', 'cbd8a893-9de6-4b27-961a-b69b6ce7a667', '2d1bceea-d904-4ec8-b7c0-675583300257'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:37:15 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-351e5fd8-cb32-4b3a-94f2-ddc78db4dbc2 tempest-VolumesSnapshotTestJSON-1431891046 None] Delete snapshot completed successfully. Nov 03 07:37:15 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-351e5fd8-cb32-4b3a-94f2-ddc78db4dbc2 tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "cinder-1681e1b0-1caa-432d-ae01-0feb8834ce8b-delete_snapshot" released by "delete_snapshot" :: held 2.680s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:37:16 devstack sudo[97079]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-29dfd5ba-b836-40bf-acdb-16ebf36da897 tempest-AttachVolumeNegativeTest-376242003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ba62065b-3452-4db1-a973-f35706d9ba59 1073741824" returned: 0 in 0.595s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-29dfd5ba-b836-40bf-acdb-16ebf36da897 tempest-AttachVolumeNegativeTest-376242003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ba62065b-3452-4db1-a973-f35706d9ba59 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:16 devstack sudo[97086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ba62065b-3452-4db1-a973-f35706d9ba59 Nov 03 07:37:16 devstack sudo[97086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:16 devstack sudo[97086]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-29dfd5ba-b836-40bf-acdb-16ebf36da897 tempest-AttachVolumeNegativeTest-376242003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ba62065b-3452-4db1-a973-f35706d9ba59" returned: 0 in 0.402s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:16 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-29dfd5ba-b836-40bf-acdb-16ebf36da897 tempest-AttachVolumeNegativeTest-376242003 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:37:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-29dfd5ba-b836-40bf-acdb-16ebf36da897 tempest-AttachVolumeNegativeTest-376242003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:37:16 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-29dfd5ba-b836-40bf-acdb-16ebf36da897 tempest-AttachVolumeNegativeTest-376242003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06ed3518-e86b-4701-85be-eb0d7295ead0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba62065b-3452-4db1-a973-f35706d9ba59', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:16 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-29dfd5ba-b836-40bf-acdb-16ebf36da897 tempest-AttachVolumeNegativeTest-376242003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42beea56-4d78-4b4b-b5e5-7bbe3cfcb26e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:16 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-29dfd5ba-b836-40bf-acdb-16ebf36da897 tempest-AttachVolumeNegativeTest-376242003 None] Volume volume-ba62065b-3452-4db1-a973-f35706d9ba59 (ba62065b-3452-4db1-a973-f35706d9ba59): created successfully Nov 03 07:37:16 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-29dfd5ba-b836-40bf-acdb-16ebf36da897 tempest-AttachVolumeNegativeTest-376242003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42beea56-4d78-4b4b-b5e5-7bbe3cfcb26e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:16 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-29dfd5ba-b836-40bf-acdb-16ebf36da897 tempest-AttachVolumeNegativeTest-376242003 None] Flow 'volume_create_manager' (8fa548b2-8cc8-4dc3-b273-57d1adbff643) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:37:16 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-29dfd5ba-b836-40bf-acdb-16ebf36da897 tempest-AttachVolumeNegativeTest-376242003 None] Created volume successfully. Nov 03 07:37:16 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-974ee754-5298-4390-a723-b9e8b779039f tempest-VolumesSnapshotTestJSON-1431891046 None] Acquiring lock "cinder-85e8c1eb-0447-4258-8390-9c9511f8ec04-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:37:16 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-974ee754-5298-4390-a723-b9e8b779039f tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "cinder-85e8c1eb-0447-4258-8390-9c9511f8ec04-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:37:16 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-974ee754-5298-4390-a723-b9e8b779039f tempest-VolumesSnapshotTestJSON-1431891046 None] Acquiring lock "cinder-quobyte-85e8c1eb-0447-4258-8390-9c9511f8ec04" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:37:16 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-974ee754-5298-4390-a723-b9e8b779039f tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "cinder-quobyte-85e8c1eb-0447-4258-8390-9c9511f8ec04" acquired by "delete_volume" :: waited 0.020s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:37:16 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[177d64b0-97a6-408c-bbad-9c7107abb3bd]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:37:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-974ee754-5298-4390-a723-b9e8b779039f tempest-VolumesSnapshotTestJSON-1431891046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-85e8c1eb-0447-4258-8390-9c9511f8ec04 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:16 devstack sudo[97096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-85e8c1eb-0447-4258-8390-9c9511f8ec04 Nov 03 07:37:16 devstack sudo[97096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:17 devstack sudo[97096]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-974ee754-5298-4390-a723-b9e8b779039f tempest-VolumesSnapshotTestJSON-1431891046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-85e8c1eb-0447-4258-8390-9c9511f8ec04" returned: 0 in 0.450s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-974ee754-5298-4390-a723-b9e8b779039f tempest-VolumesSnapshotTestJSON-1431891046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-85e8c1eb-0447-4258-8390-9c9511f8ec04 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:17 devstack sudo[97101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-85e8c1eb-0447-4258-8390-9c9511f8ec04 Nov 03 07:37:17 devstack sudo[97101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:17 devstack sudo[97101]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-974ee754-5298-4390-a723-b9e8b779039f tempest-VolumesSnapshotTestJSON-1431891046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-85e8c1eb-0447-4258-8390-9c9511f8ec04" returned: 0 in 0.430s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:17 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-974ee754-5298-4390-a723-b9e8b779039f tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "cinder-quobyte-85e8c1eb-0447-4258-8390-9c9511f8ec04" released by "delete_volume" :: held 0.994s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:37:17 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-974ee754-5298-4390-a723-b9e8b779039f tempest-VolumesSnapshotTestJSON-1431891046 None] Created reservations ['5a19c621-7cbf-4bf1-a8bb-1433ceb946f5', '85def601-c5a1-4223-b045-0b9971f01210', 'b8317128-1f07-49e7-bc27-badf35cfc053', '7ea4d3b5-d75f-471b-8739-ecfb13d5a94c'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:37:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-974ee754-5298-4390-a723-b9e8b779039f tempest-VolumesSnapshotTestJSON-1431891046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:37:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-974ee754-5298-4390-a723-b9e8b779039f tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:37:17 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-974ee754-5298-4390-a723-b9e8b779039f tempest-VolumesSnapshotTestJSON-1431891046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:37:17 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-974ee754-5298-4390-a723-b9e8b779039f tempest-VolumesSnapshotTestJSON-1431891046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:37:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-974ee754-5298-4390-a723-b9e8b779039f tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:37:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-974ee754-5298-4390-a723-b9e8b779039f tempest-VolumesSnapshotTestJSON-1431891046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:18 devstack sudo[97145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:37:18 devstack sudo[97145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:18 devstack sudo[97145]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:18 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-974ee754-5298-4390-a723-b9e8b779039f tempest-VolumesSnapshotTestJSON-1431891046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.681s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:18 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-974ee754-5298-4390-a723-b9e8b779039f tempest-VolumesSnapshotTestJSON-1431891046 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:37:18 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-974ee754-5298-4390-a723-b9e8b779039f tempest-VolumesSnapshotTestJSON-1431891046 None] Deleted volume successfully. Nov 03 07:37:18 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-974ee754-5298-4390-a723-b9e8b779039f tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "cinder-85e8c1eb-0447-4258-8390-9c9511f8ec04-delete_volume" released by "delete_volume" :: held 2.046s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:37:19 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-e0f8cb1e-24ee-43b4-8d9b-e07d7794efb0 req-cd4d93d0-2e45-454a-b296-7b0491d42b5b tempest-AttachVolumeNegativeTest-376242003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:37:19 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-e0f8cb1e-24ee-43b4-8d9b-e07d7794efb0 req-cd4d93d0-2e45-454a-b296-7b0491d42b5b tempest-AttachVolumeNegativeTest-376242003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:37:19 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-e0f8cb1e-24ee-43b4-8d9b-e07d7794efb0 req-cd4d93d0-2e45-454a-b296-7b0491d42b5b tempest-AttachVolumeNegativeTest-376242003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.042s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:37:19 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-29ed3910-079b-4063-abd7-ec6d2010413f tempest-VolumesSnapshotTestJSON-1431891046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:37:19 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-29ed3910-079b-4063-abd7-ec6d2010413f tempest-VolumesSnapshotTestJSON-1431891046 None] Flow 'volume_create_manager' (33771080-b668-48f8-80eb-ade77fc3a33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:37:19 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-29ed3910-079b-4063-abd7-ec6d2010413f tempest-VolumesSnapshotTestJSON-1431891046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d07dbe73-7be7-4025-8f6c-8bf34950baeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:19 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-29ed3910-079b-4063-abd7-ec6d2010413f tempest-VolumesSnapshotTestJSON-1431891046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d07dbe73-7be7-4025-8f6c-8bf34950baeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:37:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-837553719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf9880a3-f130-41f5-8761-e2c726642bce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb83551fe0a4f9d86ec8819326c943b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:37:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:37:19Z,use_quota=True,user_id='2e03928097b24a51b19fc04bea3933bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:19 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-29ed3910-079b-4063-abd7-ec6d2010413f tempest-VolumesSnapshotTestJSON-1431891046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (025fdc31-d4f7-46d1-ad16-d3de67b8ad4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:19 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-29ed3910-079b-4063-abd7-ec6d2010413f tempest-VolumesSnapshotTestJSON-1431891046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (025fdc31-d4f7-46d1-ad16-d3de67b8ad4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:19 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-29ed3910-079b-4063-abd7-ec6d2010413f tempest-VolumesSnapshotTestJSON-1431891046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (583bbe52-8828-4991-a992-b239aefa3e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:19 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-29ed3910-079b-4063-abd7-ec6d2010413f tempest-VolumesSnapshotTestJSON-1431891046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (583bbe52-8828-4991-a992-b239aefa3e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf9880a3-f130-41f5-8761-e2c726642bce', 'volume_name': 'volume-cf9880a3-f130-41f5-8761-e2c726642bce', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:19 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-29ed3910-079b-4063-abd7-ec6d2010413f tempest-VolumesSnapshotTestJSON-1431891046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04008f48-c1cb-4e3c-a776-2f98423e8eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:19 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-29ed3910-079b-4063-abd7-ec6d2010413f tempest-VolumesSnapshotTestJSON-1431891046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04008f48-c1cb-4e3c-a776-2f98423e8eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:19 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-29ed3910-079b-4063-abd7-ec6d2010413f tempest-VolumesSnapshotTestJSON-1431891046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c43cd64-0aa5-4a45-b68c-6b20e44e4e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:19 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-29ed3910-079b-4063-abd7-ec6d2010413f tempest-VolumesSnapshotTestJSON-1431891046 None] Volume cf9880a3-f130-41f5-8761-e2c726642bce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf9880a3-f130-41f5-8761-e2c726642bce', 'volume_size': 1} Nov 03 07:37:19 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-29ed3910-079b-4063-abd7-ec6d2010413f tempest-VolumesSnapshotTestJSON-1431891046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:37:19 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-29ed3910-079b-4063-abd7-ec6d2010413f tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:37:19 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-29ed3910-079b-4063-abd7-ec6d2010413f tempest-VolumesSnapshotTestJSON-1431891046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:37:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-837553719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf9880a3-f130-41f5-8761-e2c726642bce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb83551fe0a4f9d86ec8819326c943b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:37:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:37:19Z,use_quota=True,user_id='2e03928097b24a51b19fc04bea3933bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:37:19 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-29ed3910-079b-4063-abd7-ec6d2010413f tempest-VolumesSnapshotTestJSON-1431891046 None] Creating volume cf9880a3-f130-41f5-8761-e2c726642bce {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:37:19 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-29ed3910-079b-4063-abd7-ec6d2010413f tempest-VolumesSnapshotTestJSON-1431891046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:37:19 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-29ed3910-079b-4063-abd7-ec6d2010413f tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:37:19 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-29ed3910-079b-4063-abd7-ec6d2010413f tempest-VolumesSnapshotTestJSON-1431891046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:37:19 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-29ed3910-079b-4063-abd7-ec6d2010413f tempest-VolumesSnapshotTestJSON-1431891046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:37:19 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-29ed3910-079b-4063-abd7-ec6d2010413f tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:37:19 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-29ed3910-079b-4063-abd7-ec6d2010413f tempest-VolumesSnapshotTestJSON-1431891046 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:37:19 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-29ed3910-079b-4063-abd7-ec6d2010413f tempest-VolumesSnapshotTestJSON-1431891046 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:37:19 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-29ed3910-079b-4063-abd7-ec6d2010413f tempest-VolumesSnapshotTestJSON-1431891046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf9880a3-f130-41f5-8761-e2c726642bce 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:19 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-e0f8cb1e-24ee-43b4-8d9b-e07d7794efb0 req-cd4d93d0-2e45-454a-b296-7b0491d42b5b tempest-AttachVolumeNegativeTest-376242003 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1', 'name': 'volume-ba62065b-3452-4db1-a973-f35706d9ba59', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6f5ea17a-1047-4580-9ac5-18569f69431c', 'enforce_multipath': True} {{(pid=86875) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:37:19 devstack sudo[97158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf9880a3-f130-41f5-8761-e2c726642bce 1073741824 Nov 03 07:37:19 devstack sudo[97158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:19 devstack cinder-volume[86875]: INFO cinder.volume.manager [req-e0f8cb1e-24ee-43b4-8d9b-e07d7794efb0 req-cd4d93d0-2e45-454a-b296-7b0491d42b5b tempest-AttachVolumeNegativeTest-376242003 None] attachment_update completed successfully. Nov 03 07:37:20 devstack sudo[97158]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-29ed3910-079b-4063-abd7-ec6d2010413f tempest-VolumesSnapshotTestJSON-1431891046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf9880a3-f130-41f5-8761-e2c726642bce 1073741824" returned: 0 in 0.856s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-29ed3910-079b-4063-abd7-ec6d2010413f tempest-VolumesSnapshotTestJSON-1431891046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf9880a3-f130-41f5-8761-e2c726642bce {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:20 devstack sudo[97582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf9880a3-f130-41f5-8761-e2c726642bce Nov 03 07:37:20 devstack sudo[97582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:20 devstack sudo[97582]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-29ed3910-079b-4063-abd7-ec6d2010413f tempest-VolumesSnapshotTestJSON-1431891046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf9880a3-f130-41f5-8761-e2c726642bce" returned: 0 in 0.388s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:20 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-29ed3910-079b-4063-abd7-ec6d2010413f tempest-VolumesSnapshotTestJSON-1431891046 None] <== create_volume: return (1309ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:37:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-29ed3910-079b-4063-abd7-ec6d2010413f tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.312s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:37:20 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-29ed3910-079b-4063-abd7-ec6d2010413f tempest-VolumesSnapshotTestJSON-1431891046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c43cd64-0aa5-4a45-b68c-6b20e44e4e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf9880a3-f130-41f5-8761-e2c726642bce', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:20 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-29ed3910-079b-4063-abd7-ec6d2010413f tempest-VolumesSnapshotTestJSON-1431891046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14a2d547-4630-4a3f-acd1-71b64979f93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:20 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-29ed3910-079b-4063-abd7-ec6d2010413f tempest-VolumesSnapshotTestJSON-1431891046 None] Volume volume-cf9880a3-f130-41f5-8761-e2c726642bce (cf9880a3-f130-41f5-8761-e2c726642bce): created successfully Nov 03 07:37:20 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-29ed3910-079b-4063-abd7-ec6d2010413f tempest-VolumesSnapshotTestJSON-1431891046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14a2d547-4630-4a3f-acd1-71b64979f93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:20 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-29ed3910-079b-4063-abd7-ec6d2010413f tempest-VolumesSnapshotTestJSON-1431891046 None] Flow 'volume_create_manager' (33771080-b668-48f8-80eb-ade77fc3a33c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:37:20 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-29ed3910-079b-4063-abd7-ec6d2010413f tempest-VolumesSnapshotTestJSON-1431891046 None] Created volume successfully. Nov 03 07:37:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-448781c9-d384-4b9b-a958-2203f40446fe tempest-VolumesSnapshotTestJSON-1431891046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:37:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-448781c9-d384-4b9b-a958-2203f40446fe tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:37:21 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-448781c9-d384-4b9b-a958-2203f40446fe tempest-VolumesSnapshotTestJSON-1431891046 None] Creating offline snapshot af9cd81b-34b2-4004-89a1-37c4d652829e of volume cf9880a3-f130-41f5-8761-e2c726642bce {{(pid=86875) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:37:21 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5db1f90-b8e5-45ff-97be-285ef53a2d7c]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:37:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-448781c9-d384-4b9b-a958-2203f40446fe tempest-VolumesSnapshotTestJSON-1431891046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf9880a3-f130-41f5-8761-e2c726642bce {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:21 devstack sudo[97598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf9880a3-f130-41f5-8761-e2c726642bce Nov 03 07:37:21 devstack sudo[97598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:22 devstack cinder-volume[86875]: INFO cinder.volume.manager [req-06d37494-6338-45c1-acdb-9a3dcc69817d req-03a9ff37-8193-4822-a103-a8153ebc6f9f tempest-AttachVolumeNegativeTest-376242003 None] Terminate volume connection completed successfully. Nov 03 07:37:22 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-06d37494-6338-45c1-acdb-9a3dcc69817d req-03a9ff37-8193-4822-a103-a8153ebc6f9f tempest-AttachVolumeNegativeTest-376242003 None] Deleting attachment 6f5ea17a-1047-4580-9ac5-18569f69431c. {{(pid=86875) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:37:22 devstack sudo[97598]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-448781c9-d384-4b9b-a958-2203f40446fe tempest-VolumesSnapshotTestJSON-1431891046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf9880a3-f130-41f5-8761-e2c726642bce" returned: 0 in 0.561s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-448781c9-d384-4b9b-a958-2203f40446fe tempest-VolumesSnapshotTestJSON-1431891046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf9880a3-f130-41f5-8761-e2c726642bce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf9880a3-f130-41f5-8761-e2c726642bce.af9cd81b-34b2-4004-89a1-37c4d652829e 1G {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:22 devstack sudo[97629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf9880a3-f130-41f5-8761-e2c726642bce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf9880a3-f130-41f5-8761-e2c726642bce.af9cd81b-34b2-4004-89a1-37c4d652829e 1G Nov 03 07:37:22 devstack sudo[97629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:22 devstack sudo[97629]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-448781c9-d384-4b9b-a958-2203f40446fe tempest-VolumesSnapshotTestJSON-1431891046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf9880a3-f130-41f5-8761-e2c726642bce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf9880a3-f130-41f5-8761-e2c726642bce.af9cd81b-34b2-4004-89a1-37c4d652829e 1G" returned: 0 in 0.637s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-448781c9-d384-4b9b-a958-2203f40446fe tempest-VolumesSnapshotTestJSON-1431891046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf9880a3-f130-41f5-8761-e2c726642bce -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf9880a3-f130-41f5-8761-e2c726642bce.af9cd81b-34b2-4004-89a1-37c4d652829e {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:23 devstack sudo[97635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf9880a3-f130-41f5-8761-e2c726642bce -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf9880a3-f130-41f5-8761-e2c726642bce.af9cd81b-34b2-4004-89a1-37c4d652829e Nov 03 07:37:23 devstack sudo[97635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:23 devstack sudo[97635]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-448781c9-d384-4b9b-a958-2203f40446fe tempest-VolumesSnapshotTestJSON-1431891046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf9880a3-f130-41f5-8761-e2c726642bce -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf9880a3-f130-41f5-8761-e2c726642bce.af9cd81b-34b2-4004-89a1-37c4d652829e" returned: 0 in 0.810s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:23 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-448781c9-d384-4b9b-a958-2203f40446fe tempest-VolumesSnapshotTestJSON-1431891046 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf9880a3-f130-41f5-8761-e2c726642bce.af9cd81b-34b2-4004-89a1-37c4d652829e is being set with open permissions: ugo+rw Nov 03 07:37:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-448781c9-d384-4b9b-a958-2203f40446fe tempest-VolumesSnapshotTestJSON-1431891046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf9880a3-f130-41f5-8761-e2c726642bce.af9cd81b-34b2-4004-89a1-37c4d652829e {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:23 devstack sudo[97661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf9880a3-f130-41f5-8761-e2c726642bce.af9cd81b-34b2-4004-89a1-37c4d652829e Nov 03 07:37:23 devstack sudo[97661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:24 devstack sudo[97661]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-448781c9-d384-4b9b-a958-2203f40446fe tempest-VolumesSnapshotTestJSON-1431891046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf9880a3-f130-41f5-8761-e2c726642bce.af9cd81b-34b2-4004-89a1-37c4d652829e" returned: 0 in 0.377s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-448781c9-d384-4b9b-a958-2203f40446fe tempest-VolumesSnapshotTestJSON-1431891046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf9880a3-f130-41f5-8761-e2c726642bce.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:24 devstack sudo[97665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf9880a3-f130-41f5-8761-e2c726642bce.info Nov 03 07:37:24 devstack sudo[97665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:24 devstack sudo[97665]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-448781c9-d384-4b9b-a958-2203f40446fe tempest-VolumesSnapshotTestJSON-1431891046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf9880a3-f130-41f5-8761-e2c726642bce.info" returned: 0 in 0.315s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:24 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-448781c9-d384-4b9b-a958-2203f40446fe tempest-VolumesSnapshotTestJSON-1431891046 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf9880a3-f130-41f5-8761-e2c726642bce.info is being set with open permissions: ugo+rw Nov 03 07:37:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-448781c9-d384-4b9b-a958-2203f40446fe tempest-VolumesSnapshotTestJSON-1431891046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf9880a3-f130-41f5-8761-e2c726642bce.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:24 devstack sudo[97668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf9880a3-f130-41f5-8761-e2c726642bce.info Nov 03 07:37:24 devstack sudo[97668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:24 devstack sudo[97668]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-448781c9-d384-4b9b-a958-2203f40446fe tempest-VolumesSnapshotTestJSON-1431891046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf9880a3-f130-41f5-8761-e2c726642bce.info" returned: 0 in 0.320s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-448781c9-d384-4b9b-a958-2203f40446fe tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.206s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:37:24 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-448781c9-d384-4b9b-a958-2203f40446fe tempest-VolumesSnapshotTestJSON-1431891046 None] Create snapshot completed successfully Nov 03 07:37:27 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-3705c2f7-c939-4a1a-9b7c-4dc3abf23696 tempest-VolumesSnapshotTestJSON-1431891046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:37:27 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3705c2f7-c939-4a1a-9b7c-4dc3abf23696 tempest-VolumesSnapshotTestJSON-1431891046 None] Flow 'volume_create_manager' (0895abae-4d03-49cd-847b-7ee942a6cc12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:37:27 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3705c2f7-c939-4a1a-9b7c-4dc3abf23696 tempest-VolumesSnapshotTestJSON-1431891046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f0fd1e0-3608-4fe0-82db-503651998dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:27 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3705c2f7-c939-4a1a-9b7c-4dc3abf23696 tempest-VolumesSnapshotTestJSON-1431891046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f0fd1e0-3608-4fe0-82db-503651998dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:37:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1534175587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2861edc4-8ce8-4ee9-b423-a006cb410cd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb83551fe0a4f9d86ec8819326c943b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:37:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=af9cd81b-34b2-4004-89a1-37c4d652829e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:37:27Z,use_quota=True,user_id='2e03928097b24a51b19fc04bea3933bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:27 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3705c2f7-c939-4a1a-9b7c-4dc3abf23696 tempest-VolumesSnapshotTestJSON-1431891046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2f63747-de2b-475f-8ee0-783bb0b80a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:27 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3705c2f7-c939-4a1a-9b7c-4dc3abf23696 tempest-VolumesSnapshotTestJSON-1431891046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2f63747-de2b-475f-8ee0-783bb0b80a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:27 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3705c2f7-c939-4a1a-9b7c-4dc3abf23696 tempest-VolumesSnapshotTestJSON-1431891046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad9aca4e-2aa8-444c-9cb8-fefc7c4c1c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:27 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3705c2f7-c939-4a1a-9b7c-4dc3abf23696 tempest-VolumesSnapshotTestJSON-1431891046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad9aca4e-2aa8-444c-9cb8-fefc7c4c1c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2861edc4-8ce8-4ee9-b423-a006cb410cd9', 'volume_name': 'volume-2861edc4-8ce8-4ee9-b423-a006cb410cd9', 'volume_size': 1, 'snapshot_id': 'af9cd81b-34b2-4004-89a1-37c4d652829e'}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:27 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3705c2f7-c939-4a1a-9b7c-4dc3abf23696 tempest-VolumesSnapshotTestJSON-1431891046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55414e80-8d72-4651-a086-bd747a6ec394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:27 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3705c2f7-c939-4a1a-9b7c-4dc3abf23696 tempest-VolumesSnapshotTestJSON-1431891046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55414e80-8d72-4651-a086-bd747a6ec394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:27 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3705c2f7-c939-4a1a-9b7c-4dc3abf23696 tempest-VolumesSnapshotTestJSON-1431891046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (947b6ad1-4c32-43ec-9d9b-bc16619a9e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:27 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-3705c2f7-c939-4a1a-9b7c-4dc3abf23696 tempest-VolumesSnapshotTestJSON-1431891046 None] Volume 2861edc4-8ce8-4ee9-b423-a006cb410cd9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2861edc4-8ce8-4ee9-b423-a006cb410cd9', 'volume_size': 1, 'snapshot_id': 'af9cd81b-34b2-4004-89a1-37c4d652829e'} Nov 03 07:37:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3705c2f7-c939-4a1a-9b7c-4dc3abf23696 tempest-VolumesSnapshotTestJSON-1431891046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:37:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3705c2f7-c939-4a1a-9b7c-4dc3abf23696 tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:37:27 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-3705c2f7-c939-4a1a-9b7c-4dc3abf23696 tempest-VolumesSnapshotTestJSON-1431891046 None] Acquiring lock "cinder-quobyte-af9cd81b-34b2-4004-89a1-37c4d652829e-2861edc4-8ce8-4ee9-b423-a006cb410cd9" by "_create_volume_from_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:37:27 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-3705c2f7-c939-4a1a-9b7c-4dc3abf23696 tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "cinder-quobyte-af9cd81b-34b2-4004-89a1-37c4d652829e-2861edc4-8ce8-4ee9-b423-a006cb410cd9" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:37:27 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-3705c2f7-c939-4a1a-9b7c-4dc3abf23696 tempest-VolumesSnapshotTestJSON-1431891046 None] Creating volume 2861edc4-8ce8-4ee9-b423-a006cb410cd9 from snapshot af9cd81b-34b2-4004-89a1-37c4d652829e {{(pid=86875) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 07:37:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3705c2f7-c939-4a1a-9b7c-4dc3abf23696 tempest-VolumesSnapshotTestJSON-1431891046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:37:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3705c2f7-c939-4a1a-9b7c-4dc3abf23696 tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:37:27 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-3705c2f7-c939-4a1a-9b7c-4dc3abf23696 tempest-VolumesSnapshotTestJSON-1431891046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:37:27 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-3705c2f7-c939-4a1a-9b7c-4dc3abf23696 tempest-VolumesSnapshotTestJSON-1431891046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:37:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3705c2f7-c939-4a1a-9b7c-4dc3abf23696 tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:37:27 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-3705c2f7-c939-4a1a-9b7c-4dc3abf23696 tempest-VolumesSnapshotTestJSON-1431891046 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:37:27 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-3705c2f7-c939-4a1a-9b7c-4dc3abf23696 tempest-VolumesSnapshotTestJSON-1431891046 None] Acquiring lock "cinder-quobyte-2861edc4-8ce8-4ee9-b423-a006cb410cd9" by "_copy_volume_from_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:37:27 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-3705c2f7-c939-4a1a-9b7c-4dc3abf23696 tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "cinder-quobyte-2861edc4-8ce8-4ee9-b423-a006cb410cd9" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:37:27 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-3705c2f7-c939-4a1a-9b7c-4dc3abf23696 tempest-VolumesSnapshotTestJSON-1431891046 None] snapshot: af9cd81b-34b2-4004-89a1-37c4d652829e, volume: 2861edc4-8ce8-4ee9-b423-a006cb410cd9, {{(pid=86875) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 07:37:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3705c2f7-c939-4a1a-9b7c-4dc3abf23696 tempest-VolumesSnapshotTestJSON-1431891046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:37:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3705c2f7-c939-4a1a-9b7c-4dc3abf23696 tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:37:27 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-3705c2f7-c939-4a1a-9b7c-4dc3abf23696 tempest-VolumesSnapshotTestJSON-1431891046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:37:27 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-3705c2f7-c939-4a1a-9b7c-4dc3abf23696 tempest-VolumesSnapshotTestJSON-1431891046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:37:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3705c2f7-c939-4a1a-9b7c-4dc3abf23696 tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:37:27 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee81b045-ddcd-426b-a860-6e2be143136a]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:37:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3705c2f7-c939-4a1a-9b7c-4dc3abf23696 tempest-VolumesSnapshotTestJSON-1431891046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf9880a3-f130-41f5-8761-e2c726642bce.af9cd81b-34b2-4004-89a1-37c4d652829e {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:27 devstack sudo[97728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf9880a3-f130-41f5-8761-e2c726642bce.af9cd81b-34b2-4004-89a1-37c4d652829e Nov 03 07:37:27 devstack sudo[97728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:28 devstack sudo[97728]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3705c2f7-c939-4a1a-9b7c-4dc3abf23696 tempest-VolumesSnapshotTestJSON-1431891046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf9880a3-f130-41f5-8761-e2c726642bce.af9cd81b-34b2-4004-89a1-37c4d652829e" returned: 0 in 0.821s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:28 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-3705c2f7-c939-4a1a-9b7c-4dc3abf23696 tempest-VolumesSnapshotTestJSON-1431891046 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf9880a3-f130-41f5-8761-e2c726642bce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:37:28 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4985bb-3652-4b84-8560-9b57d75d9176]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:37:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3705c2f7-c939-4a1a-9b7c-4dc3abf23696 tempest-VolumesSnapshotTestJSON-1431891046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf9880a3-f130-41f5-8761-e2c726642bce {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:28 devstack sudo[97746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf9880a3-f130-41f5-8761-e2c726642bce Nov 03 07:37:28 devstack sudo[97746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:29 devstack sudo[97746]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:29 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3705c2f7-c939-4a1a-9b7c-4dc3abf23696 tempest-VolumesSnapshotTestJSON-1431891046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf9880a3-f130-41f5-8761-e2c726642bce" returned: 0 in 0.776s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:29 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-3705c2f7-c939-4a1a-9b7c-4dc3abf23696 tempest-VolumesSnapshotTestJSON-1431891046 None] will copy from snapshot at /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf9880a3-f130-41f5-8761-e2c726642bce {{(pid=86875) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 07:37:29 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-3705c2f7-c939-4a1a-9b7c-4dc3abf23696 tempest-VolumesSnapshotTestJSON-1431891046 None] Creating direct copy from snapshot {{(pid=86875) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 07:37:29 devstack cinder-volume[86875]: DEBUG cinder.utils [None req-3705c2f7-c939-4a1a-9b7c-4dc3abf23696 tempest-VolumesSnapshotTestJSON-1431891046 None] Path /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2861edc4-8ce8-4ee9-b423-a006cb410cd9 not found in is_blk_device check {{(pid=86875) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 07:37:29 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3705c2f7-c939-4a1a-9b7c-4dc3abf23696 tempest-VolumesSnapshotTestJSON-1431891046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf9880a3-f130-41f5-8761-e2c726642bce /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2861edc4-8ce8-4ee9-b423-a006cb410cd9 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:29 devstack sudo[97754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf9880a3-f130-41f5-8761-e2c726642bce /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2861edc4-8ce8-4ee9-b423-a006cb410cd9 Nov 03 07:37:29 devstack sudo[97754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:32 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ae6aeaea-68f6-4ff4-acd0-7d718ef272c7 tempest-AttachVolumeNegativeTest-376242003 None] Acquiring lock "cinder-ba62065b-3452-4db1-a973-f35706d9ba59-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:37:32 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ae6aeaea-68f6-4ff4-acd0-7d718ef272c7 tempest-AttachVolumeNegativeTest-376242003 None] Lock "cinder-ba62065b-3452-4db1-a973-f35706d9ba59-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:37:32 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ae6aeaea-68f6-4ff4-acd0-7d718ef272c7 tempest-AttachVolumeNegativeTest-376242003 None] Acquiring lock "cinder-quobyte-ba62065b-3452-4db1-a973-f35706d9ba59" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:37:32 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ae6aeaea-68f6-4ff4-acd0-7d718ef272c7 tempest-AttachVolumeNegativeTest-376242003 None] Lock "cinder-quobyte-ba62065b-3452-4db1-a973-f35706d9ba59" acquired by "delete_volume" :: waited 0.044s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:37:32 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3787851-f479-4019-8fe1-a67af9af8d86]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:37:32 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ae6aeaea-68f6-4ff4-acd0-7d718ef272c7 tempest-AttachVolumeNegativeTest-376242003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ba62065b-3452-4db1-a973-f35706d9ba59 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:33 devstack sudo[97768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ba62065b-3452-4db1-a973-f35706d9ba59 Nov 03 07:37:33 devstack sudo[97768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:34 devstack sudo[97768]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ae6aeaea-68f6-4ff4-acd0-7d718ef272c7 tempest-AttachVolumeNegativeTest-376242003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ba62065b-3452-4db1-a973-f35706d9ba59" returned: 0 in 1.423s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ae6aeaea-68f6-4ff4-acd0-7d718ef272c7 tempest-AttachVolumeNegativeTest-376242003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ba62065b-3452-4db1-a973-f35706d9ba59 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:34 devstack sudo[97778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ba62065b-3452-4db1-a973-f35706d9ba59 Nov 03 07:37:34 devstack sudo[97778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:35 devstack sudo[97778]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ae6aeaea-68f6-4ff4-acd0-7d718ef272c7 tempest-AttachVolumeNegativeTest-376242003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ba62065b-3452-4db1-a973-f35706d9ba59" returned: 0 in 1.001s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:35 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ae6aeaea-68f6-4ff4-acd0-7d718ef272c7 tempest-AttachVolumeNegativeTest-376242003 None] Lock "cinder-quobyte-ba62065b-3452-4db1-a973-f35706d9ba59" released by "delete_volume" :: held 2.577s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:37:35 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-ae6aeaea-68f6-4ff4-acd0-7d718ef272c7 tempest-AttachVolumeNegativeTest-376242003 None] Created reservations ['ebd6264a-02ec-4099-adbb-3d72de07d18d', '769fb2eb-a4f3-4e68-a91b-eda87b066630', '30c8d117-65ca-441c-a5ff-87315a66d6c9', '3b16fe83-5fe0-4198-a210-7bb8f45ff328'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:37:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-ae6aeaea-68f6-4ff4-acd0-7d718ef272c7 tempest-AttachVolumeNegativeTest-376242003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:37:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-ae6aeaea-68f6-4ff4-acd0-7d718ef272c7 tempest-AttachVolumeNegativeTest-376242003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:37:35 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-ae6aeaea-68f6-4ff4-acd0-7d718ef272c7 tempest-AttachVolumeNegativeTest-376242003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:37:35 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-ae6aeaea-68f6-4ff4-acd0-7d718ef272c7 tempest-AttachVolumeNegativeTest-376242003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:37:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-ae6aeaea-68f6-4ff4-acd0-7d718ef272c7 tempest-AttachVolumeNegativeTest-376242003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:37:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ae6aeaea-68f6-4ff4-acd0-7d718ef272c7 tempest-AttachVolumeNegativeTest-376242003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:36 devstack sudo[97786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:37:36 devstack sudo[97786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:37 devstack sudo[97786]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:37 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-db4db504-f5c7-4116-915c-8626246bbc29 tempest-AttachVolumeNegativeTest-376242003 None] Acquiring lock "cinder-a8233617-9f01-4aa5-afe5-08a0654c2e1b-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:37:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ae6aeaea-68f6-4ff4-acd0-7d718ef272c7 tempest-AttachVolumeNegativeTest-376242003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 1.175s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:37 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-ae6aeaea-68f6-4ff4-acd0-7d718ef272c7 tempest-AttachVolumeNegativeTest-376242003 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:37:37 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-ae6aeaea-68f6-4ff4-acd0-7d718ef272c7 tempest-AttachVolumeNegativeTest-376242003 None] Deleted volume successfully. Nov 03 07:37:37 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-db4db504-f5c7-4116-915c-8626246bbc29 tempest-AttachVolumeNegativeTest-376242003 None] Lock "cinder-a8233617-9f01-4aa5-afe5-08a0654c2e1b-delete_volume" acquired by "delete_volume" :: waited 0.138s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:37:37 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ae6aeaea-68f6-4ff4-acd0-7d718ef272c7 tempest-AttachVolumeNegativeTest-376242003 None] Lock "cinder-ba62065b-3452-4db1-a973-f35706d9ba59-delete_volume" released by "delete_volume" :: held 4.679s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:37:37 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-db4db504-f5c7-4116-915c-8626246bbc29 tempest-AttachVolumeNegativeTest-376242003 None] Acquiring lock "cinder-quobyte-a8233617-9f01-4aa5-afe5-08a0654c2e1b" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:37:37 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-db4db504-f5c7-4116-915c-8626246bbc29 tempest-AttachVolumeNegativeTest-376242003 None] Lock "cinder-quobyte-a8233617-9f01-4aa5-afe5-08a0654c2e1b" acquired by "delete_volume" :: waited 0.056s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:37:37 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a39315-5e47-4d45-acd5-5a49d903fb04]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:37:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-db4db504-f5c7-4116-915c-8626246bbc29 tempest-AttachVolumeNegativeTest-376242003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a8233617-9f01-4aa5-afe5-08a0654c2e1b {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:38 devstack sudo[97792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a8233617-9f01-4aa5-afe5-08a0654c2e1b Nov 03 07:37:38 devstack sudo[97792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:39 devstack sudo[97792]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-db4db504-f5c7-4116-915c-8626246bbc29 tempest-AttachVolumeNegativeTest-376242003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a8233617-9f01-4aa5-afe5-08a0654c2e1b" returned: 0 in 1.542s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-db4db504-f5c7-4116-915c-8626246bbc29 tempest-AttachVolumeNegativeTest-376242003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a8233617-9f01-4aa5-afe5-08a0654c2e1b {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:39 devstack sudo[97797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a8233617-9f01-4aa5-afe5-08a0654c2e1b Nov 03 07:37:39 devstack sudo[97797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:40 devstack sudo[97797]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-db4db504-f5c7-4116-915c-8626246bbc29 tempest-AttachVolumeNegativeTest-376242003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a8233617-9f01-4aa5-afe5-08a0654c2e1b" returned: 0 in 1.246s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:40 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-db4db504-f5c7-4116-915c-8626246bbc29 tempest-AttachVolumeNegativeTest-376242003 None] Lock "cinder-quobyte-a8233617-9f01-4aa5-afe5-08a0654c2e1b" released by "delete_volume" :: held 2.992s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:37:40 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-db4db504-f5c7-4116-915c-8626246bbc29 tempest-AttachVolumeNegativeTest-376242003 None] Created reservations ['d8fb32de-fddf-4a39-8996-71802fc24d3f', '95b71df1-9687-47c7-801d-4f7f33945776', 'd2f839af-f775-4e8d-bd2d-fe3859732c70', '6969740d-40f3-4d96-bf6a-263dba921d7a'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:37:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-db4db504-f5c7-4116-915c-8626246bbc29 tempest-AttachVolumeNegativeTest-376242003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:37:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-db4db504-f5c7-4116-915c-8626246bbc29 tempest-AttachVolumeNegativeTest-376242003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:37:41 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-db4db504-f5c7-4116-915c-8626246bbc29 tempest-AttachVolumeNegativeTest-376242003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:37:41 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-db4db504-f5c7-4116-915c-8626246bbc29 tempest-AttachVolumeNegativeTest-376242003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:37:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-db4db504-f5c7-4116-915c-8626246bbc29 tempest-AttachVolumeNegativeTest-376242003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:37:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-db4db504-f5c7-4116-915c-8626246bbc29 tempest-AttachVolumeNegativeTest-376242003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:41 devstack sudo[97801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:37:41 devstack sudo[97801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:42 devstack sudo[97801]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-db4db504-f5c7-4116-915c-8626246bbc29 tempest-AttachVolumeNegativeTest-376242003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 1.007s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:42 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-db4db504-f5c7-4116-915c-8626246bbc29 tempest-AttachVolumeNegativeTest-376242003 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:37:42 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-db4db504-f5c7-4116-915c-8626246bbc29 tempest-AttachVolumeNegativeTest-376242003 None] Deleted volume successfully. Nov 03 07:37:42 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-db4db504-f5c7-4116-915c-8626246bbc29 tempest-AttachVolumeNegativeTest-376242003 None] Lock "cinder-a8233617-9f01-4aa5-afe5-08a0654c2e1b-delete_volume" released by "delete_volume" :: held 4.981s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:37:42 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-b0e1f442-fcbd-405e-a767-6fe66418d2cd tempest-AttachVolumeNegativeTest-376242003 None] Acquiring lock "cinder-25386aa5-945f-4f69-9b1a-cae9c027fc04-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:37:42 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-b0e1f442-fcbd-405e-a767-6fe66418d2cd tempest-AttachVolumeNegativeTest-376242003 None] Lock "cinder-25386aa5-945f-4f69-9b1a-cae9c027fc04-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:37:42 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-b0e1f442-fcbd-405e-a767-6fe66418d2cd tempest-AttachVolumeNegativeTest-376242003 None] Acquiring lock "cinder-quobyte-25386aa5-945f-4f69-9b1a-cae9c027fc04" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:37:42 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-b0e1f442-fcbd-405e-a767-6fe66418d2cd tempest-AttachVolumeNegativeTest-376242003 None] Lock "cinder-quobyte-25386aa5-945f-4f69-9b1a-cae9c027fc04" acquired by "delete_volume" :: waited 0.066s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:37:42 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e36ad26-7005-434c-8503-f3e23c2d470f]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:37:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b0e1f442-fcbd-405e-a767-6fe66418d2cd tempest-AttachVolumeNegativeTest-376242003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-25386aa5-945f-4f69-9b1a-cae9c027fc04 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:42 devstack sudo[97754]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3705c2f7-c939-4a1a-9b7c-4dc3abf23696 tempest-VolumesSnapshotTestJSON-1431891046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf9880a3-f130-41f5-8761-e2c726642bce /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2861edc4-8ce8-4ee9-b423-a006cb410cd9" returned: 0 in 13.745s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:42 devstack sudo[97836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-25386aa5-945f-4f69-9b1a-cae9c027fc04 Nov 03 07:37:42 devstack sudo[97836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:42 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-3705c2f7-c939-4a1a-9b7c-4dc3abf23696 tempest-VolumesSnapshotTestJSON-1431891046 None] Image conversion details: src /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf9880a3-f130-41f5-8761-e2c726642bce, size 1024.00 MB, duration 13.75 sec, destination /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2861edc4-8ce8-4ee9-b423-a006cb410cd9 {{(pid=86875) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:37:42 devstack cinder-volume[86875]: INFO cinder.image.image_utils [None req-3705c2f7-c939-4a1a-9b7c-4dc3abf23696 tempest-VolumesSnapshotTestJSON-1431891046 None] Converted 1024.00 MB image at 74.49 MB/s Nov 03 07:37:42 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-3705c2f7-c939-4a1a-9b7c-4dc3abf23696 tempest-VolumesSnapshotTestJSON-1431891046 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2861edc4-8ce8-4ee9-b423-a006cb410cd9 is being set with open permissions: ugo+rw Nov 03 07:37:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3705c2f7-c939-4a1a-9b7c-4dc3abf23696 tempest-VolumesSnapshotTestJSON-1431891046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2861edc4-8ce8-4ee9-b423-a006cb410cd9 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:42 devstack sudo[97839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2861edc4-8ce8-4ee9-b423-a006cb410cd9 Nov 03 07:37:42 devstack sudo[97839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:43 devstack sudo[97839]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:43 devstack sudo[97836]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:43 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3705c2f7-c939-4a1a-9b7c-4dc3abf23696 tempest-VolumesSnapshotTestJSON-1431891046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2861edc4-8ce8-4ee9-b423-a006cb410cd9" returned: 0 in 0.493s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:43 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b0e1f442-fcbd-405e-a767-6fe66418d2cd tempest-AttachVolumeNegativeTest-376242003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-25386aa5-945f-4f69-9b1a-cae9c027fc04" returned: 0 in 0.771s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:43 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b0e1f442-fcbd-405e-a767-6fe66418d2cd tempest-AttachVolumeNegativeTest-376242003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-25386aa5-945f-4f69-9b1a-cae9c027fc04 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:43 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-3705c2f7-c939-4a1a-9b7c-4dc3abf23696 tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "cinder-quobyte-2861edc4-8ce8-4ee9-b423-a006cb410cd9" released by "_copy_volume_from_snapshot" :: held 16.033s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:37:43 devstack sudo[97845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-25386aa5-945f-4f69-9b1a-cae9c027fc04 Nov 03 07:37:43 devstack sudo[97845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:43 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-3705c2f7-c939-4a1a-9b7c-4dc3abf23696 tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "cinder-quobyte-af9cd81b-34b2-4004-89a1-37c4d652829e-2861edc4-8ce8-4ee9-b423-a006cb410cd9" released by "_create_volume_from_snapshot" :: held 16.168s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:37:43 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3705c2f7-c939-4a1a-9b7c-4dc3abf23696 tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 16.206s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:37:43 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3705c2f7-c939-4a1a-9b7c-4dc3abf23696 tempest-VolumesSnapshotTestJSON-1431891046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (947b6ad1-4c32-43ec-9d9b-bc16619a9e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2861edc4-8ce8-4ee9-b423-a006cb410cd9', 'volume_size': 1, 'snapshot_id': 'af9cd81b-34b2-4004-89a1-37c4d652829e'}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:43 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3705c2f7-c939-4a1a-9b7c-4dc3abf23696 tempest-VolumesSnapshotTestJSON-1431891046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8407c886-afa6-4a60-b21f-57d19a41f3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:43 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-3705c2f7-c939-4a1a-9b7c-4dc3abf23696 tempest-VolumesSnapshotTestJSON-1431891046 None] Volume volume-2861edc4-8ce8-4ee9-b423-a006cb410cd9 (2861edc4-8ce8-4ee9-b423-a006cb410cd9): created successfully Nov 03 07:37:43 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3705c2f7-c939-4a1a-9b7c-4dc3abf23696 tempest-VolumesSnapshotTestJSON-1431891046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8407c886-afa6-4a60-b21f-57d19a41f3b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:43 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3705c2f7-c939-4a1a-9b7c-4dc3abf23696 tempest-VolumesSnapshotTestJSON-1431891046 None] Flow 'volume_create_manager' (0895abae-4d03-49cd-847b-7ee942a6cc12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:37:43 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-3705c2f7-c939-4a1a-9b7c-4dc3abf23696 tempest-VolumesSnapshotTestJSON-1431891046 None] Created volume successfully. Nov 03 07:37:43 devstack sudo[97845]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:43 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b0e1f442-fcbd-405e-a767-6fe66418d2cd tempest-AttachVolumeNegativeTest-376242003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-25386aa5-945f-4f69-9b1a-cae9c027fc04" returned: 0 in 0.492s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:43 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-b0e1f442-fcbd-405e-a767-6fe66418d2cd tempest-AttachVolumeNegativeTest-376242003 None] Lock "cinder-quobyte-25386aa5-945f-4f69-9b1a-cae9c027fc04" released by "delete_volume" :: held 1.448s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:37:44 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a972be70-dec3-4517-b33b-4a01e3bcaf49 tempest-VolumesSnapshotTestJSON-1431891046 None] Acquiring lock "cinder-2861edc4-8ce8-4ee9-b423-a006cb410cd9-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:37:44 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-b0e1f442-fcbd-405e-a767-6fe66418d2cd tempest-AttachVolumeNegativeTest-376242003 None] Created reservations ['1fefef2e-0d30-4b86-82a9-2aac1da2632b', '31af09d4-566b-4a52-8451-4cd652f2eb6f', '6e1d384e-f62c-4153-89a2-f6fdf2e9a1f7', '237718df-a82c-498a-9309-9757cc59f4c6'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:37:44 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a972be70-dec3-4517-b33b-4a01e3bcaf49 tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "cinder-2861edc4-8ce8-4ee9-b423-a006cb410cd9-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:37:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b0e1f442-fcbd-405e-a767-6fe66418d2cd tempest-AttachVolumeNegativeTest-376242003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:37:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b0e1f442-fcbd-405e-a767-6fe66418d2cd tempest-AttachVolumeNegativeTest-376242003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:37:44 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b0e1f442-fcbd-405e-a767-6fe66418d2cd tempest-AttachVolumeNegativeTest-376242003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:37:44 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b0e1f442-fcbd-405e-a767-6fe66418d2cd tempest-AttachVolumeNegativeTest-376242003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:37:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b0e1f442-fcbd-405e-a767-6fe66418d2cd tempest-AttachVolumeNegativeTest-376242003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:37:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b0e1f442-fcbd-405e-a767-6fe66418d2cd tempest-AttachVolumeNegativeTest-376242003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:44 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a972be70-dec3-4517-b33b-4a01e3bcaf49 tempest-VolumesSnapshotTestJSON-1431891046 None] Acquiring lock "cinder-quobyte-2861edc4-8ce8-4ee9-b423-a006cb410cd9" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:37:44 devstack sudo[97848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:37:44 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a972be70-dec3-4517-b33b-4a01e3bcaf49 tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "cinder-quobyte-2861edc4-8ce8-4ee9-b423-a006cb410cd9" acquired by "delete_volume" :: waited 0.018s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:37:44 devstack sudo[97848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:44 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a3f696-c409-4a1f-8033-c690c6b3dce8]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:37:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a972be70-dec3-4517-b33b-4a01e3bcaf49 tempest-VolumesSnapshotTestJSON-1431891046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2861edc4-8ce8-4ee9-b423-a006cb410cd9 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:44 devstack sudo[97850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2861edc4-8ce8-4ee9-b423-a006cb410cd9 Nov 03 07:37:44 devstack sudo[97850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:44 devstack sudo[97848]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b0e1f442-fcbd-405e-a767-6fe66418d2cd tempest-AttachVolumeNegativeTest-376242003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.331s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:44 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-b0e1f442-fcbd-405e-a767-6fe66418d2cd tempest-AttachVolumeNegativeTest-376242003 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:37:44 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-b0e1f442-fcbd-405e-a767-6fe66418d2cd tempest-AttachVolumeNegativeTest-376242003 None] Deleted volume successfully. Nov 03 07:37:44 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-b0e1f442-fcbd-405e-a767-6fe66418d2cd tempest-AttachVolumeNegativeTest-376242003 None] Lock "cinder-25386aa5-945f-4f69-9b1a-cae9c027fc04-delete_volume" released by "delete_volume" :: held 2.264s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:37:44 devstack sudo[97850]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a972be70-dec3-4517-b33b-4a01e3bcaf49 tempest-VolumesSnapshotTestJSON-1431891046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2861edc4-8ce8-4ee9-b423-a006cb410cd9" returned: 0 in 0.547s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a972be70-dec3-4517-b33b-4a01e3bcaf49 tempest-VolumesSnapshotTestJSON-1431891046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2861edc4-8ce8-4ee9-b423-a006cb410cd9 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:44 devstack sudo[97856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2861edc4-8ce8-4ee9-b423-a006cb410cd9 Nov 03 07:37:44 devstack sudo[97856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:45 devstack sudo[97856]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a972be70-dec3-4517-b33b-4a01e3bcaf49 tempest-VolumesSnapshotTestJSON-1431891046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2861edc4-8ce8-4ee9-b423-a006cb410cd9" returned: 0 in 0.411s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:45 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a972be70-dec3-4517-b33b-4a01e3bcaf49 tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "cinder-quobyte-2861edc4-8ce8-4ee9-b423-a006cb410cd9" released by "delete_volume" :: held 1.042s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:37:45 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-a972be70-dec3-4517-b33b-4a01e3bcaf49 tempest-VolumesSnapshotTestJSON-1431891046 None] Created reservations ['e86021f9-3605-4c7e-b58e-f3c8c78d2692', 'eca0eb6d-dc48-45b5-9a9f-88f050dfb843', 'f8d610a3-0ce4-45a6-9989-4e9f29677fca', 'ba0329d2-5f6d-4d0e-b29f-cc2a72e155af'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:37:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a972be70-dec3-4517-b33b-4a01e3bcaf49 tempest-VolumesSnapshotTestJSON-1431891046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:37:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a972be70-dec3-4517-b33b-4a01e3bcaf49 tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:37:45 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a972be70-dec3-4517-b33b-4a01e3bcaf49 tempest-VolumesSnapshotTestJSON-1431891046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:37:45 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a972be70-dec3-4517-b33b-4a01e3bcaf49 tempest-VolumesSnapshotTestJSON-1431891046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:37:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a972be70-dec3-4517-b33b-4a01e3bcaf49 tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:37:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a972be70-dec3-4517-b33b-4a01e3bcaf49 tempest-VolumesSnapshotTestJSON-1431891046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:45 devstack sudo[97859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:37:45 devstack sudo[97859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:45 devstack sudo[97859]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a972be70-dec3-4517-b33b-4a01e3bcaf49 tempest-VolumesSnapshotTestJSON-1431891046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.327s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:45 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-a972be70-dec3-4517-b33b-4a01e3bcaf49 tempest-VolumesSnapshotTestJSON-1431891046 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:37:45 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-a972be70-dec3-4517-b33b-4a01e3bcaf49 tempest-VolumesSnapshotTestJSON-1431891046 None] Deleted volume successfully. Nov 03 07:37:45 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a972be70-dec3-4517-b33b-4a01e3bcaf49 tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "cinder-2861edc4-8ce8-4ee9-b423-a006cb410cd9-delete_volume" released by "delete_volume" :: held 1.883s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:37:46 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d7b3d61f-4f8b-4048-8d78-a69e300bc211 tempest-VolumesSnapshotTestJSON-1431891046 None] Acquiring lock "cinder-af9cd81b-34b2-4004-89a1-37c4d652829e-delete_snapshot" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:37:46 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d7b3d61f-4f8b-4048-8d78-a69e300bc211 tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "cinder-af9cd81b-34b2-4004-89a1-37c4d652829e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:37:46 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d7b3d61f-4f8b-4048-8d78-a69e300bc211 tempest-VolumesSnapshotTestJSON-1431891046 None] Acquiring lock "cinder-quobyte-cf9880a3-f130-41f5-8761-e2c726642bce" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:37:46 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d7b3d61f-4f8b-4048-8d78-a69e300bc211 tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "cinder-quobyte-cf9880a3-f130-41f5-8761-e2c726642bce" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:37:46 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d7b3d61f-4f8b-4048-8d78-a69e300bc211 tempest-VolumesSnapshotTestJSON-1431891046 None] Acquiring lock "cinder-quobyte-af9cd81b-34b2-4004-89a1-37c4d652829e" by "_delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:37:46 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d7b3d61f-4f8b-4048-8d78-a69e300bc211 tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "cinder-quobyte-af9cd81b-34b2-4004-89a1-37c4d652829e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:37:46 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-d7b3d61f-4f8b-4048-8d78-a69e300bc211 tempest-VolumesSnapshotTestJSON-1431891046 None] Deleting offline snapshot af9cd81b-34b2-4004-89a1-37c4d652829e of volume cf9880a3-f130-41f5-8761-e2c726642bce {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:37:46 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-d7b3d61f-4f8b-4048-8d78-a69e300bc211 tempest-VolumesSnapshotTestJSON-1431891046 None] snapshot_file for this snap is: volume-cf9880a3-f130-41f5-8761-e2c726642bce.af9cd81b-34b2-4004-89a1-37c4d652829e {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:37:46 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[97afca3f-9256-4324-acb2-2557815f788d]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:37:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d7b3d61f-4f8b-4048-8d78-a69e300bc211 tempest-VolumesSnapshotTestJSON-1431891046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf9880a3-f130-41f5-8761-e2c726642bce.af9cd81b-34b2-4004-89a1-37c4d652829e {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:46 devstack sudo[97863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf9880a3-f130-41f5-8761-e2c726642bce.af9cd81b-34b2-4004-89a1-37c4d652829e Nov 03 07:37:46 devstack sudo[97863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:47 devstack sudo[97863]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:47 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d7b3d61f-4f8b-4048-8d78-a69e300bc211 tempest-VolumesSnapshotTestJSON-1431891046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf9880a3-f130-41f5-8761-e2c726642bce.af9cd81b-34b2-4004-89a1-37c4d652829e" returned: 0 in 0.546s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:47 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-d7b3d61f-4f8b-4048-8d78-a69e300bc211 tempest-VolumesSnapshotTestJSON-1431891046 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf9880a3-f130-41f5-8761-e2c726642bce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:37:47 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3af5c1f-a312-4c9b-a212-7ae810d274ce]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:37:47 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d7b3d61f-4f8b-4048-8d78-a69e300bc211 tempest-VolumesSnapshotTestJSON-1431891046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf9880a3-f130-41f5-8761-e2c726642bce {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:47 devstack sudo[97870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf9880a3-f130-41f5-8761-e2c726642bce Nov 03 07:37:47 devstack sudo[97870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:47 devstack sudo[97870]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:47 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d7b3d61f-4f8b-4048-8d78-a69e300bc211 tempest-VolumesSnapshotTestJSON-1431891046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf9880a3-f130-41f5-8761-e2c726642bce" returned: 0 in 0.742s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:47 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d7b3d61f-4f8b-4048-8d78-a69e300bc211 tempest-VolumesSnapshotTestJSON-1431891046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf9880a3-f130-41f5-8761-e2c726642bce.af9cd81b-34b2-4004-89a1-37c4d652829e {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:47 devstack sudo[97876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf9880a3-f130-41f5-8761-e2c726642bce.af9cd81b-34b2-4004-89a1-37c4d652829e Nov 03 07:37:47 devstack sudo[97876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:48 devstack sudo[97876]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d7b3d61f-4f8b-4048-8d78-a69e300bc211 tempest-VolumesSnapshotTestJSON-1431891046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf9880a3-f130-41f5-8761-e2c726642bce.af9cd81b-34b2-4004-89a1-37c4d652829e" returned: 0 in 0.477s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d7b3d61f-4f8b-4048-8d78-a69e300bc211 tempest-VolumesSnapshotTestJSON-1431891046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf9880a3-f130-41f5-8761-e2c726642bce.af9cd81b-34b2-4004-89a1-37c4d652829e {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:48 devstack sudo[97882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf9880a3-f130-41f5-8761-e2c726642bce.af9cd81b-34b2-4004-89a1-37c4d652829e Nov 03 07:37:48 devstack sudo[97882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:48 devstack sudo[97882]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d7b3d61f-4f8b-4048-8d78-a69e300bc211 tempest-VolumesSnapshotTestJSON-1431891046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf9880a3-f130-41f5-8761-e2c726642bce.af9cd81b-34b2-4004-89a1-37c4d652829e" returned: 0 in 0.370s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:48 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d7b3d61f-4f8b-4048-8d78-a69e300bc211 tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "cinder-quobyte-af9cd81b-34b2-4004-89a1-37c4d652829e" released by "_delete_snapshot" :: held 2.315s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:37:48 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d7b3d61f-4f8b-4048-8d78-a69e300bc211 tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "cinder-quobyte-cf9880a3-f130-41f5-8761-e2c726642bce" released by "delete_snapshot" :: held 2.343s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:37:48 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-d7b3d61f-4f8b-4048-8d78-a69e300bc211 tempest-VolumesSnapshotTestJSON-1431891046 None] Created reservations ['5567c739-f068-4bdc-9299-4278df8772a4', 'a114b8f5-d7fc-466b-bb52-a54e88f3fde0', '59980f6a-ff44-4760-8ec8-e194d34dd43e', 'f76936e5-8920-4429-b78c-357f9d1da239'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:37:49 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-d7b3d61f-4f8b-4048-8d78-a69e300bc211 tempest-VolumesSnapshotTestJSON-1431891046 None] Delete snapshot completed successfully. Nov 03 07:37:49 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d7b3d61f-4f8b-4048-8d78-a69e300bc211 tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "cinder-af9cd81b-34b2-4004-89a1-37c4d652829e-delete_snapshot" released by "delete_snapshot" :: held 2.540s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:37:49 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-e679302d-0444-47f0-ac42-62ef958c40f2 tempest-VolumesSnapshotTestJSON-1431891046 None] Acquiring lock "cinder-cf9880a3-f130-41f5-8761-e2c726642bce-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:37:49 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-e679302d-0444-47f0-ac42-62ef958c40f2 tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "cinder-cf9880a3-f130-41f5-8761-e2c726642bce-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:37:50 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-e679302d-0444-47f0-ac42-62ef958c40f2 tempest-VolumesSnapshotTestJSON-1431891046 None] Acquiring lock "cinder-quobyte-cf9880a3-f130-41f5-8761-e2c726642bce" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:37:50 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-e679302d-0444-47f0-ac42-62ef958c40f2 tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "cinder-quobyte-cf9880a3-f130-41f5-8761-e2c726642bce" acquired by "delete_volume" :: waited 0.020s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:37:50 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[0434e799-0024-45e8-8965-a3fb37820d09]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:37:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e679302d-0444-47f0-ac42-62ef958c40f2 tempest-VolumesSnapshotTestJSON-1431891046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf9880a3-f130-41f5-8761-e2c726642bce {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:50 devstack sudo[97885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf9880a3-f130-41f5-8761-e2c726642bce Nov 03 07:37:50 devstack sudo[97885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:50 devstack sudo[97885]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e679302d-0444-47f0-ac42-62ef958c40f2 tempest-VolumesSnapshotTestJSON-1431891046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf9880a3-f130-41f5-8761-e2c726642bce" returned: 0 in 0.530s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e679302d-0444-47f0-ac42-62ef958c40f2 tempest-VolumesSnapshotTestJSON-1431891046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf9880a3-f130-41f5-8761-e2c726642bce {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:50 devstack sudo[97891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf9880a3-f130-41f5-8761-e2c726642bce Nov 03 07:37:50 devstack sudo[97891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:50 devstack sudo[97891]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e679302d-0444-47f0-ac42-62ef958c40f2 tempest-VolumesSnapshotTestJSON-1431891046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf9880a3-f130-41f5-8761-e2c726642bce" returned: 0 in 0.326s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:51 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-e679302d-0444-47f0-ac42-62ef958c40f2 tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "cinder-quobyte-cf9880a3-f130-41f5-8761-e2c726642bce" released by "delete_volume" :: held 0.985s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:37:51 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-e679302d-0444-47f0-ac42-62ef958c40f2 tempest-VolumesSnapshotTestJSON-1431891046 None] Created reservations ['22048164-d837-479f-b6d4-17c8c2f4b6d9', 'bb0704d6-b8bc-405d-94db-e27b964858ff', '7cb3b96a-faf8-49d2-9c9b-3a8352e2906a', 'dddee1df-3577-491f-b962-f71d7ad1baf3'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:37:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e679302d-0444-47f0-ac42-62ef958c40f2 tempest-VolumesSnapshotTestJSON-1431891046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:37:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e679302d-0444-47f0-ac42-62ef958c40f2 tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:37:51 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-e679302d-0444-47f0-ac42-62ef958c40f2 tempest-VolumesSnapshotTestJSON-1431891046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:37:51 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-e679302d-0444-47f0-ac42-62ef958c40f2 tempest-VolumesSnapshotTestJSON-1431891046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:37:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e679302d-0444-47f0-ac42-62ef958c40f2 tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:37:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e679302d-0444-47f0-ac42-62ef958c40f2 tempest-VolumesSnapshotTestJSON-1431891046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:51 devstack sudo[97895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:37:51 devstack sudo[97895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:51 devstack sudo[97895]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e679302d-0444-47f0-ac42-62ef958c40f2 tempest-VolumesSnapshotTestJSON-1431891046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.394s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:51 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-e679302d-0444-47f0-ac42-62ef958c40f2 tempest-VolumesSnapshotTestJSON-1431891046 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:37:51 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-e679302d-0444-47f0-ac42-62ef958c40f2 tempest-VolumesSnapshotTestJSON-1431891046 None] Deleted volume successfully. Nov 03 07:37:51 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-e679302d-0444-47f0-ac42-62ef958c40f2 tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "cinder-cf9880a3-f130-41f5-8761-e2c726642bce-delete_volume" released by "delete_volume" :: held 1.768s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:37:52 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-683dcd47-d7fc-4386-a45f-df72e57cbcc1 tempest-VolumesSnapshotTestJSON-1431891046 None] Acquiring lock "cinder-72425850-6981-4edc-b5b8-9b0b46417a12-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:37:52 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-683dcd47-d7fc-4386-a45f-df72e57cbcc1 tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "cinder-72425850-6981-4edc-b5b8-9b0b46417a12-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:37:52 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-683dcd47-d7fc-4386-a45f-df72e57cbcc1 tempest-VolumesSnapshotTestJSON-1431891046 None] Acquiring lock "cinder-quobyte-72425850-6981-4edc-b5b8-9b0b46417a12" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:37:52 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-683dcd47-d7fc-4386-a45f-df72e57cbcc1 tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "cinder-quobyte-72425850-6981-4edc-b5b8-9b0b46417a12" acquired by "delete_volume" :: waited 0.027s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:37:52 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a8bca9-1633-4c8d-85d1-1b8a2f851836]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:37:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-683dcd47-d7fc-4386-a45f-df72e57cbcc1 tempest-VolumesSnapshotTestJSON-1431891046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72425850-6981-4edc-b5b8-9b0b46417a12 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:52 devstack sudo[97898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72425850-6981-4edc-b5b8-9b0b46417a12 Nov 03 07:37:52 devstack sudo[97898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:53 devstack sudo[97898]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-683dcd47-d7fc-4386-a45f-df72e57cbcc1 tempest-VolumesSnapshotTestJSON-1431891046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72425850-6981-4edc-b5b8-9b0b46417a12" returned: 0 in 0.452s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-683dcd47-d7fc-4386-a45f-df72e57cbcc1 tempest-VolumesSnapshotTestJSON-1431891046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72425850-6981-4edc-b5b8-9b0b46417a12 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:53 devstack sudo[97903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72425850-6981-4edc-b5b8-9b0b46417a12 Nov 03 07:37:53 devstack sudo[97903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:53 devstack sudo[97903]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-683dcd47-d7fc-4386-a45f-df72e57cbcc1 tempest-VolumesSnapshotTestJSON-1431891046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72425850-6981-4edc-b5b8-9b0b46417a12" returned: 0 in 0.321s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:53 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-683dcd47-d7fc-4386-a45f-df72e57cbcc1 tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "cinder-quobyte-72425850-6981-4edc-b5b8-9b0b46417a12" released by "delete_volume" :: held 0.895s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:37:53 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-683dcd47-d7fc-4386-a45f-df72e57cbcc1 tempest-VolumesSnapshotTestJSON-1431891046 None] Created reservations ['94b9a5be-fed7-4a59-8452-5275196c1708', '514d9f22-58b5-45c2-8bd5-13b3477d8bad', '8cc8bb94-d3af-4be6-9525-02b3d34306e0', '0ee6ad45-f3e4-4108-b9bf-c163c1e30f5a'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:37:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-683dcd47-d7fc-4386-a45f-df72e57cbcc1 tempest-VolumesSnapshotTestJSON-1431891046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:37:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-683dcd47-d7fc-4386-a45f-df72e57cbcc1 tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:37:53 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-683dcd47-d7fc-4386-a45f-df72e57cbcc1 tempest-VolumesSnapshotTestJSON-1431891046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:37:53 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-683dcd47-d7fc-4386-a45f-df72e57cbcc1 tempest-VolumesSnapshotTestJSON-1431891046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:37:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-683dcd47-d7fc-4386-a45f-df72e57cbcc1 tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:37:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-683dcd47-d7fc-4386-a45f-df72e57cbcc1 tempest-VolumesSnapshotTestJSON-1431891046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:53 devstack sudo[97906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:37:53 devstack sudo[97906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:53 devstack sudo[97906]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-683dcd47-d7fc-4386-a45f-df72e57cbcc1 tempest-VolumesSnapshotTestJSON-1431891046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.287s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:53 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-683dcd47-d7fc-4386-a45f-df72e57cbcc1 tempest-VolumesSnapshotTestJSON-1431891046 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:37:53 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-683dcd47-d7fc-4386-a45f-df72e57cbcc1 tempest-VolumesSnapshotTestJSON-1431891046 None] Deleted volume successfully. Nov 03 07:37:54 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-683dcd47-d7fc-4386-a45f-df72e57cbcc1 tempest-VolumesSnapshotTestJSON-1431891046 None] Lock "cinder-72425850-6981-4edc-b5b8-9b0b46417a12-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:37:54 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-96610668-0c54-41c5-89d8-645c94f00433 tempest-AttachVolumeShelveTestJSON-717092369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:37:55 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-96610668-0c54-41c5-89d8-645c94f00433 tempest-AttachVolumeShelveTestJSON-717092369 None] Flow 'volume_create_manager' (c24cc030-2d06-42a3-b9c7-64294607c8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:37:55 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-96610668-0c54-41c5-89d8-645c94f00433 tempest-AttachVolumeShelveTestJSON-717092369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e7bff36-8dd1-4af1-9ad3-3c2ab0a4f787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:55 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-96610668-0c54-41c5-89d8-645c94f00433 tempest-AttachVolumeShelveTestJSON-717092369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e7bff36-8dd1-4af1-9ad3-3c2ab0a4f787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:37:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2120348100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=982b59ef-ef75-44f8-b28e-c0bf1a0811d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8dd8bac2b46478b9474abc56a19a92f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:37:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:37:55Z,use_quota=True,user_id='acfe3336e29d45178517a0f39a98552b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:55 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-96610668-0c54-41c5-89d8-645c94f00433 tempest-AttachVolumeShelveTestJSON-717092369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ded6ef2a-ca20-49b6-b0d5-f27447766912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:55 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-96610668-0c54-41c5-89d8-645c94f00433 tempest-AttachVolumeShelveTestJSON-717092369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ded6ef2a-ca20-49b6-b0d5-f27447766912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:55 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-96610668-0c54-41c5-89d8-645c94f00433 tempest-AttachVolumeShelveTestJSON-717092369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a20bd69-845d-4d58-883e-7668805e76e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:55 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-96610668-0c54-41c5-89d8-645c94f00433 tempest-AttachVolumeShelveTestJSON-717092369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a20bd69-845d-4d58-883e-7668805e76e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '982b59ef-ef75-44f8-b28e-c0bf1a0811d2', 'volume_name': 'volume-982b59ef-ef75-44f8-b28e-c0bf1a0811d2', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:55 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-96610668-0c54-41c5-89d8-645c94f00433 tempest-AttachVolumeShelveTestJSON-717092369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f25a6d8-8769-4484-ac72-7346dcab3c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:55 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-96610668-0c54-41c5-89d8-645c94f00433 tempest-AttachVolumeShelveTestJSON-717092369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f25a6d8-8769-4484-ac72-7346dcab3c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:55 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-96610668-0c54-41c5-89d8-645c94f00433 tempest-AttachVolumeShelveTestJSON-717092369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91a65fd5-8564-4b0b-b52f-d1e054a88d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:55 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-96610668-0c54-41c5-89d8-645c94f00433 tempest-AttachVolumeShelveTestJSON-717092369 None] Volume 982b59ef-ef75-44f8-b28e-c0bf1a0811d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-982b59ef-ef75-44f8-b28e-c0bf1a0811d2', 'volume_size': 1} Nov 03 07:37:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-96610668-0c54-41c5-89d8-645c94f00433 tempest-AttachVolumeShelveTestJSON-717092369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:37:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-96610668-0c54-41c5-89d8-645c94f00433 tempest-AttachVolumeShelveTestJSON-717092369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:37:55 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-96610668-0c54-41c5-89d8-645c94f00433 tempest-AttachVolumeShelveTestJSON-717092369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:37:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2120348100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=982b59ef-ef75-44f8-b28e-c0bf1a0811d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8dd8bac2b46478b9474abc56a19a92f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:37:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:37:55Z,use_quota=True,user_id='acfe3336e29d45178517a0f39a98552b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:37:55 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-96610668-0c54-41c5-89d8-645c94f00433 tempest-AttachVolumeShelveTestJSON-717092369 None] Creating volume 982b59ef-ef75-44f8-b28e-c0bf1a0811d2 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:37:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-96610668-0c54-41c5-89d8-645c94f00433 tempest-AttachVolumeShelveTestJSON-717092369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:37:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-96610668-0c54-41c5-89d8-645c94f00433 tempest-AttachVolumeShelveTestJSON-717092369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:37:55 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-96610668-0c54-41c5-89d8-645c94f00433 tempest-AttachVolumeShelveTestJSON-717092369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:37:55 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-96610668-0c54-41c5-89d8-645c94f00433 tempest-AttachVolumeShelveTestJSON-717092369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:37:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-96610668-0c54-41c5-89d8-645c94f00433 tempest-AttachVolumeShelveTestJSON-717092369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:37:55 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-96610668-0c54-41c5-89d8-645c94f00433 tempest-AttachVolumeShelveTestJSON-717092369 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:37:55 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-96610668-0c54-41c5-89d8-645c94f00433 tempest-AttachVolumeShelveTestJSON-717092369 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:37:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-96610668-0c54-41c5-89d8-645c94f00433 tempest-AttachVolumeShelveTestJSON-717092369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-982b59ef-ef75-44f8-b28e-c0bf1a0811d2 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:55 devstack sudo[97911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-982b59ef-ef75-44f8-b28e-c0bf1a0811d2 1073741824 Nov 03 07:37:55 devstack sudo[97911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:55 devstack sudo[97911]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-96610668-0c54-41c5-89d8-645c94f00433 tempest-AttachVolumeShelveTestJSON-717092369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-982b59ef-ef75-44f8-b28e-c0bf1a0811d2 1073741824" returned: 0 in 0.750s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-96610668-0c54-41c5-89d8-645c94f00433 tempest-AttachVolumeShelveTestJSON-717092369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-982b59ef-ef75-44f8-b28e-c0bf1a0811d2 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:55 devstack sudo[97917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-982b59ef-ef75-44f8-b28e-c0bf1a0811d2 Nov 03 07:37:55 devstack sudo[97917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:56 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [req-e8fa6e41-cc6a-4518-a0b2-8cd7ea06c01e req-ad034f66-f16a-4b59-bd30-021286067611 tempest-VolumesSnapshotsTestJSON-1414188776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:37:56 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-e8fa6e41-cc6a-4518-a0b2-8cd7ea06c01e req-ad034f66-f16a-4b59-bd30-021286067611 tempest-VolumesSnapshotsTestJSON-1414188776 None] Flow 'volume_create_manager' (57143c39-0c84-414e-a155-c74b7651e9d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:37:56 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-e8fa6e41-cc6a-4518-a0b2-8cd7ea06c01e req-ad034f66-f16a-4b59-bd30-021286067611 tempest-VolumesSnapshotsTestJSON-1414188776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (944f7cda-d9c3-4a60-8cb9-63451bf1058e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:56 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-e8fa6e41-cc6a-4518-a0b2-8cd7ea06c01e req-ad034f66-f16a-4b59-bd30-021286067611 tempest-VolumesSnapshotsTestJSON-1414188776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (944f7cda-d9c3-4a60-8cb9-63451bf1058e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:37:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2063165471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d141238-50c3-47ac-84d0-3ccb75a28cff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7002055651fd47d9baf75f82d8217416',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:37:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:37:56Z,use_quota=True,user_id='c61452a95c974f0390f80f4cf4ef605e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:56 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-e8fa6e41-cc6a-4518-a0b2-8cd7ea06c01e req-ad034f66-f16a-4b59-bd30-021286067611 tempest-VolumesSnapshotsTestJSON-1414188776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (177bdaae-81d0-4a08-879c-a4a99699d38d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:56 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-e8fa6e41-cc6a-4518-a0b2-8cd7ea06c01e req-ad034f66-f16a-4b59-bd30-021286067611 tempest-VolumesSnapshotsTestJSON-1414188776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (177bdaae-81d0-4a08-879c-a4a99699d38d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:56 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-e8fa6e41-cc6a-4518-a0b2-8cd7ea06c01e req-ad034f66-f16a-4b59-bd30-021286067611 tempest-VolumesSnapshotsTestJSON-1414188776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab96e2ab-5bce-4269-bd1f-83ef1cc1ef0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:56 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-e8fa6e41-cc6a-4518-a0b2-8cd7ea06c01e req-ad034f66-f16a-4b59-bd30-021286067611 tempest-VolumesSnapshotsTestJSON-1414188776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab96e2ab-5bce-4269-bd1f-83ef1cc1ef0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d141238-50c3-47ac-84d0-3ccb75a28cff', 'volume_name': 'volume-0d141238-50c3-47ac-84d0-3ccb75a28cff', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:56 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-e8fa6e41-cc6a-4518-a0b2-8cd7ea06c01e req-ad034f66-f16a-4b59-bd30-021286067611 tempest-VolumesSnapshotsTestJSON-1414188776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e82accf-47cb-45ed-9eed-4a3bb94be507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:56 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-e8fa6e41-cc6a-4518-a0b2-8cd7ea06c01e req-ad034f66-f16a-4b59-bd30-021286067611 tempest-VolumesSnapshotsTestJSON-1414188776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e82accf-47cb-45ed-9eed-4a3bb94be507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:56 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-e8fa6e41-cc6a-4518-a0b2-8cd7ea06c01e req-ad034f66-f16a-4b59-bd30-021286067611 tempest-VolumesSnapshotsTestJSON-1414188776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d059f41-e366-492c-827f-b9b92a9bddf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:56 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [req-e8fa6e41-cc6a-4518-a0b2-8cd7ea06c01e req-ad034f66-f16a-4b59-bd30-021286067611 tempest-VolumesSnapshotsTestJSON-1414188776 None] Volume 0d141238-50c3-47ac-84d0-3ccb75a28cff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d141238-50c3-47ac-84d0-3ccb75a28cff', 'volume_size': 1} Nov 03 07:37:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-e8fa6e41-cc6a-4518-a0b2-8cd7ea06c01e req-ad034f66-f16a-4b59-bd30-021286067611 tempest-VolumesSnapshotsTestJSON-1414188776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:37:56 devstack sudo[97917]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-96610668-0c54-41c5-89d8-645c94f00433 tempest-AttachVolumeShelveTestJSON-717092369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-982b59ef-ef75-44f8-b28e-c0bf1a0811d2" returned: 0 in 0.339s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:56 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-96610668-0c54-41c5-89d8-645c94f00433 tempest-AttachVolumeShelveTestJSON-717092369 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:37:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-96610668-0c54-41c5-89d8-645c94f00433 tempest-AttachVolumeShelveTestJSON-717092369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:37:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-e8fa6e41-cc6a-4518-a0b2-8cd7ea06c01e req-ad034f66-f16a-4b59-bd30-021286067611 tempest-VolumesSnapshotsTestJSON-1414188776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.036s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:37:56 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [req-e8fa6e41-cc6a-4518-a0b2-8cd7ea06c01e req-ad034f66-f16a-4b59-bd30-021286067611 tempest-VolumesSnapshotsTestJSON-1414188776 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:37:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2063165471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d141238-50c3-47ac-84d0-3ccb75a28cff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7002055651fd47d9baf75f82d8217416',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:37:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:37:56Z,use_quota=True,user_id='c61452a95c974f0390f80f4cf4ef605e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:37:56 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [req-e8fa6e41-cc6a-4518-a0b2-8cd7ea06c01e req-ad034f66-f16a-4b59-bd30-021286067611 tempest-VolumesSnapshotsTestJSON-1414188776 None] Creating volume 0d141238-50c3-47ac-84d0-3ccb75a28cff {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:37:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-e8fa6e41-cc6a-4518-a0b2-8cd7ea06c01e req-ad034f66-f16a-4b59-bd30-021286067611 tempest-VolumesSnapshotsTestJSON-1414188776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:37:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-e8fa6e41-cc6a-4518-a0b2-8cd7ea06c01e req-ad034f66-f16a-4b59-bd30-021286067611 tempest-VolumesSnapshotsTestJSON-1414188776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:37:56 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [req-e8fa6e41-cc6a-4518-a0b2-8cd7ea06c01e req-ad034f66-f16a-4b59-bd30-021286067611 tempest-VolumesSnapshotsTestJSON-1414188776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:37:56 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [req-e8fa6e41-cc6a-4518-a0b2-8cd7ea06c01e req-ad034f66-f16a-4b59-bd30-021286067611 tempest-VolumesSnapshotsTestJSON-1414188776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:37:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-e8fa6e41-cc6a-4518-a0b2-8cd7ea06c01e req-ad034f66-f16a-4b59-bd30-021286067611 tempest-VolumesSnapshotsTestJSON-1414188776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:37:56 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [req-e8fa6e41-cc6a-4518-a0b2-8cd7ea06c01e req-ad034f66-f16a-4b59-bd30-021286067611 tempest-VolumesSnapshotsTestJSON-1414188776 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:37:56 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [req-e8fa6e41-cc6a-4518-a0b2-8cd7ea06c01e req-ad034f66-f16a-4b59-bd30-021286067611 tempest-VolumesSnapshotsTestJSON-1414188776 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:37:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [req-e8fa6e41-cc6a-4518-a0b2-8cd7ea06c01e req-ad034f66-f16a-4b59-bd30-021286067611 tempest-VolumesSnapshotsTestJSON-1414188776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d141238-50c3-47ac-84d0-3ccb75a28cff 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:56 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-96610668-0c54-41c5-89d8-645c94f00433 tempest-AttachVolumeShelveTestJSON-717092369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91a65fd5-8564-4b0b-b52f-d1e054a88d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-982b59ef-ef75-44f8-b28e-c0bf1a0811d2', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:56 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-96610668-0c54-41c5-89d8-645c94f00433 tempest-AttachVolumeShelveTestJSON-717092369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5caff73e-7e3b-4d23-ab22-c59038074433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:56 devstack sudo[97920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d141238-50c3-47ac-84d0-3ccb75a28cff 1073741824 Nov 03 07:37:56 devstack sudo[97920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:56 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-96610668-0c54-41c5-89d8-645c94f00433 tempest-AttachVolumeShelveTestJSON-717092369 None] Volume volume-982b59ef-ef75-44f8-b28e-c0bf1a0811d2 (982b59ef-ef75-44f8-b28e-c0bf1a0811d2): created successfully Nov 03 07:37:56 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-96610668-0c54-41c5-89d8-645c94f00433 tempest-AttachVolumeShelveTestJSON-717092369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5caff73e-7e3b-4d23-ab22-c59038074433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:56 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-96610668-0c54-41c5-89d8-645c94f00433 tempest-AttachVolumeShelveTestJSON-717092369 None] Flow 'volume_create_manager' (c24cc030-2d06-42a3-b9c7-64294607c8f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:37:56 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-96610668-0c54-41c5-89d8-645c94f00433 tempest-AttachVolumeShelveTestJSON-717092369 None] Created volume successfully. Nov 03 07:37:56 devstack sudo[97920]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [req-e8fa6e41-cc6a-4518-a0b2-8cd7ea06c01e req-ad034f66-f16a-4b59-bd30-021286067611 tempest-VolumesSnapshotsTestJSON-1414188776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d141238-50c3-47ac-84d0-3ccb75a28cff 1073741824" returned: 0 in 0.674s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [req-e8fa6e41-cc6a-4518-a0b2-8cd7ea06c01e req-ad034f66-f16a-4b59-bd30-021286067611 tempest-VolumesSnapshotsTestJSON-1414188776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d141238-50c3-47ac-84d0-3ccb75a28cff {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:57 devstack sudo[97928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d141238-50c3-47ac-84d0-3ccb75a28cff Nov 03 07:37:57 devstack sudo[97928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:57 devstack sudo[97928]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [req-e8fa6e41-cc6a-4518-a0b2-8cd7ea06c01e req-ad034f66-f16a-4b59-bd30-021286067611 tempest-VolumesSnapshotsTestJSON-1414188776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d141238-50c3-47ac-84d0-3ccb75a28cff" returned: 0 in 0.389s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:57 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [req-e8fa6e41-cc6a-4518-a0b2-8cd7ea06c01e req-ad034f66-f16a-4b59-bd30-021286067611 tempest-VolumesSnapshotsTestJSON-1414188776 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:37:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-e8fa6e41-cc6a-4518-a0b2-8cd7ea06c01e req-ad034f66-f16a-4b59-bd30-021286067611 tempest-VolumesSnapshotsTestJSON-1414188776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:37:57 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-e8fa6e41-cc6a-4518-a0b2-8cd7ea06c01e req-ad034f66-f16a-4b59-bd30-021286067611 tempest-VolumesSnapshotsTestJSON-1414188776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d059f41-e366-492c-827f-b9b92a9bddf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d141238-50c3-47ac-84d0-3ccb75a28cff', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:57 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-e8fa6e41-cc6a-4518-a0b2-8cd7ea06c01e req-ad034f66-f16a-4b59-bd30-021286067611 tempest-VolumesSnapshotsTestJSON-1414188776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70fbc5f1-04ac-488c-a39f-d42f9b2c10ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:37:57 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [req-e8fa6e41-cc6a-4518-a0b2-8cd7ea06c01e req-ad034f66-f16a-4b59-bd30-021286067611 tempest-VolumesSnapshotsTestJSON-1414188776 None] Volume volume-0d141238-50c3-47ac-84d0-3ccb75a28cff (0d141238-50c3-47ac-84d0-3ccb75a28cff): created successfully Nov 03 07:37:57 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-e8fa6e41-cc6a-4518-a0b2-8cd7ea06c01e req-ad034f66-f16a-4b59-bd30-021286067611 tempest-VolumesSnapshotsTestJSON-1414188776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70fbc5f1-04ac-488c-a39f-d42f9b2c10ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:37:57 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-e8fa6e41-cc6a-4518-a0b2-8cd7ea06c01e req-ad034f66-f16a-4b59-bd30-021286067611 tempest-VolumesSnapshotsTestJSON-1414188776 None] Flow 'volume_create_manager' (57143c39-0c84-414e-a155-c74b7651e9d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:37:57 devstack cinder-volume[86875]: INFO cinder.volume.manager [req-e8fa6e41-cc6a-4518-a0b2-8cd7ea06c01e req-ad034f66-f16a-4b59-bd30-021286067611 tempest-VolumesSnapshotsTestJSON-1414188776 None] Created volume successfully. Nov 03 07:37:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-a3d279a2-5ff0-46c3-b386-4365768fdcc3 req-cf3bc39f-6077-49b0-bd73-d7386a12f72f tempest-VolumesSnapshotsTestJSON-1414188776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:37:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-a3d279a2-5ff0-46c3-b386-4365768fdcc3 req-cf3bc39f-6077-49b0-bd73-d7386a12f72f tempest-VolumesSnapshotsTestJSON-1414188776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:37:58 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [req-a3d279a2-5ff0-46c3-b386-4365768fdcc3 req-cf3bc39f-6077-49b0-bd73-d7386a12f72f tempest-VolumesSnapshotsTestJSON-1414188776 None] Creating offline snapshot 9618cb42-87ce-49c2-b999-47e475b3e2e5 of volume 0d141238-50c3-47ac-84d0-3ccb75a28cff {{(pid=86875) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:37:58 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[073c259f-5b49-466c-8c49-700ceb77cbb9]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:37:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [req-a3d279a2-5ff0-46c3-b386-4365768fdcc3 req-cf3bc39f-6077-49b0-bd73-d7386a12f72f tempest-VolumesSnapshotsTestJSON-1414188776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d141238-50c3-47ac-84d0-3ccb75a28cff {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:59 devstack sudo[97938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d141238-50c3-47ac-84d0-3ccb75a28cff Nov 03 07:37:59 devstack sudo[97938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:37:59 devstack sudo[97938]: pam_unix(sudo:session): session closed for user root Nov 03 07:37:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [req-a3d279a2-5ff0-46c3-b386-4365768fdcc3 req-cf3bc39f-6077-49b0-bd73-d7386a12f72f tempest-VolumesSnapshotsTestJSON-1414188776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d141238-50c3-47ac-84d0-3ccb75a28cff" returned: 0 in 0.591s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:37:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [req-a3d279a2-5ff0-46c3-b386-4365768fdcc3 req-cf3bc39f-6077-49b0-bd73-d7386a12f72f tempest-VolumesSnapshotsTestJSON-1414188776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d141238-50c3-47ac-84d0-3ccb75a28cff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d141238-50c3-47ac-84d0-3ccb75a28cff.9618cb42-87ce-49c2-b999-47e475b3e2e5 1G {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:37:59 devstack sudo[97949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d141238-50c3-47ac-84d0-3ccb75a28cff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d141238-50c3-47ac-84d0-3ccb75a28cff.9618cb42-87ce-49c2-b999-47e475b3e2e5 1G Nov 03 07:37:59 devstack sudo[97949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:00 devstack sudo[97949]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [req-a3d279a2-5ff0-46c3-b386-4365768fdcc3 req-cf3bc39f-6077-49b0-bd73-d7386a12f72f tempest-VolumesSnapshotsTestJSON-1414188776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d141238-50c3-47ac-84d0-3ccb75a28cff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d141238-50c3-47ac-84d0-3ccb75a28cff.9618cb42-87ce-49c2-b999-47e475b3e2e5 1G" returned: 0 in 0.839s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [req-a3d279a2-5ff0-46c3-b386-4365768fdcc3 req-cf3bc39f-6077-49b0-bd73-d7386a12f72f tempest-VolumesSnapshotsTestJSON-1414188776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d141238-50c3-47ac-84d0-3ccb75a28cff -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d141238-50c3-47ac-84d0-3ccb75a28cff.9618cb42-87ce-49c2-b999-47e475b3e2e5 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:00 devstack sudo[97962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d141238-50c3-47ac-84d0-3ccb75a28cff -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d141238-50c3-47ac-84d0-3ccb75a28cff.9618cb42-87ce-49c2-b999-47e475b3e2e5 Nov 03 07:38:00 devstack sudo[97962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:00 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-7455c79c-736e-4464-bc30-68fcd72f675e tempest-TestServerVolumeAttachmentScenario-550494203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:38:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7455c79c-736e-4464-bc30-68fcd72f675e tempest-TestServerVolumeAttachmentScenario-550494203 None] Flow 'volume_create_manager' (0446d561-997c-4596-9ccf-079ed96aac8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:38:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7455c79c-736e-4464-bc30-68fcd72f675e tempest-TestServerVolumeAttachmentScenario-550494203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3135c6d2-a9ad-420f-9c58-10ef913f9082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7455c79c-736e-4464-bc30-68fcd72f675e tempest-TestServerVolumeAttachmentScenario-550494203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3135c6d2-a9ad-420f-9c58-10ef913f9082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:38:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2043523909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=291939ff-7368-47d5-a122-0a0d083c8a67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c54e3a3aa1f44145b2518e3727e5dab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:38:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:38:00Z,use_quota=True,user_id='70e994010cd9498d8a441a56478d8653',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7455c79c-736e-4464-bc30-68fcd72f675e tempest-TestServerVolumeAttachmentScenario-550494203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (349a3d9c-7a9f-405b-9700-6d274c23d8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7455c79c-736e-4464-bc30-68fcd72f675e tempest-TestServerVolumeAttachmentScenario-550494203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (349a3d9c-7a9f-405b-9700-6d274c23d8c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7455c79c-736e-4464-bc30-68fcd72f675e tempest-TestServerVolumeAttachmentScenario-550494203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e304ab5f-5ef6-486c-bcc6-4e4d8db6233f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7455c79c-736e-4464-bc30-68fcd72f675e tempest-TestServerVolumeAttachmentScenario-550494203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e304ab5f-5ef6-486c-bcc6-4e4d8db6233f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '291939ff-7368-47d5-a122-0a0d083c8a67', 'volume_name': 'volume-291939ff-7368-47d5-a122-0a0d083c8a67', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7455c79c-736e-4464-bc30-68fcd72f675e tempest-TestServerVolumeAttachmentScenario-550494203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cda6918-05e7-4aba-b8b4-4851ccb464c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7455c79c-736e-4464-bc30-68fcd72f675e tempest-TestServerVolumeAttachmentScenario-550494203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cda6918-05e7-4aba-b8b4-4851ccb464c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7455c79c-736e-4464-bc30-68fcd72f675e tempest-TestServerVolumeAttachmentScenario-550494203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ad1f075-d106-4a2f-ab43-30fe8a994db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:00 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-7455c79c-736e-4464-bc30-68fcd72f675e tempest-TestServerVolumeAttachmentScenario-550494203 None] Volume 291939ff-7368-47d5-a122-0a0d083c8a67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-291939ff-7368-47d5-a122-0a0d083c8a67', 'volume_size': 1} Nov 03 07:38:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7455c79c-736e-4464-bc30-68fcd72f675e tempest-TestServerVolumeAttachmentScenario-550494203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:38:01 devstack sudo[97962]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [req-a3d279a2-5ff0-46c3-b386-4365768fdcc3 req-cf3bc39f-6077-49b0-bd73-d7386a12f72f tempest-VolumesSnapshotsTestJSON-1414188776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d141238-50c3-47ac-84d0-3ccb75a28cff -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d141238-50c3-47ac-84d0-3ccb75a28cff.9618cb42-87ce-49c2-b999-47e475b3e2e5" returned: 0 in 0.690s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:01 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [req-a3d279a2-5ff0-46c3-b386-4365768fdcc3 req-cf3bc39f-6077-49b0-bd73-d7386a12f72f tempest-VolumesSnapshotsTestJSON-1414188776 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d141238-50c3-47ac-84d0-3ccb75a28cff.9618cb42-87ce-49c2-b999-47e475b3e2e5 is being set with open permissions: ugo+rw Nov 03 07:38:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [req-a3d279a2-5ff0-46c3-b386-4365768fdcc3 req-cf3bc39f-6077-49b0-bd73-d7386a12f72f tempest-VolumesSnapshotsTestJSON-1414188776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d141238-50c3-47ac-84d0-3ccb75a28cff.9618cb42-87ce-49c2-b999-47e475b3e2e5 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:01 devstack sudo[97967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d141238-50c3-47ac-84d0-3ccb75a28cff.9618cb42-87ce-49c2-b999-47e475b3e2e5 Nov 03 07:38:01 devstack sudo[97967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:01 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c4a3e24-87ae-471f-85a8-d56d868d0ea6 tempest-TestServerVolumeAttachmentScenario-550494203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:38:01 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7c4a3e24-87ae-471f-85a8-d56d868d0ea6 tempest-TestServerVolumeAttachmentScenario-550494203 None] Flow 'volume_create_manager' (60a92165-6915-4d4b-93dd-4d37550a8f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:38:01 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7c4a3e24-87ae-471f-85a8-d56d868d0ea6 tempest-TestServerVolumeAttachmentScenario-550494203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b35bfc1e-6fb1-4b0e-94bd-cf8e6103c5c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:01 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7c4a3e24-87ae-471f-85a8-d56d868d0ea6 tempest-TestServerVolumeAttachmentScenario-550494203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b35bfc1e-6fb1-4b0e-94bd-cf8e6103c5c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2117546477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=935e5aa5-422b-47cf-ad8e-d906843705aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c54e3a3aa1f44145b2518e3727e5dab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:38:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:38:01Z,use_quota=True,user_id='70e994010cd9498d8a441a56478d8653',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:01 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7c4a3e24-87ae-471f-85a8-d56d868d0ea6 tempest-TestServerVolumeAttachmentScenario-550494203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fec33e3-31e9-4a53-8026-eb289ee1364f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:01 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7c4a3e24-87ae-471f-85a8-d56d868d0ea6 tempest-TestServerVolumeAttachmentScenario-550494203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fec33e3-31e9-4a53-8026-eb289ee1364f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:01 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7c4a3e24-87ae-471f-85a8-d56d868d0ea6 tempest-TestServerVolumeAttachmentScenario-550494203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88016e91-2c6c-463d-9840-657ecf73f76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:01 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7c4a3e24-87ae-471f-85a8-d56d868d0ea6 tempest-TestServerVolumeAttachmentScenario-550494203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88016e91-2c6c-463d-9840-657ecf73f76d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '935e5aa5-422b-47cf-ad8e-d906843705aa', 'volume_name': 'volume-935e5aa5-422b-47cf-ad8e-d906843705aa', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:01 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7c4a3e24-87ae-471f-85a8-d56d868d0ea6 tempest-TestServerVolumeAttachmentScenario-550494203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69212f2f-7d7c-482e-864f-02086ea8df93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:01 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7c4a3e24-87ae-471f-85a8-d56d868d0ea6 tempest-TestServerVolumeAttachmentScenario-550494203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69212f2f-7d7c-482e-864f-02086ea8df93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:01 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7c4a3e24-87ae-471f-85a8-d56d868d0ea6 tempest-TestServerVolumeAttachmentScenario-550494203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7958f319-2274-45fc-ac34-c41d92ffed38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:01 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-7c4a3e24-87ae-471f-85a8-d56d868d0ea6 tempest-TestServerVolumeAttachmentScenario-550494203 None] Volume 935e5aa5-422b-47cf-ad8e-d906843705aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-935e5aa5-422b-47cf-ad8e-d906843705aa', 'volume_size': 1} Nov 03 07:38:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7c4a3e24-87ae-471f-85a8-d56d868d0ea6 tempest-TestServerVolumeAttachmentScenario-550494203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:38:01 devstack sudo[97967]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [req-a3d279a2-5ff0-46c3-b386-4365768fdcc3 req-cf3bc39f-6077-49b0-bd73-d7386a12f72f tempest-VolumesSnapshotsTestJSON-1414188776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d141238-50c3-47ac-84d0-3ccb75a28cff.9618cb42-87ce-49c2-b999-47e475b3e2e5" returned: 0 in 0.608s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [req-a3d279a2-5ff0-46c3-b386-4365768fdcc3 req-cf3bc39f-6077-49b0-bd73-d7386a12f72f tempest-VolumesSnapshotsTestJSON-1414188776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d141238-50c3-47ac-84d0-3ccb75a28cff.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:01 devstack sudo[97970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d141238-50c3-47ac-84d0-3ccb75a28cff.info Nov 03 07:38:01 devstack sudo[97970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:02 devstack sudo[97970]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [req-a3d279a2-5ff0-46c3-b386-4365768fdcc3 req-cf3bc39f-6077-49b0-bd73-d7386a12f72f tempest-VolumesSnapshotsTestJSON-1414188776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d141238-50c3-47ac-84d0-3ccb75a28cff.info" returned: 0 in 0.374s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:02 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [req-a3d279a2-5ff0-46c3-b386-4365768fdcc3 req-cf3bc39f-6077-49b0-bd73-d7386a12f72f tempest-VolumesSnapshotsTestJSON-1414188776 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d141238-50c3-47ac-84d0-3ccb75a28cff.info is being set with open permissions: ugo+rw Nov 03 07:38:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [req-a3d279a2-5ff0-46c3-b386-4365768fdcc3 req-cf3bc39f-6077-49b0-bd73-d7386a12f72f tempest-VolumesSnapshotsTestJSON-1414188776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d141238-50c3-47ac-84d0-3ccb75a28cff.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:02 devstack sudo[97973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d141238-50c3-47ac-84d0-3ccb75a28cff.info Nov 03 07:38:02 devstack sudo[97973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:02 devstack sudo[97973]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [req-a3d279a2-5ff0-46c3-b386-4365768fdcc3 req-cf3bc39f-6077-49b0-bd73-d7386a12f72f tempest-VolumesSnapshotsTestJSON-1414188776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d141238-50c3-47ac-84d0-3ccb75a28cff.info" returned: 0 in 0.403s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-a3d279a2-5ff0-46c3-b386-4365768fdcc3 req-cf3bc39f-6077-49b0-bd73-d7386a12f72f tempest-VolumesSnapshotsTestJSON-1414188776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.711s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:38:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7455c79c-736e-4464-bc30-68fcd72f675e tempest-TestServerVolumeAttachmentScenario-550494203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.966s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:38:02 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-7455c79c-736e-4464-bc30-68fcd72f675e tempest-TestServerVolumeAttachmentScenario-550494203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:38:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2043523909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=291939ff-7368-47d5-a122-0a0d083c8a67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c54e3a3aa1f44145b2518e3727e5dab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:38:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:38:00Z,use_quota=True,user_id='70e994010cd9498d8a441a56478d8653',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:38:02 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-7455c79c-736e-4464-bc30-68fcd72f675e tempest-TestServerVolumeAttachmentScenario-550494203 None] Creating volume 291939ff-7368-47d5-a122-0a0d083c8a67 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:38:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7455c79c-736e-4464-bc30-68fcd72f675e tempest-TestServerVolumeAttachmentScenario-550494203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:38:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7455c79c-736e-4464-bc30-68fcd72f675e tempest-TestServerVolumeAttachmentScenario-550494203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:38:02 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-7455c79c-736e-4464-bc30-68fcd72f675e tempest-TestServerVolumeAttachmentScenario-550494203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:38:02 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-7455c79c-736e-4464-bc30-68fcd72f675e tempest-TestServerVolumeAttachmentScenario-550494203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:38:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7455c79c-736e-4464-bc30-68fcd72f675e tempest-TestServerVolumeAttachmentScenario-550494203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:38:02 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-7455c79c-736e-4464-bc30-68fcd72f675e tempest-TestServerVolumeAttachmentScenario-550494203 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:38:02 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-7455c79c-736e-4464-bc30-68fcd72f675e tempest-TestServerVolumeAttachmentScenario-550494203 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:38:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7455c79c-736e-4464-bc30-68fcd72f675e tempest-TestServerVolumeAttachmentScenario-550494203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-291939ff-7368-47d5-a122-0a0d083c8a67 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:02 devstack sudo[97976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-291939ff-7368-47d5-a122-0a0d083c8a67 1073741824 Nov 03 07:38:02 devstack sudo[97976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:02 devstack cinder-volume[86875]: INFO cinder.volume.manager [req-a3d279a2-5ff0-46c3-b386-4365768fdcc3 req-cf3bc39f-6077-49b0-bd73-d7386a12f72f tempest-VolumesSnapshotsTestJSON-1414188776 None] Create snapshot completed successfully Nov 03 07:38:03 devstack sudo[97976]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7455c79c-736e-4464-bc30-68fcd72f675e tempest-TestServerVolumeAttachmentScenario-550494203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-291939ff-7368-47d5-a122-0a0d083c8a67 1073741824" returned: 0 in 0.746s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7455c79c-736e-4464-bc30-68fcd72f675e tempest-TestServerVolumeAttachmentScenario-550494203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-291939ff-7368-47d5-a122-0a0d083c8a67 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:03 devstack sudo[97982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-291939ff-7368-47d5-a122-0a0d083c8a67 Nov 03 07:38:03 devstack sudo[97982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:03 devstack cinder-volume[86875]: DEBUG oslo_service.periodic_task [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86875) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:38:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:38:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:38:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:38:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:38:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:38:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:03 devstack sudo[97984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:38:03 devstack sudo[97984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:03 devstack sudo[97982]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7455c79c-736e-4464-bc30-68fcd72f675e tempest-TestServerVolumeAttachmentScenario-550494203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-291939ff-7368-47d5-a122-0a0d083c8a67" returned: 0 in 0.366s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-7455c79c-736e-4464-bc30-68fcd72f675e tempest-TestServerVolumeAttachmentScenario-550494203 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:38:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7455c79c-736e-4464-bc30-68fcd72f675e tempest-TestServerVolumeAttachmentScenario-550494203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.192s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:38:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7c4a3e24-87ae-471f-85a8-d56d868d0ea6 tempest-TestServerVolumeAttachmentScenario-550494203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.263s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:38:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-7c4a3e24-87ae-471f-85a8-d56d868d0ea6 tempest-TestServerVolumeAttachmentScenario-550494203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2117546477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=935e5aa5-422b-47cf-ad8e-d906843705aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c54e3a3aa1f44145b2518e3727e5dab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:38:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:38:01Z,use_quota=True,user_id='70e994010cd9498d8a441a56478d8653',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:38:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-7c4a3e24-87ae-471f-85a8-d56d868d0ea6 tempest-TestServerVolumeAttachmentScenario-550494203 None] Creating volume 935e5aa5-422b-47cf-ad8e-d906843705aa {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:38:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7c4a3e24-87ae-471f-85a8-d56d868d0ea6 tempest-TestServerVolumeAttachmentScenario-550494203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:38:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7c4a3e24-87ae-471f-85a8-d56d868d0ea6 tempest-TestServerVolumeAttachmentScenario-550494203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:38:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-7c4a3e24-87ae-471f-85a8-d56d868d0ea6 tempest-TestServerVolumeAttachmentScenario-550494203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:38:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-7c4a3e24-87ae-471f-85a8-d56d868d0ea6 tempest-TestServerVolumeAttachmentScenario-550494203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:38:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7c4a3e24-87ae-471f-85a8-d56d868d0ea6 tempest-TestServerVolumeAttachmentScenario-550494203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:38:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-7c4a3e24-87ae-471f-85a8-d56d868d0ea6 tempest-TestServerVolumeAttachmentScenario-550494203 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:38:03 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-7c4a3e24-87ae-471f-85a8-d56d868d0ea6 tempest-TestServerVolumeAttachmentScenario-550494203 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:38:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7c4a3e24-87ae-471f-85a8-d56d868d0ea6 tempest-TestServerVolumeAttachmentScenario-550494203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-935e5aa5-422b-47cf-ad8e-d906843705aa 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:03 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7455c79c-736e-4464-bc30-68fcd72f675e tempest-TestServerVolumeAttachmentScenario-550494203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ad1f075-d106-4a2f-ab43-30fe8a994db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-291939ff-7368-47d5-a122-0a0d083c8a67', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:03 devstack sudo[97987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-935e5aa5-422b-47cf-ad8e-d906843705aa 1073741824 Nov 03 07:38:03 devstack sudo[97987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:03 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7455c79c-736e-4464-bc30-68fcd72f675e tempest-TestServerVolumeAttachmentScenario-550494203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d85e3d4-20f8-4954-875e-7170d447bc86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:03 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-7455c79c-736e-4464-bc30-68fcd72f675e tempest-TestServerVolumeAttachmentScenario-550494203 None] Volume volume-291939ff-7368-47d5-a122-0a0d083c8a67 (291939ff-7368-47d5-a122-0a0d083c8a67): created successfully Nov 03 07:38:03 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7455c79c-736e-4464-bc30-68fcd72f675e tempest-TestServerVolumeAttachmentScenario-550494203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d85e3d4-20f8-4954-875e-7170d447bc86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:03 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7455c79c-736e-4464-bc30-68fcd72f675e tempest-TestServerVolumeAttachmentScenario-550494203 None] Flow 'volume_create_manager' (0446d561-997c-4596-9ccf-079ed96aac8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:38:03 devstack cinder-volume[86875]: DEBUG cinder.coordination [req-2bd94f5d-46ef-466f-a7cc-1d252a10c562 req-a3f3c2ac-7ee7-4323-9cbd-6f93f5449280 tempest-VolumesSnapshotsTestJSON-1414188776 None] Acquiring lock "cinder-9618cb42-87ce-49c2-b999-47e475b3e2e5-delete_snapshot" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:38:03 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-7455c79c-736e-4464-bc30-68fcd72f675e tempest-TestServerVolumeAttachmentScenario-550494203 None] Created volume successfully. Nov 03 07:38:03 devstack cinder-volume[86875]: DEBUG cinder.coordination [req-2bd94f5d-46ef-466f-a7cc-1d252a10c562 req-a3f3c2ac-7ee7-4323-9cbd-6f93f5449280 tempest-VolumesSnapshotsTestJSON-1414188776 None] Lock "cinder-9618cb42-87ce-49c2-b999-47e475b3e2e5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:38:03 devstack cinder-volume[86875]: DEBUG cinder.coordination [req-2bd94f5d-46ef-466f-a7cc-1d252a10c562 req-a3f3c2ac-7ee7-4323-9cbd-6f93f5449280 tempest-VolumesSnapshotsTestJSON-1414188776 None] Acquiring lock "cinder-quobyte-0d141238-50c3-47ac-84d0-3ccb75a28cff" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:38:04 devstack cinder-volume[86875]: DEBUG cinder.coordination [req-2bd94f5d-46ef-466f-a7cc-1d252a10c562 req-a3f3c2ac-7ee7-4323-9cbd-6f93f5449280 tempest-VolumesSnapshotsTestJSON-1414188776 None] Lock "cinder-quobyte-0d141238-50c3-47ac-84d0-3ccb75a28cff" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:38:04 devstack cinder-volume[86875]: DEBUG cinder.coordination [req-2bd94f5d-46ef-466f-a7cc-1d252a10c562 req-a3f3c2ac-7ee7-4323-9cbd-6f93f5449280 tempest-VolumesSnapshotsTestJSON-1414188776 None] Acquiring lock "cinder-quobyte-9618cb42-87ce-49c2-b999-47e475b3e2e5" by "_delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:38:04 devstack cinder-volume[86875]: DEBUG cinder.coordination [req-2bd94f5d-46ef-466f-a7cc-1d252a10c562 req-a3f3c2ac-7ee7-4323-9cbd-6f93f5449280 tempest-VolumesSnapshotsTestJSON-1414188776 None] Lock "cinder-quobyte-9618cb42-87ce-49c2-b999-47e475b3e2e5" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:38:04 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [req-2bd94f5d-46ef-466f-a7cc-1d252a10c562 req-a3f3c2ac-7ee7-4323-9cbd-6f93f5449280 tempest-VolumesSnapshotsTestJSON-1414188776 None] Deleting offline snapshot 9618cb42-87ce-49c2-b999-47e475b3e2e5 of volume 0d141238-50c3-47ac-84d0-3ccb75a28cff {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:38:04 devstack sudo[97984]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:04 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [req-2bd94f5d-46ef-466f-a7cc-1d252a10c562 req-a3f3c2ac-7ee7-4323-9cbd-6f93f5449280 tempest-VolumesSnapshotsTestJSON-1414188776 None] snapshot_file for this snap is: volume-0d141238-50c3-47ac-84d0-3ccb75a28cff.9618cb42-87ce-49c2-b999-47e475b3e2e5 {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:38:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.593s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:04 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:38:04 devstack cinder-volume[86875]: DEBUG oslo_service.periodic_task [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running periodic task VolumeManager._thread_info {{(pid=86875) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:38:04 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] thread count: 28 {{(pid=86875) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:38:04 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] thread info: [<_MainThread(MainThread, started 125626325639296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86875) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:38:04 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[b40716d2-3120-4abd-99b8-337ede110386]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:38:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [req-2bd94f5d-46ef-466f-a7cc-1d252a10c562 req-a3f3c2ac-7ee7-4323-9cbd-6f93f5449280 tempest-VolumesSnapshotsTestJSON-1414188776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d141238-50c3-47ac-84d0-3ccb75a28cff.9618cb42-87ce-49c2-b999-47e475b3e2e5 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:04 devstack sudo[97990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d141238-50c3-47ac-84d0-3ccb75a28cff.9618cb42-87ce-49c2-b999-47e475b3e2e5 Nov 03 07:38:04 devstack sudo[97990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:04 devstack sudo[97987]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7c4a3e24-87ae-471f-85a8-d56d868d0ea6 tempest-TestServerVolumeAttachmentScenario-550494203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-935e5aa5-422b-47cf-ad8e-d906843705aa 1073741824" returned: 0 in 1.141s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:04 devstack sudo[97990]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7c4a3e24-87ae-471f-85a8-d56d868d0ea6 tempest-TestServerVolumeAttachmentScenario-550494203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-935e5aa5-422b-47cf-ad8e-d906843705aa {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [req-2bd94f5d-46ef-466f-a7cc-1d252a10c562 req-a3f3c2ac-7ee7-4323-9cbd-6f93f5449280 tempest-VolumesSnapshotsTestJSON-1414188776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d141238-50c3-47ac-84d0-3ccb75a28cff.9618cb42-87ce-49c2-b999-47e475b3e2e5" returned: 0 in 0.777s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:05 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [req-2bd94f5d-46ef-466f-a7cc-1d252a10c562 req-a3f3c2ac-7ee7-4323-9cbd-6f93f5449280 tempest-VolumesSnapshotsTestJSON-1414188776 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d141238-50c3-47ac-84d0-3ccb75a28cff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:38:05 devstack sudo[97999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-935e5aa5-422b-47cf-ad8e-d906843705aa Nov 03 07:38:05 devstack sudo[97999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:05 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79e850e-7338-4fad-b723-55c44ad66d36]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:38:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [req-2bd94f5d-46ef-466f-a7cc-1d252a10c562 req-a3f3c2ac-7ee7-4323-9cbd-6f93f5449280 tempest-VolumesSnapshotsTestJSON-1414188776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d141238-50c3-47ac-84d0-3ccb75a28cff {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:05 devstack sudo[98001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d141238-50c3-47ac-84d0-3ccb75a28cff Nov 03 07:38:05 devstack sudo[98001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:05 devstack sudo[97999]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7c4a3e24-87ae-471f-85a8-d56d868d0ea6 tempest-TestServerVolumeAttachmentScenario-550494203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-935e5aa5-422b-47cf-ad8e-d906843705aa" returned: 0 in 0.407s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:05 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-7c4a3e24-87ae-471f-85a8-d56d868d0ea6 tempest-TestServerVolumeAttachmentScenario-550494203 None] <== create_volume: return (1639ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:38:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7c4a3e24-87ae-471f-85a8-d56d868d0ea6 tempest-TestServerVolumeAttachmentScenario-550494203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.651s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:38:05 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7c4a3e24-87ae-471f-85a8-d56d868d0ea6 tempest-TestServerVolumeAttachmentScenario-550494203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7958f319-2274-45fc-ac34-c41d92ffed38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-935e5aa5-422b-47cf-ad8e-d906843705aa', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:05 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7c4a3e24-87ae-471f-85a8-d56d868d0ea6 tempest-TestServerVolumeAttachmentScenario-550494203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95762a7b-206d-4dfc-90cf-5ce5f3672687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:05 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-7c4a3e24-87ae-471f-85a8-d56d868d0ea6 tempest-TestServerVolumeAttachmentScenario-550494203 None] Volume volume-935e5aa5-422b-47cf-ad8e-d906843705aa (935e5aa5-422b-47cf-ad8e-d906843705aa): created successfully Nov 03 07:38:05 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7c4a3e24-87ae-471f-85a8-d56d868d0ea6 tempest-TestServerVolumeAttachmentScenario-550494203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95762a7b-206d-4dfc-90cf-5ce5f3672687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:05 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7c4a3e24-87ae-471f-85a8-d56d868d0ea6 tempest-TestServerVolumeAttachmentScenario-550494203 None] Flow 'volume_create_manager' (60a92165-6915-4d4b-93dd-4d37550a8f5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:38:05 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-7c4a3e24-87ae-471f-85a8-d56d868d0ea6 tempest-TestServerVolumeAttachmentScenario-550494203 None] Created volume successfully. Nov 03 07:38:05 devstack sudo[98001]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [req-2bd94f5d-46ef-466f-a7cc-1d252a10c562 req-a3f3c2ac-7ee7-4323-9cbd-6f93f5449280 tempest-VolumesSnapshotsTestJSON-1414188776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d141238-50c3-47ac-84d0-3ccb75a28cff" returned: 0 in 0.582s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [req-2bd94f5d-46ef-466f-a7cc-1d252a10c562 req-a3f3c2ac-7ee7-4323-9cbd-6f93f5449280 tempest-VolumesSnapshotsTestJSON-1414188776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d141238-50c3-47ac-84d0-3ccb75a28cff.9618cb42-87ce-49c2-b999-47e475b3e2e5 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:05 devstack sudo[98009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d141238-50c3-47ac-84d0-3ccb75a28cff.9618cb42-87ce-49c2-b999-47e475b3e2e5 Nov 03 07:38:05 devstack sudo[98009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:06 devstack sudo[98009]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [req-2bd94f5d-46ef-466f-a7cc-1d252a10c562 req-a3f3c2ac-7ee7-4323-9cbd-6f93f5449280 tempest-VolumesSnapshotsTestJSON-1414188776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d141238-50c3-47ac-84d0-3ccb75a28cff.9618cb42-87ce-49c2-b999-47e475b3e2e5" returned: 0 in 0.531s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [req-2bd94f5d-46ef-466f-a7cc-1d252a10c562 req-a3f3c2ac-7ee7-4323-9cbd-6f93f5449280 tempest-VolumesSnapshotsTestJSON-1414188776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d141238-50c3-47ac-84d0-3ccb75a28cff.9618cb42-87ce-49c2-b999-47e475b3e2e5 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:06 devstack sudo[98015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d141238-50c3-47ac-84d0-3ccb75a28cff.9618cb42-87ce-49c2-b999-47e475b3e2e5 Nov 03 07:38:06 devstack sudo[98015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:06 devstack sudo[98015]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [req-2bd94f5d-46ef-466f-a7cc-1d252a10c562 req-a3f3c2ac-7ee7-4323-9cbd-6f93f5449280 tempest-VolumesSnapshotsTestJSON-1414188776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d141238-50c3-47ac-84d0-3ccb75a28cff.9618cb42-87ce-49c2-b999-47e475b3e2e5" returned: 0 in 0.352s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:06 devstack cinder-volume[86875]: DEBUG cinder.coordination [req-2bd94f5d-46ef-466f-a7cc-1d252a10c562 req-a3f3c2ac-7ee7-4323-9cbd-6f93f5449280 tempest-VolumesSnapshotsTestJSON-1414188776 None] Lock "cinder-quobyte-9618cb42-87ce-49c2-b999-47e475b3e2e5" released by "_delete_snapshot" :: held 2.530s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:38:06 devstack cinder-volume[86875]: DEBUG cinder.coordination [req-2bd94f5d-46ef-466f-a7cc-1d252a10c562 req-a3f3c2ac-7ee7-4323-9cbd-6f93f5449280 tempest-VolumesSnapshotsTestJSON-1414188776 None] Lock "cinder-quobyte-0d141238-50c3-47ac-84d0-3ccb75a28cff" released by "delete_snapshot" :: held 2.592s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:38:06 devstack cinder-volume[86875]: DEBUG cinder.quota [req-2bd94f5d-46ef-466f-a7cc-1d252a10c562 req-a3f3c2ac-7ee7-4323-9cbd-6f93f5449280 tempest-VolumesSnapshotsTestJSON-1414188776 None] Created reservations ['99696f8c-6e5e-419b-9308-be31bf518ca1', 'add00959-383c-4d5a-8fd1-3473dfa086f2', '45edb42d-bad1-4ee1-8105-df6ff31eff63', '632253ea-0d16-4213-82be-157e38a29b10'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:38:06 devstack cinder-volume[86875]: INFO cinder.volume.manager [req-2bd94f5d-46ef-466f-a7cc-1d252a10c562 req-a3f3c2ac-7ee7-4323-9cbd-6f93f5449280 tempest-VolumesSnapshotsTestJSON-1414188776 None] Delete snapshot completed successfully. Nov 03 07:38:06 devstack cinder-volume[86875]: DEBUG cinder.coordination [req-2bd94f5d-46ef-466f-a7cc-1d252a10c562 req-a3f3c2ac-7ee7-4323-9cbd-6f93f5449280 tempest-VolumesSnapshotsTestJSON-1414188776 None] Lock "cinder-9618cb42-87ce-49c2-b999-47e475b3e2e5-delete_snapshot" released by "delete_snapshot" :: held 2.934s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:38:07 devstack cinder-volume[86875]: DEBUG cinder.coordination [req-cd759336-83cc-4b96-8859-bd0efce4a8e1 req-2d0fae2e-0602-474b-890d-753c51a7290c tempest-VolumesSnapshotsTestJSON-1414188776 None] Acquiring lock "cinder-0d141238-50c3-47ac-84d0-3ccb75a28cff-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:38:07 devstack cinder-volume[86875]: DEBUG cinder.coordination [req-cd759336-83cc-4b96-8859-bd0efce4a8e1 req-2d0fae2e-0602-474b-890d-753c51a7290c tempest-VolumesSnapshotsTestJSON-1414188776 None] Lock "cinder-0d141238-50c3-47ac-84d0-3ccb75a28cff-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:38:07 devstack cinder-volume[86875]: DEBUG cinder.coordination [req-cd759336-83cc-4b96-8859-bd0efce4a8e1 req-2d0fae2e-0602-474b-890d-753c51a7290c tempest-VolumesSnapshotsTestJSON-1414188776 None] Acquiring lock "cinder-quobyte-0d141238-50c3-47ac-84d0-3ccb75a28cff" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:38:07 devstack cinder-volume[86875]: DEBUG cinder.coordination [req-cd759336-83cc-4b96-8859-bd0efce4a8e1 req-2d0fae2e-0602-474b-890d-753c51a7290c tempest-VolumesSnapshotsTestJSON-1414188776 None] Lock "cinder-quobyte-0d141238-50c3-47ac-84d0-3ccb75a28cff" acquired by "delete_volume" :: waited 0.022s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:38:08 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c01e76-6c1c-496d-8f80-a0a847bd1e72]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:38:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [req-cd759336-83cc-4b96-8859-bd0efce4a8e1 req-2d0fae2e-0602-474b-890d-753c51a7290c tempest-VolumesSnapshotsTestJSON-1414188776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d141238-50c3-47ac-84d0-3ccb75a28cff {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:08 devstack sudo[98023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d141238-50c3-47ac-84d0-3ccb75a28cff Nov 03 07:38:08 devstack sudo[98023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:08 devstack sudo[98023]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [req-cd759336-83cc-4b96-8859-bd0efce4a8e1 req-2d0fae2e-0602-474b-890d-753c51a7290c tempest-VolumesSnapshotsTestJSON-1414188776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d141238-50c3-47ac-84d0-3ccb75a28cff" returned: 0 in 0.887s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [req-cd759336-83cc-4b96-8859-bd0efce4a8e1 req-2d0fae2e-0602-474b-890d-753c51a7290c tempest-VolumesSnapshotsTestJSON-1414188776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d141238-50c3-47ac-84d0-3ccb75a28cff {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:09 devstack sudo[98046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d141238-50c3-47ac-84d0-3ccb75a28cff Nov 03 07:38:09 devstack sudo[98046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:09 devstack sudo[98046]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [req-cd759336-83cc-4b96-8859-bd0efce4a8e1 req-2d0fae2e-0602-474b-890d-753c51a7290c tempest-VolumesSnapshotsTestJSON-1414188776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d141238-50c3-47ac-84d0-3ccb75a28cff" returned: 0 in 0.420s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:09 devstack cinder-volume[86875]: DEBUG cinder.coordination [req-cd759336-83cc-4b96-8859-bd0efce4a8e1 req-2d0fae2e-0602-474b-890d-753c51a7290c tempest-VolumesSnapshotsTestJSON-1414188776 None] Lock "cinder-quobyte-0d141238-50c3-47ac-84d0-3ccb75a28cff" released by "delete_volume" :: held 1.457s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:38:09 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:INSERT=26,cinder:UPDATE=101,cinder:DELETE=9,cinder:SELECT=88 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:38:09 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:SELECT=92,cinder:UPDATE=117,cinder:INSERT=28,cinder:DELETE=9 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:38:09 devstack cinder-volume[86875]: DEBUG cinder.quota [req-cd759336-83cc-4b96-8859-bd0efce4a8e1 req-2d0fae2e-0602-474b-890d-753c51a7290c tempest-VolumesSnapshotsTestJSON-1414188776 None] Created reservations ['98e71380-c389-4bb6-ad83-72c71edbe199', '1cbff3ca-4767-41d0-b39f-8a0956d4bb08', '4df47655-40eb-4988-8101-98e8de18f6e5', '3893f2db-ae93-4065-bcb0-a56da1eddd17'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:38:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-cd759336-83cc-4b96-8859-bd0efce4a8e1 req-2d0fae2e-0602-474b-890d-753c51a7290c tempest-VolumesSnapshotsTestJSON-1414188776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:38:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-cd759336-83cc-4b96-8859-bd0efce4a8e1 req-2d0fae2e-0602-474b-890d-753c51a7290c tempest-VolumesSnapshotsTestJSON-1414188776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:38:09 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [req-cd759336-83cc-4b96-8859-bd0efce4a8e1 req-2d0fae2e-0602-474b-890d-753c51a7290c tempest-VolumesSnapshotsTestJSON-1414188776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:38:09 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [req-cd759336-83cc-4b96-8859-bd0efce4a8e1 req-2d0fae2e-0602-474b-890d-753c51a7290c tempest-VolumesSnapshotsTestJSON-1414188776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:38:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-cd759336-83cc-4b96-8859-bd0efce4a8e1 req-2d0fae2e-0602-474b-890d-753c51a7290c tempest-VolumesSnapshotsTestJSON-1414188776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:38:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [req-cd759336-83cc-4b96-8859-bd0efce4a8e1 req-2d0fae2e-0602-474b-890d-753c51a7290c tempest-VolumesSnapshotsTestJSON-1414188776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:09 devstack sudo[98049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:38:09 devstack sudo[98049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:10 devstack sudo[98049]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [req-cd759336-83cc-4b96-8859-bd0efce4a8e1 req-2d0fae2e-0602-474b-890d-753c51a7290c tempest-VolumesSnapshotsTestJSON-1414188776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.471s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:10 devstack cinder-volume[86875]: DEBUG cinder.manager [req-cd759336-83cc-4b96-8859-bd0efce4a8e1 req-2d0fae2e-0602-474b-890d-753c51a7290c tempest-VolumesSnapshotsTestJSON-1414188776 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:38:10 devstack cinder-volume[86875]: INFO cinder.volume.manager [req-cd759336-83cc-4b96-8859-bd0efce4a8e1 req-2d0fae2e-0602-474b-890d-753c51a7290c tempest-VolumesSnapshotsTestJSON-1414188776 None] Deleted volume successfully. Nov 03 07:38:10 devstack cinder-volume[86875]: DEBUG cinder.coordination [req-cd759336-83cc-4b96-8859-bd0efce4a8e1 req-2d0fae2e-0602-474b-890d-753c51a7290c tempest-VolumesSnapshotsTestJSON-1414188776 None] Lock "cinder-0d141238-50c3-47ac-84d0-3ccb75a28cff-delete_volume" released by "delete_volume" :: held 2.449s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:38:13 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-7640f336-6c8b-477a-baf8-0cbd2496061e req-5bd890cc-a8a6-45fa-bc1f-3caa97fbaf46 tempest-AttachVolumeShelveTestJSON-717092369 None] No connector for attachment 3e20dec4-058a-4711-b6cb-4a58b884eafb; skipping storage backend terminate_connection call. {{(pid=86875) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Nov 03 07:38:13 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-7640f336-6c8b-477a-baf8-0cbd2496061e req-5bd890cc-a8a6-45fa-bc1f-3caa97fbaf46 tempest-AttachVolumeShelveTestJSON-717092369 None] Deleting attachment 3e20dec4-058a-4711-b6cb-4a58b884eafb. {{(pid=86875) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:38:20 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4f7202e6-09a2-4e72-9b82-dfebfca179e6 tempest-BackendsCapabilitiesAdminTestsJSON-1448627912 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6651611328125, 'free_capacity_gb': 1773.6651611328125, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86875) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 03 07:38:20 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-273f4b43-4eb7-4516-9d73-ebbb4996b798 tempest-BackendsCapabilitiesAdminTestsJSON-1448627912 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6651611328125, 'free_capacity_gb': 1773.6651611328125, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86875) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 03 07:38:23 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:SELECT=6,cinder:INSERT=3,cinder:UPDATE=5 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:38:23 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:INSERT=1,cinder:UPDATE=10,cinder:SELECT=2,cinder:DELETE=1 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:38:35 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:38:45 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-af04b6bc-ae5a-48f9-b642-0f796d4a07b3 tempest-GroupsV314Test-490172018 None] Group tempest-GroupsV314Test-Group-104412605: creating Nov 03 07:38:45 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-af04b6bc-ae5a-48f9-b642-0f796d4a07b3 tempest-GroupsV314Test-490172018 None] Group tempest-GroupsV314Test-Group-104412605: created successfully Nov 03 07:38:45 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-af04b6bc-ae5a-48f9-b642-0f796d4a07b3 tempest-GroupsV314Test-490172018 None] Create group completed successfully. Nov 03 07:38:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-f6b08a2d-bf54-4e82-bad7-aefc1c17fee7 req-9ac48a22-da90-4ecf-ba86-185302ba7f4b tempest-TestServerVolumeAttachmentScenario-550494203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:38:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-f6b08a2d-bf54-4e82-bad7-aefc1c17fee7 req-9ac48a22-da90-4ecf-ba86-185302ba7f4b tempest-TestServerVolumeAttachmentScenario-550494203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:38:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-f6b08a2d-bf54-4e82-bad7-aefc1c17fee7 req-9ac48a22-da90-4ecf-ba86-185302ba7f4b tempest-TestServerVolumeAttachmentScenario-550494203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:38:46 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-f6b08a2d-bf54-4e82-bad7-aefc1c17fee7 req-9ac48a22-da90-4ecf-ba86-185302ba7f4b tempest-TestServerVolumeAttachmentScenario-550494203 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1', 'name': 'volume-291939ff-7368-47d5-a122-0a0d083c8a67', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e756d32e-c79c-41c4-92a2-536feb724837', 'enforce_multipath': True} {{(pid=86875) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:38:46 devstack cinder-volume[86875]: INFO cinder.volume.manager [req-f6b08a2d-bf54-4e82-bad7-aefc1c17fee7 req-9ac48a22-da90-4ecf-ba86-185302ba7f4b tempest-TestServerVolumeAttachmentScenario-550494203 None] attachment_update completed successfully. Nov 03 07:38:47 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-f56ed2ef-0fa1-4c5e-80c5-9f0efa2652c7 tempest-GroupsV314Test-490172018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:38:47 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f56ed2ef-0fa1-4c5e-80c5-9f0efa2652c7 tempest-GroupsV314Test-490172018 None] Flow 'volume_create_manager' (738e8225-d882-417e-944a-e165d8db5203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:38:47 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f56ed2ef-0fa1-4c5e-80c5-9f0efa2652c7 tempest-GroupsV314Test-490172018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10d5ff51-27df-4ecb-b987-39ae77378a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:47 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f56ed2ef-0fa1-4c5e-80c5-9f0efa2652c7 tempest-GroupsV314Test-490172018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10d5ff51-27df-4ecb-b987-39ae77378a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:38:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-768476693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d16d58d6-5c9e-4e07-b928-f6e72aaf3b32,host='devstack@QuobyteHD#QuobyteHD',id=d2912785-596a-49d6-b4cc-547cfc8c71a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d8a5c968b9f4df6bc0b57d7e9bc0dd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:38:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:38:48Z,use_quota=True,user_id='15f85b5161dc4eec88007fcb2be2b674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(86ddecbd-d575-4db2-a231-817aed46c586),volume_type_id=86ddecbd-d575-4db2-a231-817aed46c586)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:47 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f56ed2ef-0fa1-4c5e-80c5-9f0efa2652c7 tempest-GroupsV314Test-490172018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f509ad8-ac13-45d9-8785-d9ab879f4586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:47 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f56ed2ef-0fa1-4c5e-80c5-9f0efa2652c7 tempest-GroupsV314Test-490172018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f509ad8-ac13-45d9-8785-d9ab879f4586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:47 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f56ed2ef-0fa1-4c5e-80c5-9f0efa2652c7 tempest-GroupsV314Test-490172018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9a70d23-7fa4-4a30-ac97-c5675bd94701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:47 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f56ed2ef-0fa1-4c5e-80c5-9f0efa2652c7 tempest-GroupsV314Test-490172018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9a70d23-7fa4-4a30-ac97-c5675bd94701) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2912785-596a-49d6-b4cc-547cfc8c71a7', 'volume_name': 'volume-d2912785-596a-49d6-b4cc-547cfc8c71a7', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:47 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f56ed2ef-0fa1-4c5e-80c5-9f0efa2652c7 tempest-GroupsV314Test-490172018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2705ef77-7056-48f8-85c3-4c15d15056f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:47 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f56ed2ef-0fa1-4c5e-80c5-9f0efa2652c7 tempest-GroupsV314Test-490172018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2705ef77-7056-48f8-85c3-4c15d15056f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:47 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f56ed2ef-0fa1-4c5e-80c5-9f0efa2652c7 tempest-GroupsV314Test-490172018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b1d8e19-3ed4-492b-ad96-6faa121f300f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:47 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-f56ed2ef-0fa1-4c5e-80c5-9f0efa2652c7 tempest-GroupsV314Test-490172018 None] Volume d2912785-596a-49d6-b4cc-547cfc8c71a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2912785-596a-49d6-b4cc-547cfc8c71a7', 'volume_size': 1} Nov 03 07:38:47 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-f56ed2ef-0fa1-4c5e-80c5-9f0efa2652c7 tempest-GroupsV314Test-490172018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:38:47 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-f56ed2ef-0fa1-4c5e-80c5-9f0efa2652c7 tempest-GroupsV314Test-490172018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:38:47 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-f56ed2ef-0fa1-4c5e-80c5-9f0efa2652c7 tempest-GroupsV314Test-490172018 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d16d58d6-5c9e-4e07-b928-f6e72aaf3b32,created_at=2026-11-03T06:38:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-768476693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d16d58d6-5c9e-4e07-b928-f6e72aaf3b32,host='devstack@QuobyteHD#QuobyteHD',id=d2912785-596a-49d6-b4cc-547cfc8c71a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d8a5c968b9f4df6bc0b57d7e9bc0dd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:38:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:38:48Z,use_quota=True,user_id='15f85b5161dc4eec88007fcb2be2b674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(86ddecbd-d575-4db2-a231-817aed46c586),volume_type_id=86ddecbd-d575-4db2-a231-817aed46c586)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:38:47 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-f56ed2ef-0fa1-4c5e-80c5-9f0efa2652c7 tempest-GroupsV314Test-490172018 None] Creating volume d2912785-596a-49d6-b4cc-547cfc8c71a7 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:38:47 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-f56ed2ef-0fa1-4c5e-80c5-9f0efa2652c7 tempest-GroupsV314Test-490172018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:38:47 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-f56ed2ef-0fa1-4c5e-80c5-9f0efa2652c7 tempest-GroupsV314Test-490172018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:38:47 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-f56ed2ef-0fa1-4c5e-80c5-9f0efa2652c7 tempest-GroupsV314Test-490172018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:38:47 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-f56ed2ef-0fa1-4c5e-80c5-9f0efa2652c7 tempest-GroupsV314Test-490172018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:38:47 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-f56ed2ef-0fa1-4c5e-80c5-9f0efa2652c7 tempest-GroupsV314Test-490172018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:38:47 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-f56ed2ef-0fa1-4c5e-80c5-9f0efa2652c7 tempest-GroupsV314Test-490172018 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:38:47 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-f56ed2ef-0fa1-4c5e-80c5-9f0efa2652c7 tempest-GroupsV314Test-490172018 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:38:47 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f56ed2ef-0fa1-4c5e-80c5-9f0efa2652c7 tempest-GroupsV314Test-490172018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d2912785-596a-49d6-b4cc-547cfc8c71a7 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:47 devstack sudo[98785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d2912785-596a-49d6-b4cc-547cfc8c71a7 1073741824 Nov 03 07:38:47 devstack sudo[98785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:48 devstack sudo[98785]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f56ed2ef-0fa1-4c5e-80c5-9f0efa2652c7 tempest-GroupsV314Test-490172018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d2912785-596a-49d6-b4cc-547cfc8c71a7 1073741824" returned: 0 in 0.617s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f56ed2ef-0fa1-4c5e-80c5-9f0efa2652c7 tempest-GroupsV314Test-490172018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d2912785-596a-49d6-b4cc-547cfc8c71a7 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:48 devstack sudo[98791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d2912785-596a-49d6-b4cc-547cfc8c71a7 Nov 03 07:38:48 devstack sudo[98791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:49 devstack sudo[98791]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f56ed2ef-0fa1-4c5e-80c5-9f0efa2652c7 tempest-GroupsV314Test-490172018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d2912785-596a-49d6-b4cc-547cfc8c71a7" returned: 0 in 0.466s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:49 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-f56ed2ef-0fa1-4c5e-80c5-9f0efa2652c7 tempest-GroupsV314Test-490172018 None] <== create_volume: return (1178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:38:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-f56ed2ef-0fa1-4c5e-80c5-9f0efa2652c7 tempest-GroupsV314Test-490172018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:38:49 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f56ed2ef-0fa1-4c5e-80c5-9f0efa2652c7 tempest-GroupsV314Test-490172018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b1d8e19-3ed4-492b-ad96-6faa121f300f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2912785-596a-49d6-b4cc-547cfc8c71a7', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:49 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f56ed2ef-0fa1-4c5e-80c5-9f0efa2652c7 tempest-GroupsV314Test-490172018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1e9b791-abe2-46dd-836c-2add1f58b84f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:49 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-f56ed2ef-0fa1-4c5e-80c5-9f0efa2652c7 tempest-GroupsV314Test-490172018 None] Volume volume-d2912785-596a-49d6-b4cc-547cfc8c71a7 (d2912785-596a-49d6-b4cc-547cfc8c71a7): created successfully Nov 03 07:38:49 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f56ed2ef-0fa1-4c5e-80c5-9f0efa2652c7 tempest-GroupsV314Test-490172018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1e9b791-abe2-46dd-836c-2add1f58b84f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:49 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f56ed2ef-0fa1-4c5e-80c5-9f0efa2652c7 tempest-GroupsV314Test-490172018 None] Flow 'volume_create_manager' (738e8225-d882-417e-944a-e165d8db5203) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:38:49 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-f56ed2ef-0fa1-4c5e-80c5-9f0efa2652c7 tempest-GroupsV314Test-490172018 None] Created volume successfully. Nov 03 07:38:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-1bf3116d-0bab-489a-bf18-369869a5c34d tempest-GroupsV314Test-490172018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:38:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-1bf3116d-0bab-489a-bf18-369869a5c34d tempest-GroupsV314Test-490172018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:38:51 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-1bf3116d-0bab-489a-bf18-369869a5c34d tempest-GroupsV314Test-490172018 None] Cloning volume d2912785-596a-49d6-b4cc-547cfc8c71a7 to volume bd7bd52e-cec8-48c2-bfd6-9806166989b7 Nov 03 07:38:51 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-1bf3116d-0bab-489a-bf18-369869a5c34d tempest-GroupsV314Test-490172018 None] Creating offline snapshot 468c59ff-6028-4a9f-b8c1-3f125c02d6d8 of volume d2912785-596a-49d6-b4cc-547cfc8c71a7 {{(pid=86875) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:38:51 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b8558c-bfc5-4456-b308-a165f73e9989]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:38:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1bf3116d-0bab-489a-bf18-369869a5c34d tempest-GroupsV314Test-490172018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d2912785-596a-49d6-b4cc-547cfc8c71a7 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:52 devstack sudo[98799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d2912785-596a-49d6-b4cc-547cfc8c71a7 Nov 03 07:38:52 devstack sudo[98799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:52 devstack sudo[98799]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1bf3116d-0bab-489a-bf18-369869a5c34d tempest-GroupsV314Test-490172018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d2912785-596a-49d6-b4cc-547cfc8c71a7" returned: 0 in 0.509s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1bf3116d-0bab-489a-bf18-369869a5c34d tempest-GroupsV314Test-490172018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d2912785-596a-49d6-b4cc-547cfc8c71a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d2912785-596a-49d6-b4cc-547cfc8c71a7.468c59ff-6028-4a9f-b8c1-3f125c02d6d8 1G {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:52 devstack sudo[98805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d2912785-596a-49d6-b4cc-547cfc8c71a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d2912785-596a-49d6-b4cc-547cfc8c71a7.468c59ff-6028-4a9f-b8c1-3f125c02d6d8 1G Nov 03 07:38:52 devstack sudo[98805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:53 devstack sudo[98805]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1bf3116d-0bab-489a-bf18-369869a5c34d tempest-GroupsV314Test-490172018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d2912785-596a-49d6-b4cc-547cfc8c71a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d2912785-596a-49d6-b4cc-547cfc8c71a7.468c59ff-6028-4a9f-b8c1-3f125c02d6d8 1G" returned: 0 in 0.736s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1bf3116d-0bab-489a-bf18-369869a5c34d tempest-GroupsV314Test-490172018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2912785-596a-49d6-b4cc-547cfc8c71a7 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d2912785-596a-49d6-b4cc-547cfc8c71a7.468c59ff-6028-4a9f-b8c1-3f125c02d6d8 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:53 devstack sudo[98818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2912785-596a-49d6-b4cc-547cfc8c71a7 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d2912785-596a-49d6-b4cc-547cfc8c71a7.468c59ff-6028-4a9f-b8c1-3f125c02d6d8 Nov 03 07:38:53 devstack sudo[98818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-d7a5ac45-99ed-4e14-91f5-5f100bfd07c8 req-4f5010db-e9f8-4e90-a6b5-d2ebc9de8690 tempest-TestServerVolumeAttachmentScenario-550494203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:38:53 devstack sudo[98818]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1bf3116d-0bab-489a-bf18-369869a5c34d tempest-GroupsV314Test-490172018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2912785-596a-49d6-b4cc-547cfc8c71a7 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d2912785-596a-49d6-b4cc-547cfc8c71a7.468c59ff-6028-4a9f-b8c1-3f125c02d6d8" returned: 0 in 0.345s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:53 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-1bf3116d-0bab-489a-bf18-369869a5c34d tempest-GroupsV314Test-490172018 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d2912785-596a-49d6-b4cc-547cfc8c71a7.468c59ff-6028-4a9f-b8c1-3f125c02d6d8 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 07:38:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1bf3116d-0bab-489a-bf18-369869a5c34d tempest-GroupsV314Test-490172018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d2912785-596a-49d6-b4cc-547cfc8c71a7.468c59ff-6028-4a9f-b8c1-3f125c02d6d8 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:53 devstack sudo[98827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d2912785-596a-49d6-b4cc-547cfc8c71a7.468c59ff-6028-4a9f-b8c1-3f125c02d6d8 Nov 03 07:38:53 devstack sudo[98827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:53 devstack sudo[98827]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1bf3116d-0bab-489a-bf18-369869a5c34d tempest-GroupsV314Test-490172018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d2912785-596a-49d6-b4cc-547cfc8c71a7.468c59ff-6028-4a9f-b8c1-3f125c02d6d8" returned: 0 in 0.310s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1bf3116d-0bab-489a-bf18-369869a5c34d tempest-GroupsV314Test-490172018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d2912785-596a-49d6-b4cc-547cfc8c71a7.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:53 devstack sudo[98830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d2912785-596a-49d6-b4cc-547cfc8c71a7.info Nov 03 07:38:53 devstack sudo[98830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:54 devstack sudo[98830]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1bf3116d-0bab-489a-bf18-369869a5c34d tempest-GroupsV314Test-490172018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d2912785-596a-49d6-b4cc-547cfc8c71a7.info" returned: 0 in 0.325s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:54 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-1bf3116d-0bab-489a-bf18-369869a5c34d tempest-GroupsV314Test-490172018 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d2912785-596a-49d6-b4cc-547cfc8c71a7.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 07:38:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1bf3116d-0bab-489a-bf18-369869a5c34d tempest-GroupsV314Test-490172018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d2912785-596a-49d6-b4cc-547cfc8c71a7.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:54 devstack sudo[98833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d2912785-596a-49d6-b4cc-547cfc8c71a7.info Nov 03 07:38:54 devstack sudo[98833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:54 devstack sudo[98833]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1bf3116d-0bab-489a-bf18-369869a5c34d tempest-GroupsV314Test-490172018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d2912785-596a-49d6-b4cc-547cfc8c71a7.info" returned: 0 in 0.273s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:54 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-1bf3116d-0bab-489a-bf18-369869a5c34d tempest-GroupsV314Test-490172018 None] Acquiring lock "cinder-quobyte-bd7bd52e-cec8-48c2-bfd6-9806166989b7" by "_copy_volume_from_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:38:54 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-1bf3116d-0bab-489a-bf18-369869a5c34d tempest-GroupsV314Test-490172018 None] Lock "cinder-quobyte-bd7bd52e-cec8-48c2-bfd6-9806166989b7" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:38:54 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-1bf3116d-0bab-489a-bf18-369869a5c34d tempest-GroupsV314Test-490172018 None] snapshot: 468c59ff-6028-4a9f-b8c1-3f125c02d6d8, volume: bd7bd52e-cec8-48c2-bfd6-9806166989b7, {{(pid=86875) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 07:38:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-1bf3116d-0bab-489a-bf18-369869a5c34d tempest-GroupsV314Test-490172018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:38:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-1bf3116d-0bab-489a-bf18-369869a5c34d tempest-GroupsV314Test-490172018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:38:54 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-1bf3116d-0bab-489a-bf18-369869a5c34d tempest-GroupsV314Test-490172018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:38:54 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-1bf3116d-0bab-489a-bf18-369869a5c34d tempest-GroupsV314Test-490172018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:38:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-1bf3116d-0bab-489a-bf18-369869a5c34d tempest-GroupsV314Test-490172018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:38:54 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[07bb2de6-f9ce-4c3e-8f1f-d0e6130902e1]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:38:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1bf3116d-0bab-489a-bf18-369869a5c34d tempest-GroupsV314Test-490172018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d2912785-596a-49d6-b4cc-547cfc8c71a7.468c59ff-6028-4a9f-b8c1-3f125c02d6d8 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:54 devstack sudo[98836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d2912785-596a-49d6-b4cc-547cfc8c71a7.468c59ff-6028-4a9f-b8c1-3f125c02d6d8 Nov 03 07:38:54 devstack sudo[98836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:54 devstack sudo[98836]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1bf3116d-0bab-489a-bf18-369869a5c34d tempest-GroupsV314Test-490172018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d2912785-596a-49d6-b4cc-547cfc8c71a7.468c59ff-6028-4a9f-b8c1-3f125c02d6d8" returned: 0 in 0.453s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:54 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-1bf3116d-0bab-489a-bf18-369869a5c34d tempest-GroupsV314Test-490172018 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2912785-596a-49d6-b4cc-547cfc8c71a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:38:55 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4c6778-dcbe-41b6-b7b0-b591f17ad8fa]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:38:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1bf3116d-0bab-489a-bf18-369869a5c34d tempest-GroupsV314Test-490172018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d2912785-596a-49d6-b4cc-547cfc8c71a7 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:55 devstack sudo[98842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d2912785-596a-49d6-b4cc-547cfc8c71a7 Nov 03 07:38:55 devstack sudo[98842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:55 devstack sudo[98842]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1bf3116d-0bab-489a-bf18-369869a5c34d tempest-GroupsV314Test-490172018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d2912785-596a-49d6-b4cc-547cfc8c71a7" returned: 0 in 0.425s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:55 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-1bf3116d-0bab-489a-bf18-369869a5c34d tempest-GroupsV314Test-490172018 None] will copy from snapshot at /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d2912785-596a-49d6-b4cc-547cfc8c71a7 {{(pid=86875) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 07:38:55 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-1bf3116d-0bab-489a-bf18-369869a5c34d tempest-GroupsV314Test-490172018 None] Creating direct copy from snapshot {{(pid=86875) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 07:38:55 devstack cinder-volume[86875]: DEBUG cinder.utils [None req-1bf3116d-0bab-489a-bf18-369869a5c34d tempest-GroupsV314Test-490172018 None] Path /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bd7bd52e-cec8-48c2-bfd6-9806166989b7 not found in is_blk_device check {{(pid=86875) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 07:38:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1bf3116d-0bab-489a-bf18-369869a5c34d tempest-GroupsV314Test-490172018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d2912785-596a-49d6-b4cc-547cfc8c71a7 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bd7bd52e-cec8-48c2-bfd6-9806166989b7 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:55 devstack sudo[98847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d2912785-596a-49d6-b4cc-547cfc8c71a7 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bd7bd52e-cec8-48c2-bfd6-9806166989b7 Nov 03 07:38:55 devstack sudo[98847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:55 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f76fa6e-7b35-4200-a3fe-037ea3d3ea46 tempest-TestShelveInstance-2081252662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:38:55 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0f76fa6e-7b35-4200-a3fe-037ea3d3ea46 tempest-TestShelveInstance-2081252662 None] Flow 'volume_create_manager' (c9bef489-af6a-424a-be46-8986f6ca2192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:38:55 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0f76fa6e-7b35-4200-a3fe-037ea3d3ea46 tempest-TestShelveInstance-2081252662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76b99f2b-3042-428f-b0bf-1abc8777fbc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:55 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0f76fa6e-7b35-4200-a3fe-037ea3d3ea46 tempest-TestShelveInstance-2081252662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76b99f2b-3042-428f-b0bf-1abc8777fbc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:38:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1227584993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=442c9ef6-b786-4e22-b5e3-e222b7b63413,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd465ddf3e8e4b9e892c5de73a6fd256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:38:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:38:56Z,use_quota=True,user_id='e3754d18f7c6407bb269027b82db4042',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:55 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0f76fa6e-7b35-4200-a3fe-037ea3d3ea46 tempest-TestShelveInstance-2081252662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd990d37-0d71-4a64-ba96-283d709de5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:55 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0f76fa6e-7b35-4200-a3fe-037ea3d3ea46 tempest-TestShelveInstance-2081252662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd990d37-0d71-4a64-ba96-283d709de5db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:55 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0f76fa6e-7b35-4200-a3fe-037ea3d3ea46 tempest-TestShelveInstance-2081252662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbd8a93e-073a-4e07-8014-32294a56191c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:55 devstack cinder-volume[86875]: DEBUG cinder.image.glance [None req-0f76fa6e-7b35-4200-a3fe-037ea3d3ea46 tempest-TestShelveInstance-2081252662 None] Creating Keystone auth plugin from conf {{(pid=86875) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 07:38:56 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0f76fa6e-7b35-4200-a3fe-037ea3d3ea46 tempest-TestShelveInstance-2081252662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbd8a93e-073a-4e07-8014-32294a56191c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '442c9ef6-b786-4e22-b5e3-e222b7b63413', 'volume_name': 'volume-442c9ef6-b786-4e22-b5e3-e222b7b63413', 'volume_size': 1, 'image_id': 'eb68a148-0c9c-4237-9d8d-94a6a7cd87d9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eb68a148-0c9c-4237-9d8d-94a6a7cd87d9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c9ace38ee46b42979b3d4c79532bd66e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eb68a148-0c9c-4237-9d8d-94a6a7cd87d9', 'created_at': datetime.datetime(2026, 11, 3, 6, 21, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 21, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eb68a148-0c9c-4237-9d8d-94a6a7cd87d9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:56 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0f76fa6e-7b35-4200-a3fe-037ea3d3ea46 tempest-TestShelveInstance-2081252662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8ef8744-f870-49a7-82bd-573391126ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:56 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0f76fa6e-7b35-4200-a3fe-037ea3d3ea46 tempest-TestShelveInstance-2081252662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8ef8744-f870-49a7-82bd-573391126ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:38:56 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0f76fa6e-7b35-4200-a3fe-037ea3d3ea46 tempest-TestShelveInstance-2081252662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0f2b7d6-0d3a-42c8-86f5-7a50f150b07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:38:56 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-0f76fa6e-7b35-4200-a3fe-037ea3d3ea46 tempest-TestShelveInstance-2081252662 None] Volume 442c9ef6-b786-4e22-b5e3-e222b7b63413: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-442c9ef6-b786-4e22-b5e3-e222b7b63413', 'volume_size': 1, 'image_id': 'eb68a148-0c9c-4237-9d8d-94a6a7cd87d9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eb68a148-0c9c-4237-9d8d-94a6a7cd87d9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c9ace38ee46b42979b3d4c79532bd66e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eb68a148-0c9c-4237-9d8d-94a6a7cd87d9', 'created_at': datetime.datetime(2026, 11, 3, 6, 21, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 21, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eb68a148-0c9c-4237-9d8d-94a6a7cd87d9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 03 07:38:56 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f76fa6e-7b35-4200-a3fe-037ea3d3ea46 tempest-TestShelveInstance-2081252662 None] Trying to clone 442c9ef6-b786-4e22-b5e3-e222b7b63413 from image eb68a148-0c9c-4237-9d8d-94a6a7cd87d9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/eb68a148-0c9c-4237-9d8d-94a6a7cd87d9', 'metadata': {}}]). {{(pid=86875) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 07:38:57 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-0f76fa6e-7b35-4200-a3fe-037ea3d3ea46 tempest-TestShelveInstance-2081252662 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_z1yzy3z3devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86875) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 07:38:57 devstack cinder-volume[86875]: INFO cinder.image.image_utils [None req-0f76fa6e-7b35-4200-a3fe-037ea3d3ea46 tempest-TestShelveInstance-2081252662 None] Image download 20.69 MB at 20.69 MB/s Nov 03 07:38:57 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[82036464-b2ba-429f-a10f-dd1704584c46]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:38:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0f76fa6e-7b35-4200-a3fe-037ea3d3ea46 tempest-TestShelveInstance-2081252662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_z1yzy3z3devstack@QuobyteHD {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:57 devstack sudo[98860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_z1yzy3z3devstack@QuobyteHD Nov 03 07:38:57 devstack sudo[98860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:58 devstack sudo[98860]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0f76fa6e-7b35-4200-a3fe-037ea3d3ea46 tempest-TestShelveInstance-2081252662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_z1yzy3z3devstack@QuobyteHD" returned: 0 in 0.902s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:58 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-0f76fa6e-7b35-4200-a3fe-037ea3d3ea46 tempest-TestShelveInstance-2081252662 None] Temporary image eb68a148-0c9c-4237-9d8d-94a6a7cd87d9 is fetched for user e3754d18f7c6407bb269027b82db4042. {{(pid=86875) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 07:38:58 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da1f3cd-4799-49f6-aa9e-34b24f7a6f08]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:38:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0f76fa6e-7b35-4200-a3fe-037ea3d3ea46 tempest-TestShelveInstance-2081252662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_z1yzy3z3devstack@QuobyteHD {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:38:58 devstack sudo[98867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_z1yzy3z3devstack@QuobyteHD Nov 03 07:38:58 devstack sudo[98867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:38:59 devstack sudo[98867]: pam_unix(sudo:session): session closed for user root Nov 03 07:38:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0f76fa6e-7b35-4200-a3fe-037ea3d3ea46 tempest-TestShelveInstance-2081252662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_z1yzy3z3devstack@QuobyteHD" returned: 0 in 0.613s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:38:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0f76fa6e-7b35-4200-a3fe-037ea3d3ea46 tempest-TestShelveInstance-2081252662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:03 devstack cinder-volume[86875]: DEBUG oslo_service.periodic_task [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86875) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:39:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:39:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:39:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:03 devstack sudo[98898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:39:03 devstack sudo[98898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:04 devstack sudo[98847]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1bf3116d-0bab-489a-bf18-369869a5c34d tempest-GroupsV314Test-490172018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d2912785-596a-49d6-b4cc-547cfc8c71a7 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bd7bd52e-cec8-48c2-bfd6-9806166989b7" returned: 0 in 8.571s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:04 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-1bf3116d-0bab-489a-bf18-369869a5c34d tempest-GroupsV314Test-490172018 None] Image conversion details: src /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d2912785-596a-49d6-b4cc-547cfc8c71a7, size 1024.00 MB, duration 8.57 sec, destination /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bd7bd52e-cec8-48c2-bfd6-9806166989b7 {{(pid=86875) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:39:04 devstack cinder-volume[86875]: INFO cinder.image.image_utils [None req-1bf3116d-0bab-489a-bf18-369869a5c34d tempest-GroupsV314Test-490172018 None] Converted 1024.00 MB image at 119.44 MB/s Nov 03 07:39:04 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-1bf3116d-0bab-489a-bf18-369869a5c34d tempest-GroupsV314Test-490172018 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bd7bd52e-cec8-48c2-bfd6-9806166989b7 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 07:39:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1bf3116d-0bab-489a-bf18-369869a5c34d tempest-GroupsV314Test-490172018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bd7bd52e-cec8-48c2-bfd6-9806166989b7 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:04 devstack sudo[98898]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.447s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:04 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:39:04 devstack sudo[98902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bd7bd52e-cec8-48c2-bfd6-9806166989b7 Nov 03 07:39:04 devstack sudo[98902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:04 devstack cinder-volume[86875]: DEBUG oslo_service.periodic_task [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running periodic task VolumeManager._thread_info {{(pid=86875) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:39:04 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] thread count: 28 {{(pid=86875) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:39:04 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] thread info: [<_MainThread(MainThread, started 125626325639296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86875) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:39:04 devstack sudo[98902]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1bf3116d-0bab-489a-bf18-369869a5c34d tempest-GroupsV314Test-490172018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bd7bd52e-cec8-48c2-bfd6-9806166989b7" returned: 0 in 0.282s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:04 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-1bf3116d-0bab-489a-bf18-369869a5c34d tempest-GroupsV314Test-490172018 None] Lock "cinder-quobyte-bd7bd52e-cec8-48c2-bfd6-9806166989b7" released by "_copy_volume_from_snapshot" :: held 9.832s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:04 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-1bf3116d-0bab-489a-bf18-369869a5c34d tempest-GroupsV314Test-490172018 None] Acquiring lock "cinder-quobyte-468c59ff-6028-4a9f-b8c1-3f125c02d6d8" by "_delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:04 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-1bf3116d-0bab-489a-bf18-369869a5c34d tempest-GroupsV314Test-490172018 None] Lock "cinder-quobyte-468c59ff-6028-4a9f-b8c1-3f125c02d6d8" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:04 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-1bf3116d-0bab-489a-bf18-369869a5c34d tempest-GroupsV314Test-490172018 None] Deleting offline snapshot 468c59ff-6028-4a9f-b8c1-3f125c02d6d8 of volume d2912785-596a-49d6-b4cc-547cfc8c71a7 {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:39:04 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-1bf3116d-0bab-489a-bf18-369869a5c34d tempest-GroupsV314Test-490172018 None] snapshot_file for this snap is: volume-d2912785-596a-49d6-b4cc-547cfc8c71a7.468c59ff-6028-4a9f-b8c1-3f125c02d6d8 {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:39:04 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd42abf-9159-467d-8d8b-50e7df05dab8]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:39:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1bf3116d-0bab-489a-bf18-369869a5c34d tempest-GroupsV314Test-490172018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d2912785-596a-49d6-b4cc-547cfc8c71a7.468c59ff-6028-4a9f-b8c1-3f125c02d6d8 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:04 devstack sudo[98906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d2912785-596a-49d6-b4cc-547cfc8c71a7.468c59ff-6028-4a9f-b8c1-3f125c02d6d8 Nov 03 07:39:04 devstack sudo[98906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:04 devstack sudo[98906]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1bf3116d-0bab-489a-bf18-369869a5c34d tempest-GroupsV314Test-490172018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d2912785-596a-49d6-b4cc-547cfc8c71a7.468c59ff-6028-4a9f-b8c1-3f125c02d6d8" returned: 0 in 0.505s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:04 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-1bf3116d-0bab-489a-bf18-369869a5c34d tempest-GroupsV314Test-490172018 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2912785-596a-49d6-b4cc-547cfc8c71a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:39:04 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[665f0477-af74-4d19-b036-770eb8d0fa8e]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:39:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1bf3116d-0bab-489a-bf18-369869a5c34d tempest-GroupsV314Test-490172018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d2912785-596a-49d6-b4cc-547cfc8c71a7 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:05 devstack sudo[98912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d2912785-596a-49d6-b4cc-547cfc8c71a7 Nov 03 07:39:05 devstack sudo[98912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:05 devstack sudo[98912]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1bf3116d-0bab-489a-bf18-369869a5c34d tempest-GroupsV314Test-490172018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d2912785-596a-49d6-b4cc-547cfc8c71a7" returned: 0 in 0.641s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1bf3116d-0bab-489a-bf18-369869a5c34d tempest-GroupsV314Test-490172018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d2912785-596a-49d6-b4cc-547cfc8c71a7.468c59ff-6028-4a9f-b8c1-3f125c02d6d8 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:05 devstack sudo[98917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d2912785-596a-49d6-b4cc-547cfc8c71a7.468c59ff-6028-4a9f-b8c1-3f125c02d6d8 Nov 03 07:39:05 devstack sudo[98917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:06 devstack sudo[98917]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1bf3116d-0bab-489a-bf18-369869a5c34d tempest-GroupsV314Test-490172018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d2912785-596a-49d6-b4cc-547cfc8c71a7.468c59ff-6028-4a9f-b8c1-3f125c02d6d8" returned: 0 in 0.480s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1bf3116d-0bab-489a-bf18-369869a5c34d tempest-GroupsV314Test-490172018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d2912785-596a-49d6-b4cc-547cfc8c71a7.468c59ff-6028-4a9f-b8c1-3f125c02d6d8 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:06 devstack sudo[98922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d2912785-596a-49d6-b4cc-547cfc8c71a7.468c59ff-6028-4a9f-b8c1-3f125c02d6d8 Nov 03 07:39:06 devstack sudo[98922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:06 devstack sudo[98922]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1bf3116d-0bab-489a-bf18-369869a5c34d tempest-GroupsV314Test-490172018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d2912785-596a-49d6-b4cc-547cfc8c71a7.468c59ff-6028-4a9f-b8c1-3f125c02d6d8" returned: 0 in 0.332s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:06 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-1bf3116d-0bab-489a-bf18-369869a5c34d tempest-GroupsV314Test-490172018 None] Lock "cinder-quobyte-468c59ff-6028-4a9f-b8c1-3f125c02d6d8" released by "_delete_snapshot" :: held 2.114s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-1bf3116d-0bab-489a-bf18-369869a5c34d tempest-GroupsV314Test-490172018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.692s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-d7a5ac45-99ed-4e14-91f5-5f100bfd07c8 req-4f5010db-e9f8-4e90-a6b5-d2ebc9de8690 tempest-TestServerVolumeAttachmentScenario-550494203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 13.110s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-d7a5ac45-99ed-4e14-91f5-5f100bfd07c8 req-4f5010db-e9f8-4e90-a6b5-d2ebc9de8690 tempest-TestServerVolumeAttachmentScenario-550494203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0f76fa6e-7b35-4200-a3fe-037ea3d3ea46 tempest-TestShelveInstance-2081252662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.373s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:06 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-0f76fa6e-7b35-4200-a3fe-037ea3d3ea46 tempest-TestShelveInstance-2081252662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:38:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1227584993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=442c9ef6-b786-4e22-b5e3-e222b7b63413,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd465ddf3e8e4b9e892c5de73a6fd256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:38:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:38:56Z,use_quota=True,user_id='e3754d18f7c6407bb269027b82db4042',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:39:06 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-0f76fa6e-7b35-4200-a3fe-037ea3d3ea46 tempest-TestShelveInstance-2081252662 None] Creating volume 442c9ef6-b786-4e22-b5e3-e222b7b63413 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:39:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0f76fa6e-7b35-4200-a3fe-037ea3d3ea46 tempest-TestShelveInstance-2081252662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0f76fa6e-7b35-4200-a3fe-037ea3d3ea46 tempest-TestShelveInstance-2081252662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:06 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-0f76fa6e-7b35-4200-a3fe-037ea3d3ea46 tempest-TestShelveInstance-2081252662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:39:06 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-0f76fa6e-7b35-4200-a3fe-037ea3d3ea46 tempest-TestShelveInstance-2081252662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:39:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0f76fa6e-7b35-4200-a3fe-037ea3d3ea46 tempest-TestShelveInstance-2081252662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:06 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-0f76fa6e-7b35-4200-a3fe-037ea3d3ea46 tempest-TestShelveInstance-2081252662 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:39:06 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-0f76fa6e-7b35-4200-a3fe-037ea3d3ea46 tempest-TestShelveInstance-2081252662 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:39:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0f76fa6e-7b35-4200-a3fe-037ea3d3ea46 tempest-TestShelveInstance-2081252662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-442c9ef6-b786-4e22-b5e3-e222b7b63413 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:06 devstack sudo[98925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-442c9ef6-b786-4e22-b5e3-e222b7b63413 1073741824 Nov 03 07:39:06 devstack sudo[98925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-d7a5ac45-99ed-4e14-91f5-5f100bfd07c8 req-4f5010db-e9f8-4e90-a6b5-d2ebc9de8690 tempest-TestServerVolumeAttachmentScenario-550494203 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1', 'name': 'volume-935e5aa5-422b-47cf-ad8e-d906843705aa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e470728d-2fa1-4a65-89ba-79d3ea93765d', 'enforce_multipath': True} {{(pid=86875) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:39:06 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-1bf3116d-0bab-489a-bf18-369869a5c34d tempest-GroupsV314Test-490172018 None] Create group from source-group-d16d58d6-5c9e-4e07-b928-f6e72aaf3b32 completed successfully. Nov 03 07:39:06 devstack cinder-volume[86875]: INFO cinder.volume.manager [req-d7a5ac45-99ed-4e14-91f5-5f100bfd07c8 req-4f5010db-e9f8-4e90-a6b5-d2ebc9de8690 tempest-TestServerVolumeAttachmentScenario-550494203 None] attachment_update completed successfully. Nov 03 07:39:07 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-23a919bd-797e-4f02-8f2d-fc6c12b68728 tempest-AttachVolumeShelveTestJSON-717092369 None] Acquiring lock "cinder-982b59ef-ef75-44f8-b28e-c0bf1a0811d2-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:07 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-23a919bd-797e-4f02-8f2d-fc6c12b68728 tempest-AttachVolumeShelveTestJSON-717092369 None] Lock "cinder-982b59ef-ef75-44f8-b28e-c0bf1a0811d2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:07 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-23a919bd-797e-4f02-8f2d-fc6c12b68728 tempest-AttachVolumeShelveTestJSON-717092369 None] Acquiring lock "cinder-quobyte-982b59ef-ef75-44f8-b28e-c0bf1a0811d2" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:07 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-23a919bd-797e-4f02-8f2d-fc6c12b68728 tempest-AttachVolumeShelveTestJSON-717092369 None] Lock "cinder-quobyte-982b59ef-ef75-44f8-b28e-c0bf1a0811d2" acquired by "delete_volume" :: waited 0.020s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:07 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f42d9e-7839-42c7-86f2-750a735cfd13]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:39:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-23a919bd-797e-4f02-8f2d-fc6c12b68728 tempest-AttachVolumeShelveTestJSON-717092369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-982b59ef-ef75-44f8-b28e-c0bf1a0811d2 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:07 devstack sudo[98925]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0f76fa6e-7b35-4200-a3fe-037ea3d3ea46 tempest-TestShelveInstance-2081252662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-442c9ef6-b786-4e22-b5e3-e222b7b63413 1073741824" returned: 0 in 0.893s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0f76fa6e-7b35-4200-a3fe-037ea3d3ea46 tempest-TestShelveInstance-2081252662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-442c9ef6-b786-4e22-b5e3-e222b7b63413 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:07 devstack sudo[98959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-442c9ef6-b786-4e22-b5e3-e222b7b63413 Nov 03 07:39:07 devstack sudo[98959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:07 devstack sudo[98957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-982b59ef-ef75-44f8-b28e-c0bf1a0811d2 Nov 03 07:39:07 devstack sudo[98957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:07 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-1ed54fda-f7f4-4b9a-b066-706f5f0bd6bc tempest-GroupsV314Test-490172018 None] Acquiring lock "cinder-quobyte-bd7bd52e-cec8-48c2-bfd6-9806166989b7" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:07 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-1ed54fda-f7f4-4b9a-b066-706f5f0bd6bc tempest-GroupsV314Test-490172018 None] Lock "cinder-quobyte-bd7bd52e-cec8-48c2-bfd6-9806166989b7" acquired by "delete_volume" :: waited 0.018s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:07 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[4490dfd9-79f4-473b-97ab-4f6771060a8a]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:39:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1ed54fda-f7f4-4b9a-b066-706f5f0bd6bc tempest-GroupsV314Test-490172018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bd7bd52e-cec8-48c2-bfd6-9806166989b7 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:07 devstack sudo[98959]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0f76fa6e-7b35-4200-a3fe-037ea3d3ea46 tempest-TestShelveInstance-2081252662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-442c9ef6-b786-4e22-b5e3-e222b7b63413" returned: 0 in 0.446s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:07 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-0f76fa6e-7b35-4200-a3fe-037ea3d3ea46 tempest-TestShelveInstance-2081252662 None] <== create_volume: return (1448ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:39:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0f76fa6e-7b35-4200-a3fe-037ea3d3ea46 tempest-TestShelveInstance-2081252662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.451s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:08 devstack cinder-volume[86875]: DEBUG cinder.volume.volume_utils [None req-0f76fa6e-7b35-4200-a3fe-037ea3d3ea46 tempest-TestShelveInstance-2081252662 None] Attempting download of eb68a148-0c9c-4237-9d8d-94a6a7cd87d9 ((None, [{'url': 'file:///opt/stack/data/glance/images/eb68a148-0c9c-4237-9d8d-94a6a7cd87d9', 'metadata': {}}])) to volume 442c9ef6-b786-4e22-b5e3-e222b7b63413. {{(pid=86875) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 07:39:08 devstack sudo[98963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bd7bd52e-cec8-48c2-bfd6-9806166989b7 Nov 03 07:39:08 devstack sudo[98963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:08 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[6974e748-ad25-40a6-a601-bf6e8c276ac6]: (4, 'raw') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:39:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0f76fa6e-7b35-4200-a3fe-037ea3d3ea46 tempest-TestShelveInstance-2081252662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_7md4wfgf {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:08 devstack sudo[98957]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-23a919bd-797e-4f02-8f2d-fc6c12b68728 tempest-AttachVolumeShelveTestJSON-717092369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-982b59ef-ef75-44f8-b28e-c0bf1a0811d2" returned: 0 in 0.795s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-23a919bd-797e-4f02-8f2d-fc6c12b68728 tempest-AttachVolumeShelveTestJSON-717092369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-982b59ef-ef75-44f8-b28e-c0bf1a0811d2 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:08 devstack sudo[98969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-982b59ef-ef75-44f8-b28e-c0bf1a0811d2 Nov 03 07:39:08 devstack sudo[98969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:08 devstack sudo[98968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_7md4wfgf Nov 03 07:39:08 devstack sudo[98968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:08 devstack sudo[98963]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1ed54fda-f7f4-4b9a-b066-706f5f0bd6bc tempest-GroupsV314Test-490172018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bd7bd52e-cec8-48c2-bfd6-9806166989b7" returned: 0 in 0.546s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1ed54fda-f7f4-4b9a-b066-706f5f0bd6bc tempest-GroupsV314Test-490172018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bd7bd52e-cec8-48c2-bfd6-9806166989b7 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:08 devstack sudo[98977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bd7bd52e-cec8-48c2-bfd6-9806166989b7 Nov 03 07:39:08 devstack sudo[98977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:08 devstack sudo[98968]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0f76fa6e-7b35-4200-a3fe-037ea3d3ea46 tempest-TestShelveInstance-2081252662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_7md4wfgf" returned: 0 in 0.449s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0f76fa6e-7b35-4200-a3fe-037ea3d3ea46 tempest-TestShelveInstance-2081252662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_7md4wfgf {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:08 devstack sudo[98969]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-23a919bd-797e-4f02-8f2d-fc6c12b68728 tempest-AttachVolumeShelveTestJSON-717092369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-982b59ef-ef75-44f8-b28e-c0bf1a0811d2" returned: 0 in 0.443s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:08 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-23a919bd-797e-4f02-8f2d-fc6c12b68728 tempest-AttachVolumeShelveTestJSON-717092369 None] Lock "cinder-quobyte-982b59ef-ef75-44f8-b28e-c0bf1a0811d2" released by "delete_volume" :: held 1.322s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:08 devstack sudo[98980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_7md4wfgf Nov 03 07:39:08 devstack sudo[98980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:08 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-23a919bd-797e-4f02-8f2d-fc6c12b68728 tempest-AttachVolumeShelveTestJSON-717092369 None] Created reservations ['31abe08b-8043-46a1-bce3-4acbe662b768', '027252a0-5ded-4da7-809c-46dcf9accc06', '5afcf343-a34c-41fb-9582-72bda06af088', '950e0c9e-7567-4497-8ab6-4a0203900230'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:39:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-23a919bd-797e-4f02-8f2d-fc6c12b68728 tempest-AttachVolumeShelveTestJSON-717092369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-23a919bd-797e-4f02-8f2d-fc6c12b68728 tempest-AttachVolumeShelveTestJSON-717092369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:08 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-23a919bd-797e-4f02-8f2d-fc6c12b68728 tempest-AttachVolumeShelveTestJSON-717092369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:39:08 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-23a919bd-797e-4f02-8f2d-fc6c12b68728 tempest-AttachVolumeShelveTestJSON-717092369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:39:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-23a919bd-797e-4f02-8f2d-fc6c12b68728 tempest-AttachVolumeShelveTestJSON-717092369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-23a919bd-797e-4f02-8f2d-fc6c12b68728 tempest-AttachVolumeShelveTestJSON-717092369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:08 devstack sudo[98977]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:08 devstack sudo[98983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:39:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1ed54fda-f7f4-4b9a-b066-706f5f0bd6bc tempest-GroupsV314Test-490172018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bd7bd52e-cec8-48c2-bfd6-9806166989b7" returned: 0 in 0.410s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:08 devstack sudo[98983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:08 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-1ed54fda-f7f4-4b9a-b066-706f5f0bd6bc tempest-GroupsV314Test-490172018 None] Lock "cinder-quobyte-bd7bd52e-cec8-48c2-bfd6-9806166989b7" released by "delete_volume" :: held 1.034s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:09 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-1ed54fda-f7f4-4b9a-b066-706f5f0bd6bc tempest-GroupsV314Test-490172018 None] Created reservations ['8516bb4c-24c3-424d-aca1-3c30280ec01c'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:39:09 devstack sudo[98980]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0f76fa6e-7b35-4200-a3fe-037ea3d3ea46 tempest-TestShelveInstance-2081252662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_7md4wfgf" returned: 1 in 0.474s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0f76fa6e-7b35-4200-a3fe-037ea3d3ea46 tempest-TestShelveInstance-2081252662 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_7md4wfgf' failed. Not Retrying. {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:39:09 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ade5391-c8c9-4d76-9af3-612a9c45140b]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:39:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0f76fa6e-7b35-4200-a3fe-037ea3d3ea46 tempest-TestShelveInstance-2081252662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_z1yzy3z3devstack@QuobyteHD {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:09 devstack cinder-volume[86875]: WARNING cinder.quota [None req-1ed54fda-f7f4-4b9a-b066-706f5f0bd6bc tempest-GroupsV314Test-490172018 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-2144864725 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-2144864725, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:39:09 devstack cinder-volume[86875]: WARNING cinder.quota [None req-1ed54fda-f7f4-4b9a-b066-706f5f0bd6bc tempest-GroupsV314Test-490172018 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-2144864725 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-2144864725, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:39:09 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-1ed54fda-f7f4-4b9a-b066-706f5f0bd6bc tempest-GroupsV314Test-490172018 None] Created reservations ['548cef7e-83d0-4469-87dc-67c61f1f8451', 'd9d44b75-3dba-481e-94a6-6c436b3615b2', '426cf13c-4d4c-4756-a5d7-bfe5b39ec547', 'f0e98275-432e-4883-975a-f76ef9e736f4'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:39:09 devstack sudo[98987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_z1yzy3z3devstack@QuobyteHD Nov 03 07:39:09 devstack sudo[98987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:09 devstack sudo[98983]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-23a919bd-797e-4f02-8f2d-fc6c12b68728 tempest-AttachVolumeShelveTestJSON-717092369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.396s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:09 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-23a919bd-797e-4f02-8f2d-fc6c12b68728 tempest-AttachVolumeShelveTestJSON-717092369 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:39:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-1ed54fda-f7f4-4b9a-b066-706f5f0bd6bc tempest-GroupsV314Test-490172018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-1ed54fda-f7f4-4b9a-b066-706f5f0bd6bc tempest-GroupsV314Test-490172018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:09 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-1ed54fda-f7f4-4b9a-b066-706f5f0bd6bc tempest-GroupsV314Test-490172018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:39:09 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-1ed54fda-f7f4-4b9a-b066-706f5f0bd6bc tempest-GroupsV314Test-490172018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:39:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-1ed54fda-f7f4-4b9a-b066-706f5f0bd6bc tempest-GroupsV314Test-490172018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1ed54fda-f7f4-4b9a-b066-706f5f0bd6bc tempest-GroupsV314Test-490172018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:09 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-23a919bd-797e-4f02-8f2d-fc6c12b68728 tempest-AttachVolumeShelveTestJSON-717092369 None] Deleted volume successfully. Nov 03 07:39:09 devstack sudo[98992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:39:09 devstack sudo[98992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:09 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-23a919bd-797e-4f02-8f2d-fc6c12b68728 tempest-AttachVolumeShelveTestJSON-717092369 None] Lock "cinder-982b59ef-ef75-44f8-b28e-c0bf1a0811d2-delete_volume" released by "delete_volume" :: held 2.152s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:09 devstack cinder-volume[86875]: INFO cinder.volume.manager [req-ac3ea8fd-dc96-49b6-ac93-af1adccdb63f req-e18e96fe-51a3-41a4-8f41-71effe2e49dc tempest-TestServerVolumeAttachmentScenario-550494203 None] Terminate volume connection completed successfully. Nov 03 07:39:09 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-ac3ea8fd-dc96-49b6-ac93-af1adccdb63f req-e18e96fe-51a3-41a4-8f41-71effe2e49dc tempest-TestServerVolumeAttachmentScenario-550494203 None] Deleting attachment e470728d-2fa1-4a65-89ba-79d3ea93765d. {{(pid=86875) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:39:09 devstack sudo[98987]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0f76fa6e-7b35-4200-a3fe-037ea3d3ea46 tempest-TestShelveInstance-2081252662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_z1yzy3z3devstack@QuobyteHD" returned: 0 in 0.510s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:09 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-0f76fa6e-7b35-4200-a3fe-037ea3d3ea46 tempest-TestShelveInstance-2081252662 None] eb68a148-0c9c-4237-9d8d-94a6a7cd87d9 was qcow2, converting to qcow2 {{(pid=86875) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 07:39:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0f76fa6e-7b35-4200-a3fe-037ea3d3ea46 tempest-TestShelveInstance-2081252662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_z1yzy3z3devstack@QuobyteHD /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-442c9ef6-b786-4e22-b5e3-e222b7b63413 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:09 devstack sudo[98992]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:09 devstack sudo[98999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_z1yzy3z3devstack@QuobyteHD /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-442c9ef6-b786-4e22-b5e3-e222b7b63413 Nov 03 07:39:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1ed54fda-f7f4-4b9a-b066-706f5f0bd6bc tempest-GroupsV314Test-490172018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.338s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:09 devstack sudo[98999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:09 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-1ed54fda-f7f4-4b9a-b066-706f5f0bd6bc tempest-GroupsV314Test-490172018 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:39:09 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-1ed54fda-f7f4-4b9a-b066-706f5f0bd6bc tempest-GroupsV314Test-490172018 None] Delete group completed successfully. Nov 03 07:39:09 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-3a57d825-8a3f-4769-99d4-b3e5652eca08 tempest-GroupsV314Test-490172018 None] Acquiring lock "cinder-quobyte-d2912785-596a-49d6-b4cc-547cfc8c71a7" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:09 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-3a57d825-8a3f-4769-99d4-b3e5652eca08 tempest-GroupsV314Test-490172018 None] Lock "cinder-quobyte-d2912785-596a-49d6-b4cc-547cfc8c71a7" acquired by "delete_volume" :: waited 0.027s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:09 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[eadb328b-8f63-430d-9b6f-561f42071acc]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:39:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3a57d825-8a3f-4769-99d4-b3e5652eca08 tempest-GroupsV314Test-490172018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d2912785-596a-49d6-b4cc-547cfc8c71a7 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:09 devstack sudo[99001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d2912785-596a-49d6-b4cc-547cfc8c71a7 Nov 03 07:39:09 devstack sudo[99001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:10 devstack sudo[99001]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3a57d825-8a3f-4769-99d4-b3e5652eca08 tempest-GroupsV314Test-490172018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d2912785-596a-49d6-b4cc-547cfc8c71a7" returned: 0 in 0.511s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3a57d825-8a3f-4769-99d4-b3e5652eca08 tempest-GroupsV314Test-490172018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d2912785-596a-49d6-b4cc-547cfc8c71a7 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:10 devstack sudo[99011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d2912785-596a-49d6-b4cc-547cfc8c71a7 Nov 03 07:39:10 devstack sudo[99011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:10 devstack sudo[99011]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3a57d825-8a3f-4769-99d4-b3e5652eca08 tempest-GroupsV314Test-490172018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d2912785-596a-49d6-b4cc-547cfc8c71a7" returned: 0 in 0.469s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:10 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-3a57d825-8a3f-4769-99d4-b3e5652eca08 tempest-GroupsV314Test-490172018 None] Lock "cinder-quobyte-d2912785-596a-49d6-b4cc-547cfc8c71a7" released by "delete_volume" :: held 1.101s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:10 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-3a57d825-8a3f-4769-99d4-b3e5652eca08 tempest-GroupsV314Test-490172018 None] Created reservations ['df7ed37d-53ba-4591-a41c-1b38310984f8'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:39:11 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-3a57d825-8a3f-4769-99d4-b3e5652eca08 tempest-GroupsV314Test-490172018 None] Created reservations ['6443dea5-55af-4199-8af7-dc951a5a2026', '774b561f-3987-459b-893b-3bbce007eb50', '0fbc6a61-a95a-4078-8f21-22da520f21e8', '5984a808-41e3-49e6-85a1-a832ea16dcdd'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:39:11 devstack cinder-volume[86875]: INFO cinder.volume.manager [req-14f43572-1741-4a71-bf65-ddd1b4439dc2 req-f30a0ea2-6063-471e-9bd1-80eb5b74cac2 tempest-TestServerVolumeAttachmentScenario-550494203 None] Terminate volume connection completed successfully. Nov 03 07:39:11 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-14f43572-1741-4a71-bf65-ddd1b4439dc2 req-f30a0ea2-6063-471e-9bd1-80eb5b74cac2 tempest-TestServerVolumeAttachmentScenario-550494203 None] Deleting attachment e756d32e-c79c-41c4-92a2-536feb724837. {{(pid=86875) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:39:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3a57d825-8a3f-4769-99d4-b3e5652eca08 tempest-GroupsV314Test-490172018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3a57d825-8a3f-4769-99d4-b3e5652eca08 tempest-GroupsV314Test-490172018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:11 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-3a57d825-8a3f-4769-99d4-b3e5652eca08 tempest-GroupsV314Test-490172018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:39:11 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-3a57d825-8a3f-4769-99d4-b3e5652eca08 tempest-GroupsV314Test-490172018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:39:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3a57d825-8a3f-4769-99d4-b3e5652eca08 tempest-GroupsV314Test-490172018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3a57d825-8a3f-4769-99d4-b3e5652eca08 tempest-GroupsV314Test-490172018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:11 devstack sudo[99017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:39:11 devstack sudo[99017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:11 devstack sudo[99017]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3a57d825-8a3f-4769-99d4-b3e5652eca08 tempest-GroupsV314Test-490172018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.412s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:11 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-3a57d825-8a3f-4769-99d4-b3e5652eca08 tempest-GroupsV314Test-490172018 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:39:11 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-3a57d825-8a3f-4769-99d4-b3e5652eca08 tempest-GroupsV314Test-490172018 None] Delete group completed successfully. Nov 03 07:39:12 devstack sudo[98999]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:12 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0f76fa6e-7b35-4200-a3fe-037ea3d3ea46 tempest-TestShelveInstance-2081252662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_z1yzy3z3devstack@QuobyteHD /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-442c9ef6-b786-4e22-b5e3-e222b7b63413" returned: 0 in 2.991s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:12 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-0f76fa6e-7b35-4200-a3fe-037ea3d3ea46 tempest-TestShelveInstance-2081252662 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_z1yzy3z3devstack@QuobyteHD, size 112.00 MB, duration 2.99 sec, destination /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-442c9ef6-b786-4e22-b5e3-e222b7b63413 {{(pid=86875) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:39:12 devstack cinder-volume[86875]: INFO cinder.image.image_utils [None req-0f76fa6e-7b35-4200-a3fe-037ea3d3ea46 tempest-TestShelveInstance-2081252662 None] Converted 112.00 MB image at 37.44 MB/s Nov 03 07:39:12 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0f76fa6e-7b35-4200-a3fe-037ea3d3ea46 tempest-TestShelveInstance-2081252662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-442c9ef6-b786-4e22-b5e3-e222b7b63413 1G {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:12 devstack sudo[99025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-442c9ef6-b786-4e22-b5e3-e222b7b63413 1G Nov 03 07:39:12 devstack sudo[99025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:13 devstack sudo[99025]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0f76fa6e-7b35-4200-a3fe-037ea3d3ea46 tempest-TestShelveInstance-2081252662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-442c9ef6-b786-4e22-b5e3-e222b7b63413 1G" returned: 0 in 0.799s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:13 devstack cinder-volume[86875]: DEBUG cinder.volume.volume_utils [None req-0f76fa6e-7b35-4200-a3fe-037ea3d3ea46 tempest-TestShelveInstance-2081252662 None] Downloaded image eb68a148-0c9c-4237-9d8d-94a6a7cd87d9 ((None, [{'url': 'file:///opt/stack/data/glance/images/eb68a148-0c9c-4237-9d8d-94a6a7cd87d9', 'metadata': {}}])) to volume 442c9ef6-b786-4e22-b5e3-e222b7b63413 successfully. {{(pid=86875) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 07:39:13 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-0f76fa6e-7b35-4200-a3fe-037ea3d3ea46 tempest-TestShelveInstance-2081252662 None] Temporary image eb68a148-0c9c-4237-9d8d-94a6a7cd87d9 for user e3754d18f7c6407bb269027b82db4042 is deleted. {{(pid=86875) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 07:39:13 devstack cinder-volume[86875]: DEBUG cinder.volume.volume_utils [None req-0f76fa6e-7b35-4200-a3fe-037ea3d3ea46 tempest-TestShelveInstance-2081252662 None] Marking volume 442c9ef6-b786-4e22-b5e3-e222b7b63413 as bootable. {{(pid=86875) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 07:39:13 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f76fa6e-7b35-4200-a3fe-037ea3d3ea46 tempest-TestShelveInstance-2081252662 None] Copying metadata from image eb68a148-0c9c-4237-9d8d-94a6a7cd87d9 to 442c9ef6-b786-4e22-b5e3-e222b7b63413. {{(pid=86875) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 07:39:13 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f76fa6e-7b35-4200-a3fe-037ea3d3ea46 tempest-TestShelveInstance-2081252662 None] Creating volume glance metadata for volume 442c9ef6-b786-4e22-b5e3-e222b7b63413 backed by image eb68a148-0c9c-4237-9d8d-94a6a7cd87d9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'eb68a148-0c9c-4237-9d8d-94a6a7cd87d9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86875) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 07:39:13 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0f76fa6e-7b35-4200-a3fe-037ea3d3ea46 tempest-TestShelveInstance-2081252662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0f2b7d6-0d3a-42c8-86f5-7a50f150b07d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-442c9ef6-b786-4e22-b5e3-e222b7b63413', 'volume_size': 1, 'image_id': 'eb68a148-0c9c-4237-9d8d-94a6a7cd87d9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eb68a148-0c9c-4237-9d8d-94a6a7cd87d9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c9ace38ee46b42979b3d4c79532bd66e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eb68a148-0c9c-4237-9d8d-94a6a7cd87d9', 'created_at': datetime.datetime(2026, 11, 3, 6, 21, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 21, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eb68a148-0c9c-4237-9d8d-94a6a7cd87d9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:13 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0f76fa6e-7b35-4200-a3fe-037ea3d3ea46 tempest-TestShelveInstance-2081252662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (876c3848-5fc8-4b19-acb1-3945686174fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:13 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-0f76fa6e-7b35-4200-a3fe-037ea3d3ea46 tempest-TestShelveInstance-2081252662 None] Volume volume-442c9ef6-b786-4e22-b5e3-e222b7b63413 (442c9ef6-b786-4e22-b5e3-e222b7b63413): created successfully Nov 03 07:39:13 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0f76fa6e-7b35-4200-a3fe-037ea3d3ea46 tempest-TestShelveInstance-2081252662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (876c3848-5fc8-4b19-acb1-3945686174fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:13 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0f76fa6e-7b35-4200-a3fe-037ea3d3ea46 tempest-TestShelveInstance-2081252662 None] Flow 'volume_create_manager' (c9bef489-af6a-424a-be46-8986f6ca2192) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:39:13 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-0f76fa6e-7b35-4200-a3fe-037ea3d3ea46 tempest-TestShelveInstance-2081252662 None] Created volume successfully. Nov 03 07:39:19 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a475724d-56ac-403e-b21d-30d185cb641d tempest-TestServerVolumeAttachmentScenario-550494203 None] Acquiring lock "cinder-935e5aa5-422b-47cf-ad8e-d906843705aa-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:19 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a475724d-56ac-403e-b21d-30d185cb641d tempest-TestServerVolumeAttachmentScenario-550494203 None] Lock "cinder-935e5aa5-422b-47cf-ad8e-d906843705aa-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:19 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a475724d-56ac-403e-b21d-30d185cb641d tempest-TestServerVolumeAttachmentScenario-550494203 None] Acquiring lock "cinder-quobyte-935e5aa5-422b-47cf-ad8e-d906843705aa" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:19 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a475724d-56ac-403e-b21d-30d185cb641d tempest-TestServerVolumeAttachmentScenario-550494203 None] Lock "cinder-quobyte-935e5aa5-422b-47cf-ad8e-d906843705aa" acquired by "delete_volume" :: waited 0.023s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:19 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[36916ca3-f25d-4077-a0db-517828ac16ba]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:39:19 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a475724d-56ac-403e-b21d-30d185cb641d tempest-TestServerVolumeAttachmentScenario-550494203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-935e5aa5-422b-47cf-ad8e-d906843705aa {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:19 devstack sudo[99063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-935e5aa5-422b-47cf-ad8e-d906843705aa Nov 03 07:39:19 devstack sudo[99063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:19 devstack sudo[99063]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:19 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a475724d-56ac-403e-b21d-30d185cb641d tempest-TestServerVolumeAttachmentScenario-550494203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-935e5aa5-422b-47cf-ad8e-d906843705aa" returned: 0 in 0.550s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:19 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a475724d-56ac-403e-b21d-30d185cb641d tempest-TestServerVolumeAttachmentScenario-550494203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-935e5aa5-422b-47cf-ad8e-d906843705aa {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:20 devstack sudo[99068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-935e5aa5-422b-47cf-ad8e-d906843705aa Nov 03 07:39:20 devstack sudo[99068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:20 devstack sudo[99068]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a475724d-56ac-403e-b21d-30d185cb641d tempest-TestServerVolumeAttachmentScenario-550494203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-935e5aa5-422b-47cf-ad8e-d906843705aa" returned: 0 in 0.408s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:20 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a475724d-56ac-403e-b21d-30d185cb641d tempest-TestServerVolumeAttachmentScenario-550494203 None] Lock "cinder-quobyte-935e5aa5-422b-47cf-ad8e-d906843705aa" released by "delete_volume" :: held 1.035s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:20 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-a475724d-56ac-403e-b21d-30d185cb641d tempest-TestServerVolumeAttachmentScenario-550494203 None] Created reservations ['b7ee8e0e-5042-461a-97ae-ae448a592c08', '6e0dc48c-2eb1-4edf-b419-86b6050024d5', '081690b5-23c5-43d4-81af-c431ee3eaa24', '9ff18fae-5928-44c3-865d-80274d7d04fb'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:39:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a475724d-56ac-403e-b21d-30d185cb641d tempest-TestServerVolumeAttachmentScenario-550494203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a475724d-56ac-403e-b21d-30d185cb641d tempest-TestServerVolumeAttachmentScenario-550494203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:20 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a475724d-56ac-403e-b21d-30d185cb641d tempest-TestServerVolumeAttachmentScenario-550494203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:39:20 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a475724d-56ac-403e-b21d-30d185cb641d tempest-TestServerVolumeAttachmentScenario-550494203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:39:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a475724d-56ac-403e-b21d-30d185cb641d tempest-TestServerVolumeAttachmentScenario-550494203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a475724d-56ac-403e-b21d-30d185cb641d tempest-TestServerVolumeAttachmentScenario-550494203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:20 devstack sudo[99105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:39:20 devstack sudo[99105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:21 devstack sudo[99105]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a475724d-56ac-403e-b21d-30d185cb641d tempest-TestServerVolumeAttachmentScenario-550494203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.428s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:21 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-a475724d-56ac-403e-b21d-30d185cb641d tempest-TestServerVolumeAttachmentScenario-550494203 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:39:21 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-a475724d-56ac-403e-b21d-30d185cb641d tempest-TestServerVolumeAttachmentScenario-550494203 None] Deleted volume successfully. Nov 03 07:39:21 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a475724d-56ac-403e-b21d-30d185cb641d tempest-TestServerVolumeAttachmentScenario-550494203 None] Lock "cinder-935e5aa5-422b-47cf-ad8e-d906843705aa-delete_volume" released by "delete_volume" :: held 1.925s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:21 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ec50687d-4ec0-4ee3-a705-c367da60bbb7 tempest-TestServerVolumeAttachmentScenario-550494203 None] Acquiring lock "cinder-291939ff-7368-47d5-a122-0a0d083c8a67-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:21 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ec50687d-4ec0-4ee3-a705-c367da60bbb7 tempest-TestServerVolumeAttachmentScenario-550494203 None] Lock "cinder-291939ff-7368-47d5-a122-0a0d083c8a67-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:21 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ec50687d-4ec0-4ee3-a705-c367da60bbb7 tempest-TestServerVolumeAttachmentScenario-550494203 None] Acquiring lock "cinder-quobyte-291939ff-7368-47d5-a122-0a0d083c8a67" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:21 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ec50687d-4ec0-4ee3-a705-c367da60bbb7 tempest-TestServerVolumeAttachmentScenario-550494203 None] Lock "cinder-quobyte-291939ff-7368-47d5-a122-0a0d083c8a67" acquired by "delete_volume" :: waited 0.030s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:22 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec209fa6-0cc7-4be8-91f9-a3e68e0895dc]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:39:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ec50687d-4ec0-4ee3-a705-c367da60bbb7 tempest-TestServerVolumeAttachmentScenario-550494203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-291939ff-7368-47d5-a122-0a0d083c8a67 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:22 devstack sudo[99117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-291939ff-7368-47d5-a122-0a0d083c8a67 Nov 03 07:39:22 devstack sudo[99117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-fdec48a0-9905-4ffb-8d96-9b61f4f8fa6e req-f45eba60-f6c4-4172-b877-153e368ac66c tempest-TestShelveInstance-2081252662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-fdec48a0-9905-4ffb-8d96-9b61f4f8fa6e req-f45eba60-f6c4-4172-b877-153e368ac66c tempest-TestShelveInstance-2081252662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-fdec48a0-9905-4ffb-8d96-9b61f4f8fa6e req-f45eba60-f6c4-4172-b877-153e368ac66c tempest-TestShelveInstance-2081252662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:22 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-fdec48a0-9905-4ffb-8d96-9b61f4f8fa6e req-f45eba60-f6c4-4172-b877-153e368ac66c tempest-TestShelveInstance-2081252662 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1', 'name': 'volume-442c9ef6-b786-4e22-b5e3-e222b7b63413', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9296d669-4be0-43be-bf3a-0ac538d7a704', 'enforce_multipath': True} {{(pid=86875) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:39:22 devstack cinder-volume[86875]: INFO cinder.volume.manager [req-fdec48a0-9905-4ffb-8d96-9b61f4f8fa6e req-f45eba60-f6c4-4172-b877-153e368ac66c tempest-TestShelveInstance-2081252662 None] attachment_update completed successfully. Nov 03 07:39:22 devstack sudo[99117]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ec50687d-4ec0-4ee3-a705-c367da60bbb7 tempest-TestServerVolumeAttachmentScenario-550494203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-291939ff-7368-47d5-a122-0a0d083c8a67" returned: 0 in 0.681s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ec50687d-4ec0-4ee3-a705-c367da60bbb7 tempest-TestServerVolumeAttachmentScenario-550494203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-291939ff-7368-47d5-a122-0a0d083c8a67 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:22 devstack sudo[99123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-291939ff-7368-47d5-a122-0a0d083c8a67 Nov 03 07:39:22 devstack sudo[99123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:23 devstack sudo[99123]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ec50687d-4ec0-4ee3-a705-c367da60bbb7 tempest-TestServerVolumeAttachmentScenario-550494203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-291939ff-7368-47d5-a122-0a0d083c8a67" returned: 0 in 0.514s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:23 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ec50687d-4ec0-4ee3-a705-c367da60bbb7 tempest-TestServerVolumeAttachmentScenario-550494203 None] Lock "cinder-quobyte-291939ff-7368-47d5-a122-0a0d083c8a67" released by "delete_volume" :: held 1.282s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:23 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-ec50687d-4ec0-4ee3-a705-c367da60bbb7 tempest-TestServerVolumeAttachmentScenario-550494203 None] Created reservations ['4f5aece7-d5d5-4715-8e88-5295787e1268', 'cd83c5d5-f28c-4b64-bc99-abd7c4041cf3', 'af6b7d81-df45-4565-89a3-61870567b9bb', '364f014f-90f4-44ae-9801-8b22d2ff5fca'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:39:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-ec50687d-4ec0-4ee3-a705-c367da60bbb7 tempest-TestServerVolumeAttachmentScenario-550494203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-ec50687d-4ec0-4ee3-a705-c367da60bbb7 tempest-TestServerVolumeAttachmentScenario-550494203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:23 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-ec50687d-4ec0-4ee3-a705-c367da60bbb7 tempest-TestServerVolumeAttachmentScenario-550494203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:39:23 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-ec50687d-4ec0-4ee3-a705-c367da60bbb7 tempest-TestServerVolumeAttachmentScenario-550494203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:39:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-ec50687d-4ec0-4ee3-a705-c367da60bbb7 tempest-TestServerVolumeAttachmentScenario-550494203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ec50687d-4ec0-4ee3-a705-c367da60bbb7 tempest-TestServerVolumeAttachmentScenario-550494203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:23 devstack sudo[99126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:39:23 devstack sudo[99126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:23 devstack sudo[99126]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ec50687d-4ec0-4ee3-a705-c367da60bbb7 tempest-TestServerVolumeAttachmentScenario-550494203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.376s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:23 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-ec50687d-4ec0-4ee3-a705-c367da60bbb7 tempest-TestServerVolumeAttachmentScenario-550494203 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:39:23 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-ec50687d-4ec0-4ee3-a705-c367da60bbb7 tempest-TestServerVolumeAttachmentScenario-550494203 None] Deleted volume successfully. Nov 03 07:39:23 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ec50687d-4ec0-4ee3-a705-c367da60bbb7 tempest-TestServerVolumeAttachmentScenario-550494203 None] Lock "cinder-291939ff-7368-47d5-a122-0a0d083c8a67-delete_volume" released by "delete_volume" :: held 2.163s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:24 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc82267b-17d9-4616-af6d-98251b264038 tempest-VolumesTestJSON-502494852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:39:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fc82267b-17d9-4616-af6d-98251b264038 tempest-VolumesTestJSON-502494852 None] Flow 'volume_create_manager' (8688c824-bd2d-47a6-b2ec-e1ecaf0566bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:39:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fc82267b-17d9-4616-af6d-98251b264038 tempest-VolumesTestJSON-502494852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1059880b-2172-4910-b860-92a95fa91b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fc82267b-17d9-4616-af6d-98251b264038 tempest-VolumesTestJSON-502494852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1059880b-2172-4910-b860-92a95fa91b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:39:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1414343880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af70401d-30c8-4e82-9e9e-89da231266ae,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7c0a5c6a9ac64f2489b277eb879a43b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:39:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:39:25Z,use_quota=True,user_id='1f58f85097c64e20b68afc25882ebe3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fc82267b-17d9-4616-af6d-98251b264038 tempest-VolumesTestJSON-502494852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (959f68dd-44c5-426c-a074-1e67e63629f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fc82267b-17d9-4616-af6d-98251b264038 tempest-VolumesTestJSON-502494852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (959f68dd-44c5-426c-a074-1e67e63629f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fc82267b-17d9-4616-af6d-98251b264038 tempest-VolumesTestJSON-502494852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53a561e3-1376-4023-a0de-afeeafb5b593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fc82267b-17d9-4616-af6d-98251b264038 tempest-VolumesTestJSON-502494852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53a561e3-1376-4023-a0de-afeeafb5b593) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af70401d-30c8-4e82-9e9e-89da231266ae', 'volume_name': 'volume-af70401d-30c8-4e82-9e9e-89da231266ae', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fc82267b-17d9-4616-af6d-98251b264038 tempest-VolumesTestJSON-502494852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c714dcc-06c1-4251-98b3-fc998fca9187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fc82267b-17d9-4616-af6d-98251b264038 tempest-VolumesTestJSON-502494852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c714dcc-06c1-4251-98b3-fc998fca9187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fc82267b-17d9-4616-af6d-98251b264038 tempest-VolumesTestJSON-502494852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af10fcfc-a4d4-4d42-a809-921eb2569a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:24 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-fc82267b-17d9-4616-af6d-98251b264038 tempest-VolumesTestJSON-502494852 None] Volume af70401d-30c8-4e82-9e9e-89da231266ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af70401d-30c8-4e82-9e9e-89da231266ae', 'volume_size': 1} Nov 03 07:39:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-fc82267b-17d9-4616-af6d-98251b264038 tempest-VolumesTestJSON-502494852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-fc82267b-17d9-4616-af6d-98251b264038 tempest-VolumesTestJSON-502494852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:24 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-fc82267b-17d9-4616-af6d-98251b264038 tempest-VolumesTestJSON-502494852 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:39:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1414343880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af70401d-30c8-4e82-9e9e-89da231266ae,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7c0a5c6a9ac64f2489b277eb879a43b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:39:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:39:25Z,use_quota=True,user_id='1f58f85097c64e20b68afc25882ebe3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:39:24 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-fc82267b-17d9-4616-af6d-98251b264038 tempest-VolumesTestJSON-502494852 None] Creating volume af70401d-30c8-4e82-9e9e-89da231266ae {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:39:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-fc82267b-17d9-4616-af6d-98251b264038 tempest-VolumesTestJSON-502494852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-fc82267b-17d9-4616-af6d-98251b264038 tempest-VolumesTestJSON-502494852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:24 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-fc82267b-17d9-4616-af6d-98251b264038 tempest-VolumesTestJSON-502494852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:39:24 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-fc82267b-17d9-4616-af6d-98251b264038 tempest-VolumesTestJSON-502494852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:39:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-fc82267b-17d9-4616-af6d-98251b264038 tempest-VolumesTestJSON-502494852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:24 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-fc82267b-17d9-4616-af6d-98251b264038 tempest-VolumesTestJSON-502494852 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:39:24 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-fc82267b-17d9-4616-af6d-98251b264038 tempest-VolumesTestJSON-502494852 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:39:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fc82267b-17d9-4616-af6d-98251b264038 tempest-VolumesTestJSON-502494852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-af70401d-30c8-4e82-9e9e-89da231266ae 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:24 devstack sudo[99130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-af70401d-30c8-4e82-9e9e-89da231266ae 1073741824 Nov 03 07:39:24 devstack sudo[99130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:25 devstack sudo[99130]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fc82267b-17d9-4616-af6d-98251b264038 tempest-VolumesTestJSON-502494852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-af70401d-30c8-4e82-9e9e-89da231266ae 1073741824" returned: 0 in 0.663s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fc82267b-17d9-4616-af6d-98251b264038 tempest-VolumesTestJSON-502494852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-af70401d-30c8-4e82-9e9e-89da231266ae {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:25 devstack sudo[99137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-af70401d-30c8-4e82-9e9e-89da231266ae Nov 03 07:39:25 devstack sudo[99137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:25 devstack sudo[99137]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fc82267b-17d9-4616-af6d-98251b264038 tempest-VolumesTestJSON-502494852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-af70401d-30c8-4e82-9e9e-89da231266ae" returned: 0 in 0.336s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:25 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-fc82267b-17d9-4616-af6d-98251b264038 tempest-VolumesTestJSON-502494852 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:39:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-fc82267b-17d9-4616-af6d-98251b264038 tempest-VolumesTestJSON-502494852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:25 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fc82267b-17d9-4616-af6d-98251b264038 tempest-VolumesTestJSON-502494852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af10fcfc-a4d4-4d42-a809-921eb2569a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af70401d-30c8-4e82-9e9e-89da231266ae', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:25 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fc82267b-17d9-4616-af6d-98251b264038 tempest-VolumesTestJSON-502494852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26a00703-e0a9-4b61-9f90-2a0338e78a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:25 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-fc82267b-17d9-4616-af6d-98251b264038 tempest-VolumesTestJSON-502494852 None] Volume volume-af70401d-30c8-4e82-9e9e-89da231266ae (af70401d-30c8-4e82-9e9e-89da231266ae): created successfully Nov 03 07:39:25 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fc82267b-17d9-4616-af6d-98251b264038 tempest-VolumesTestJSON-502494852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26a00703-e0a9-4b61-9f90-2a0338e78a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:25 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fc82267b-17d9-4616-af6d-98251b264038 tempest-VolumesTestJSON-502494852 None] Flow 'volume_create_manager' (8688c824-bd2d-47a6-b2ec-e1ecaf0566bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:39:25 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-fc82267b-17d9-4616-af6d-98251b264038 tempest-VolumesTestJSON-502494852 None] Created volume successfully. Nov 03 07:39:28 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-17f34a1a-2854-40e0-978d-abc51f9bc0d1 tempest-VolumesTestJSON-502494852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:39:28 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-17f34a1a-2854-40e0-978d-abc51f9bc0d1 tempest-VolumesTestJSON-502494852 None] Flow 'volume_create_manager' (c5f9707d-07b2-44ea-a6da-417c97559c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:39:28 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-17f34a1a-2854-40e0-978d-abc51f9bc0d1 tempest-VolumesTestJSON-502494852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16e0c58d-a20d-4ef6-9127-0a4097073cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:28 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-17f34a1a-2854-40e0-978d-abc51f9bc0d1 tempest-VolumesTestJSON-502494852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16e0c58d-a20d-4ef6-9127-0a4097073cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:39:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1219030698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b303d0e-ff29-4bd8-a3a4-218e4d8ed493,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7c0a5c6a9ac64f2489b277eb879a43b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:39:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:39:28Z,use_quota=True,user_id='1f58f85097c64e20b68afc25882ebe3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:28 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-17f34a1a-2854-40e0-978d-abc51f9bc0d1 tempest-VolumesTestJSON-502494852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5cf5cf1-937a-4d3f-9f4a-0cf9ce799504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:28 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-17f34a1a-2854-40e0-978d-abc51f9bc0d1 tempest-VolumesTestJSON-502494852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5cf5cf1-937a-4d3f-9f4a-0cf9ce799504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:28 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-17f34a1a-2854-40e0-978d-abc51f9bc0d1 tempest-VolumesTestJSON-502494852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9f64d31-8939-415e-9f4f-f61de22d9e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:28 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-17f34a1a-2854-40e0-978d-abc51f9bc0d1 tempest-VolumesTestJSON-502494852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9f64d31-8939-415e-9f4f-f61de22d9e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b303d0e-ff29-4bd8-a3a4-218e4d8ed493', 'volume_name': 'volume-2b303d0e-ff29-4bd8-a3a4-218e4d8ed493', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:28 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-17f34a1a-2854-40e0-978d-abc51f9bc0d1 tempest-VolumesTestJSON-502494852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9903deec-2d17-4638-acf9-decda7005fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:28 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-17f34a1a-2854-40e0-978d-abc51f9bc0d1 tempest-VolumesTestJSON-502494852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9903deec-2d17-4638-acf9-decda7005fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:28 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-17f34a1a-2854-40e0-978d-abc51f9bc0d1 tempest-VolumesTestJSON-502494852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7f9d44b-bae3-4081-a819-3a3c6fc70823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:28 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-17f34a1a-2854-40e0-978d-abc51f9bc0d1 tempest-VolumesTestJSON-502494852 None] Volume 2b303d0e-ff29-4bd8-a3a4-218e4d8ed493: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b303d0e-ff29-4bd8-a3a4-218e4d8ed493', 'volume_size': 1} Nov 03 07:39:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-17f34a1a-2854-40e0-978d-abc51f9bc0d1 tempest-VolumesTestJSON-502494852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-17f34a1a-2854-40e0-978d-abc51f9bc0d1 tempest-VolumesTestJSON-502494852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:28 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-17f34a1a-2854-40e0-978d-abc51f9bc0d1 tempest-VolumesTestJSON-502494852 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:39:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1219030698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b303d0e-ff29-4bd8-a3a4-218e4d8ed493,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7c0a5c6a9ac64f2489b277eb879a43b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:39:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:39:28Z,use_quota=True,user_id='1f58f85097c64e20b68afc25882ebe3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:39:28 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-17f34a1a-2854-40e0-978d-abc51f9bc0d1 tempest-VolumesTestJSON-502494852 None] Creating volume 2b303d0e-ff29-4bd8-a3a4-218e4d8ed493 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:39:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-17f34a1a-2854-40e0-978d-abc51f9bc0d1 tempest-VolumesTestJSON-502494852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-17f34a1a-2854-40e0-978d-abc51f9bc0d1 tempest-VolumesTestJSON-502494852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:28 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-17f34a1a-2854-40e0-978d-abc51f9bc0d1 tempest-VolumesTestJSON-502494852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:39:28 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-17f34a1a-2854-40e0-978d-abc51f9bc0d1 tempest-VolumesTestJSON-502494852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:39:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-17f34a1a-2854-40e0-978d-abc51f9bc0d1 tempest-VolumesTestJSON-502494852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:28 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-17f34a1a-2854-40e0-978d-abc51f9bc0d1 tempest-VolumesTestJSON-502494852 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:39:28 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-17f34a1a-2854-40e0-978d-abc51f9bc0d1 tempest-VolumesTestJSON-502494852 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:39:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-17f34a1a-2854-40e0-978d-abc51f9bc0d1 tempest-VolumesTestJSON-502494852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2b303d0e-ff29-4bd8-a3a4-218e4d8ed493 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:28 devstack sudo[99623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2b303d0e-ff29-4bd8-a3a4-218e4d8ed493 1073741824 Nov 03 07:39:28 devstack sudo[99623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:29 devstack sudo[99623]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:29 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-17f34a1a-2854-40e0-978d-abc51f9bc0d1 tempest-VolumesTestJSON-502494852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2b303d0e-ff29-4bd8-a3a4-218e4d8ed493 1073741824" returned: 0 in 0.847s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:29 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-17f34a1a-2854-40e0-978d-abc51f9bc0d1 tempest-VolumesTestJSON-502494852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2b303d0e-ff29-4bd8-a3a4-218e4d8ed493 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:29 devstack sudo[99631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2b303d0e-ff29-4bd8-a3a4-218e4d8ed493 Nov 03 07:39:29 devstack sudo[99631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:30 devstack sudo[99631]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-17f34a1a-2854-40e0-978d-abc51f9bc0d1 tempest-VolumesTestJSON-502494852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2b303d0e-ff29-4bd8-a3a4-218e4d8ed493" returned: 0 in 0.402s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:30 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-17f34a1a-2854-40e0-978d-abc51f9bc0d1 tempest-VolumesTestJSON-502494852 None] <== create_volume: return (1345ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:39:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-17f34a1a-2854-40e0-978d-abc51f9bc0d1 tempest-VolumesTestJSON-502494852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.355s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:30 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-17f34a1a-2854-40e0-978d-abc51f9bc0d1 tempest-VolumesTestJSON-502494852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7f9d44b-bae3-4081-a819-3a3c6fc70823) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b303d0e-ff29-4bd8-a3a4-218e4d8ed493', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:30 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-17f34a1a-2854-40e0-978d-abc51f9bc0d1 tempest-VolumesTestJSON-502494852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f01be3eb-989d-4eb8-a7ae-02ef4a97043a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:30 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-17f34a1a-2854-40e0-978d-abc51f9bc0d1 tempest-VolumesTestJSON-502494852 None] Volume volume-2b303d0e-ff29-4bd8-a3a4-218e4d8ed493 (2b303d0e-ff29-4bd8-a3a4-218e4d8ed493): created successfully Nov 03 07:39:30 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-17f34a1a-2854-40e0-978d-abc51f9bc0d1 tempest-VolumesTestJSON-502494852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f01be3eb-989d-4eb8-a7ae-02ef4a97043a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:30 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-17f34a1a-2854-40e0-978d-abc51f9bc0d1 tempest-VolumesTestJSON-502494852 None] Flow 'volume_create_manager' (c5f9707d-07b2-44ea-a6da-417c97559c15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:39:30 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-17f34a1a-2854-40e0-978d-abc51f9bc0d1 tempest-VolumesTestJSON-502494852 None] Created volume successfully. Nov 03 07:39:31 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-67e94a85-1d25-4a91-836f-a1961f89b565 tempest-VolumesTestJSON-502494852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:39:31 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-67e94a85-1d25-4a91-836f-a1961f89b565 tempest-VolumesTestJSON-502494852 None] Flow 'volume_create_manager' (1740fa69-d7f3-4b29-8252-e04a75fd7083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:39:31 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-67e94a85-1d25-4a91-836f-a1961f89b565 tempest-VolumesTestJSON-502494852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e5b02ea-75ef-4c02-8d2b-5ee361f1e8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-67e94a85-1d25-4a91-836f-a1961f89b565 tempest-VolumesTestJSON-502494852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e5b02ea-75ef-4c02-8d2b-5ee361f1e8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-601985714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63ff058e-99ee-47ca-a173-edc4be58cec7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7c0a5c6a9ac64f2489b277eb879a43b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:39:32Z,use_quota=True,user_id='1f58f85097c64e20b68afc25882ebe3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-67e94a85-1d25-4a91-836f-a1961f89b565 tempest-VolumesTestJSON-502494852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8f02b1d-486f-4611-b90c-cfa60688b011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-67e94a85-1d25-4a91-836f-a1961f89b565 tempest-VolumesTestJSON-502494852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8f02b1d-486f-4611-b90c-cfa60688b011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-67e94a85-1d25-4a91-836f-a1961f89b565 tempest-VolumesTestJSON-502494852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcf11deb-728d-49da-978a-9915920670b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-67e94a85-1d25-4a91-836f-a1961f89b565 tempest-VolumesTestJSON-502494852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcf11deb-728d-49da-978a-9915920670b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63ff058e-99ee-47ca-a173-edc4be58cec7', 'volume_name': 'volume-63ff058e-99ee-47ca-a173-edc4be58cec7', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-67e94a85-1d25-4a91-836f-a1961f89b565 tempest-VolumesTestJSON-502494852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ff4101a-fe18-4634-afd8-210aabc544ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-67e94a85-1d25-4a91-836f-a1961f89b565 tempest-VolumesTestJSON-502494852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ff4101a-fe18-4634-afd8-210aabc544ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-67e94a85-1d25-4a91-836f-a1961f89b565 tempest-VolumesTestJSON-502494852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f013806-a7f7-4e05-8be3-4b5f9300c73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:32 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-67e94a85-1d25-4a91-836f-a1961f89b565 tempest-VolumesTestJSON-502494852 None] Volume 63ff058e-99ee-47ca-a173-edc4be58cec7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63ff058e-99ee-47ca-a173-edc4be58cec7', 'volume_size': 1} Nov 03 07:39:32 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-67e94a85-1d25-4a91-836f-a1961f89b565 tempest-VolumesTestJSON-502494852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:32 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-67e94a85-1d25-4a91-836f-a1961f89b565 tempest-VolumesTestJSON-502494852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:32 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-67e94a85-1d25-4a91-836f-a1961f89b565 tempest-VolumesTestJSON-502494852 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-601985714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63ff058e-99ee-47ca-a173-edc4be58cec7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7c0a5c6a9ac64f2489b277eb879a43b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:39:32Z,use_quota=True,user_id='1f58f85097c64e20b68afc25882ebe3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:39:32 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-67e94a85-1d25-4a91-836f-a1961f89b565 tempest-VolumesTestJSON-502494852 None] Creating volume 63ff058e-99ee-47ca-a173-edc4be58cec7 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:39:32 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-67e94a85-1d25-4a91-836f-a1961f89b565 tempest-VolumesTestJSON-502494852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:32 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-67e94a85-1d25-4a91-836f-a1961f89b565 tempest-VolumesTestJSON-502494852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:32 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-67e94a85-1d25-4a91-836f-a1961f89b565 tempest-VolumesTestJSON-502494852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:39:32 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-67e94a85-1d25-4a91-836f-a1961f89b565 tempest-VolumesTestJSON-502494852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:39:32 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-67e94a85-1d25-4a91-836f-a1961f89b565 tempest-VolumesTestJSON-502494852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:32 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-67e94a85-1d25-4a91-836f-a1961f89b565 tempest-VolumesTestJSON-502494852 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:39:32 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-67e94a85-1d25-4a91-836f-a1961f89b565 tempest-VolumesTestJSON-502494852 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:39:32 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-67e94a85-1d25-4a91-836f-a1961f89b565 tempest-VolumesTestJSON-502494852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-63ff058e-99ee-47ca-a173-edc4be58cec7 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:32 devstack sudo[99634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-63ff058e-99ee-47ca-a173-edc4be58cec7 1073741824 Nov 03 07:39:32 devstack sudo[99634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:33 devstack sudo[99634]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-67e94a85-1d25-4a91-836f-a1961f89b565 tempest-VolumesTestJSON-502494852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-63ff058e-99ee-47ca-a173-edc4be58cec7 1073741824" returned: 0 in 1.022s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-67e94a85-1d25-4a91-836f-a1961f89b565 tempest-VolumesTestJSON-502494852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-63ff058e-99ee-47ca-a173-edc4be58cec7 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:33 devstack sudo[99640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-63ff058e-99ee-47ca-a173-edc4be58cec7 Nov 03 07:39:33 devstack sudo[99640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:33 devstack sudo[99640]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-67e94a85-1d25-4a91-836f-a1961f89b565 tempest-VolumesTestJSON-502494852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-63ff058e-99ee-47ca-a173-edc4be58cec7" returned: 0 in 0.408s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:33 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-67e94a85-1d25-4a91-836f-a1961f89b565 tempest-VolumesTestJSON-502494852 None] <== create_volume: return (1509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:39:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-67e94a85-1d25-4a91-836f-a1961f89b565 tempest-VolumesTestJSON-502494852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.517s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:33 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-67e94a85-1d25-4a91-836f-a1961f89b565 tempest-VolumesTestJSON-502494852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f013806-a7f7-4e05-8be3-4b5f9300c73f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63ff058e-99ee-47ca-a173-edc4be58cec7', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:33 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-67e94a85-1d25-4a91-836f-a1961f89b565 tempest-VolumesTestJSON-502494852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b80baa9-4870-4820-89ab-858935126829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:33 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-67e94a85-1d25-4a91-836f-a1961f89b565 tempest-VolumesTestJSON-502494852 None] Volume volume-63ff058e-99ee-47ca-a173-edc4be58cec7 (63ff058e-99ee-47ca-a173-edc4be58cec7): created successfully Nov 03 07:39:33 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-67e94a85-1d25-4a91-836f-a1961f89b565 tempest-VolumesTestJSON-502494852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b80baa9-4870-4820-89ab-858935126829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:33 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-67e94a85-1d25-4a91-836f-a1961f89b565 tempest-VolumesTestJSON-502494852 None] Flow 'volume_create_manager' (1740fa69-d7f3-4b29-8252-e04a75fd7083) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:39:33 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-67e94a85-1d25-4a91-836f-a1961f89b565 tempest-VolumesTestJSON-502494852 None] Created volume successfully. Nov 03 07:39:35 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-f5972d0d-5c26-4eba-9eb6-47a8d93c655f tempest-VolumesTestJSON-502494852 None] Acquiring lock "cinder-63ff058e-99ee-47ca-a173-edc4be58cec7-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:35 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-f5972d0d-5c26-4eba-9eb6-47a8d93c655f tempest-VolumesTestJSON-502494852 None] Lock "cinder-63ff058e-99ee-47ca-a173-edc4be58cec7-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:35 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-f5972d0d-5c26-4eba-9eb6-47a8d93c655f tempest-VolumesTestJSON-502494852 None] Acquiring lock "cinder-quobyte-63ff058e-99ee-47ca-a173-edc4be58cec7" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:35 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-f5972d0d-5c26-4eba-9eb6-47a8d93c655f tempest-VolumesTestJSON-502494852 None] Lock "cinder-quobyte-63ff058e-99ee-47ca-a173-edc4be58cec7" acquired by "delete_volume" :: waited 0.049s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:35 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[a450a5ea-a1d2-4ed8-940e-513c4c005089]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:39:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f5972d0d-5c26-4eba-9eb6-47a8d93c655f tempest-VolumesTestJSON-502494852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-63ff058e-99ee-47ca-a173-edc4be58cec7 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:36 devstack sudo[99648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-63ff058e-99ee-47ca-a173-edc4be58cec7 Nov 03 07:39:36 devstack sudo[99648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:36 devstack sudo[99648]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:36 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f5972d0d-5c26-4eba-9eb6-47a8d93c655f tempest-VolumesTestJSON-502494852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-63ff058e-99ee-47ca-a173-edc4be58cec7" returned: 0 in 0.711s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:36 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f5972d0d-5c26-4eba-9eb6-47a8d93c655f tempest-VolumesTestJSON-502494852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-63ff058e-99ee-47ca-a173-edc4be58cec7 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:36 devstack sudo[99653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-63ff058e-99ee-47ca-a173-edc4be58cec7 Nov 03 07:39:36 devstack sudo[99653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:37 devstack sudo[99653]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f5972d0d-5c26-4eba-9eb6-47a8d93c655f tempest-VolumesTestJSON-502494852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-63ff058e-99ee-47ca-a173-edc4be58cec7" returned: 0 in 0.446s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:37 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-f5972d0d-5c26-4eba-9eb6-47a8d93c655f tempest-VolumesTestJSON-502494852 None] Lock "cinder-quobyte-63ff058e-99ee-47ca-a173-edc4be58cec7" released by "delete_volume" :: held 1.252s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:37 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-f5972d0d-5c26-4eba-9eb6-47a8d93c655f tempest-VolumesTestJSON-502494852 None] Created reservations ['85ef48f0-a302-49bf-a338-35fb83a5e6c5', '13980931-b884-490a-8c8d-6273ed2a5d91', 'd0a4a3a2-b52f-464b-89cd-2444343a953f', '38bf97d5-5dc0-4699-9f06-775eec679d58'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:39:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-f5972d0d-5c26-4eba-9eb6-47a8d93c655f tempest-VolumesTestJSON-502494852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-f5972d0d-5c26-4eba-9eb6-47a8d93c655f tempest-VolumesTestJSON-502494852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:37 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-f5972d0d-5c26-4eba-9eb6-47a8d93c655f tempest-VolumesTestJSON-502494852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:39:37 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-f5972d0d-5c26-4eba-9eb6-47a8d93c655f tempest-VolumesTestJSON-502494852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:39:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-f5972d0d-5c26-4eba-9eb6-47a8d93c655f tempest-VolumesTestJSON-502494852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f5972d0d-5c26-4eba-9eb6-47a8d93c655f tempest-VolumesTestJSON-502494852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:37 devstack sudo[99659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:39:37 devstack sudo[99659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:37 devstack sudo[99659]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f5972d0d-5c26-4eba-9eb6-47a8d93c655f tempest-VolumesTestJSON-502494852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.423s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:37 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-f5972d0d-5c26-4eba-9eb6-47a8d93c655f tempest-VolumesTestJSON-502494852 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:39:37 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-f5972d0d-5c26-4eba-9eb6-47a8d93c655f tempest-VolumesTestJSON-502494852 None] Deleted volume successfully. Nov 03 07:39:37 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-f5972d0d-5c26-4eba-9eb6-47a8d93c655f tempest-VolumesTestJSON-502494852 None] Lock "cinder-63ff058e-99ee-47ca-a173-edc4be58cec7-delete_volume" released by "delete_volume" :: held 2.101s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:38 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-871154d5-d041-4e46-8c97-c1dff44d616e tempest-VolumesTestJSON-502494852 None] Acquiring lock "cinder-2b303d0e-ff29-4bd8-a3a4-218e4d8ed493-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:38 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-871154d5-d041-4e46-8c97-c1dff44d616e tempest-VolumesTestJSON-502494852 None] Lock "cinder-2b303d0e-ff29-4bd8-a3a4-218e4d8ed493-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:38 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-871154d5-d041-4e46-8c97-c1dff44d616e tempest-VolumesTestJSON-502494852 None] Acquiring lock "cinder-quobyte-2b303d0e-ff29-4bd8-a3a4-218e4d8ed493" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:38 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-871154d5-d041-4e46-8c97-c1dff44d616e tempest-VolumesTestJSON-502494852 None] Lock "cinder-quobyte-2b303d0e-ff29-4bd8-a3a4-218e4d8ed493" acquired by "delete_volume" :: waited 0.044s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:38 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e93414d-0dac-4b0c-bf81-dce0fd5418b6]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:39:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-871154d5-d041-4e46-8c97-c1dff44d616e tempest-VolumesTestJSON-502494852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2b303d0e-ff29-4bd8-a3a4-218e4d8ed493 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:38 devstack sudo[99663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2b303d0e-ff29-4bd8-a3a4-218e4d8ed493 Nov 03 07:39:38 devstack sudo[99663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:39 devstack sudo[99663]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-871154d5-d041-4e46-8c97-c1dff44d616e tempest-VolumesTestJSON-502494852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2b303d0e-ff29-4bd8-a3a4-218e4d8ed493" returned: 0 in 0.690s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-871154d5-d041-4e46-8c97-c1dff44d616e tempest-VolumesTestJSON-502494852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2b303d0e-ff29-4bd8-a3a4-218e4d8ed493 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:39 devstack sudo[99668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2b303d0e-ff29-4bd8-a3a4-218e4d8ed493 Nov 03 07:39:39 devstack sudo[99668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:39 devstack sudo[99668]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-871154d5-d041-4e46-8c97-c1dff44d616e tempest-VolumesTestJSON-502494852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2b303d0e-ff29-4bd8-a3a4-218e4d8ed493" returned: 0 in 0.344s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:39 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-871154d5-d041-4e46-8c97-c1dff44d616e tempest-VolumesTestJSON-502494852 None] Lock "cinder-quobyte-2b303d0e-ff29-4bd8-a3a4-218e4d8ed493" released by "delete_volume" :: held 1.138s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:39 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-871154d5-d041-4e46-8c97-c1dff44d616e tempest-VolumesTestJSON-502494852 None] Created reservations ['19eb019c-ad1a-4805-a984-06ff96efae55', '19b171b9-f052-4bf2-ba42-30982b1a4b35', '25543d78-9ccc-4a20-b974-e837960d6656', '2e960eb4-e3a4-4d27-acb0-a5b9b7fe92f1'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:39:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-871154d5-d041-4e46-8c97-c1dff44d616e tempest-VolumesTestJSON-502494852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-871154d5-d041-4e46-8c97-c1dff44d616e tempest-VolumesTestJSON-502494852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:39 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-871154d5-d041-4e46-8c97-c1dff44d616e tempest-VolumesTestJSON-502494852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:39:39 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-871154d5-d041-4e46-8c97-c1dff44d616e tempest-VolumesTestJSON-502494852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:39:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-871154d5-d041-4e46-8c97-c1dff44d616e tempest-VolumesTestJSON-502494852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-871154d5-d041-4e46-8c97-c1dff44d616e tempest-VolumesTestJSON-502494852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:39 devstack sudo[99671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:39:39 devstack sudo[99671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:40 devstack sudo[99671]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-871154d5-d041-4e46-8c97-c1dff44d616e tempest-VolumesTestJSON-502494852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.381s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:40 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-871154d5-d041-4e46-8c97-c1dff44d616e tempest-VolumesTestJSON-502494852 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:39:40 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-871154d5-d041-4e46-8c97-c1dff44d616e tempest-VolumesTestJSON-502494852 None] Deleted volume successfully. Nov 03 07:39:40 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-871154d5-d041-4e46-8c97-c1dff44d616e tempest-VolumesTestJSON-502494852 None] Lock "cinder-2b303d0e-ff29-4bd8-a3a4-218e4d8ed493-delete_volume" released by "delete_volume" :: held 1.882s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:40 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-79717d76-fa08-4085-b6d5-9ce6b7fa4113 tempest-VolumesTestJSON-502494852 None] Acquiring lock "cinder-af70401d-30c8-4e82-9e9e-89da231266ae-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:40 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-79717d76-fa08-4085-b6d5-9ce6b7fa4113 tempest-VolumesTestJSON-502494852 None] Lock "cinder-af70401d-30c8-4e82-9e9e-89da231266ae-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:40 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-79717d76-fa08-4085-b6d5-9ce6b7fa4113 tempest-VolumesTestJSON-502494852 None] Acquiring lock "cinder-quobyte-af70401d-30c8-4e82-9e9e-89da231266ae" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:40 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-79717d76-fa08-4085-b6d5-9ce6b7fa4113 tempest-VolumesTestJSON-502494852 None] Lock "cinder-quobyte-af70401d-30c8-4e82-9e9e-89da231266ae" acquired by "delete_volume" :: waited 0.030s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:41 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a09668-8626-471c-afa4-a5836e3360c1]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:39:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-79717d76-fa08-4085-b6d5-9ce6b7fa4113 tempest-VolumesTestJSON-502494852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-af70401d-30c8-4e82-9e9e-89da231266ae {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:41 devstack sudo[99674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-af70401d-30c8-4e82-9e9e-89da231266ae Nov 03 07:39:41 devstack sudo[99674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:41 devstack sudo[99674]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-79717d76-fa08-4085-b6d5-9ce6b7fa4113 tempest-VolumesTestJSON-502494852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-af70401d-30c8-4e82-9e9e-89da231266ae" returned: 0 in 0.463s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-79717d76-fa08-4085-b6d5-9ce6b7fa4113 tempest-VolumesTestJSON-502494852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-af70401d-30c8-4e82-9e9e-89da231266ae {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:41 devstack sudo[99679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-af70401d-30c8-4e82-9e9e-89da231266ae Nov 03 07:39:41 devstack sudo[99679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:41 devstack sudo[99679]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-79717d76-fa08-4085-b6d5-9ce6b7fa4113 tempest-VolumesTestJSON-502494852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-af70401d-30c8-4e82-9e9e-89da231266ae" returned: 0 in 0.478s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:42 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-79717d76-fa08-4085-b6d5-9ce6b7fa4113 tempest-VolumesTestJSON-502494852 None] Lock "cinder-quobyte-af70401d-30c8-4e82-9e9e-89da231266ae" released by "delete_volume" :: held 1.059s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:42 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-79717d76-fa08-4085-b6d5-9ce6b7fa4113 tempest-VolumesTestJSON-502494852 None] Created reservations ['0c8ef600-33e8-452a-9a6c-055741dcf121', '6b7080ad-b2b2-4fc7-a38f-3e6adea0693f', '14cc7366-e623-41a4-9ef8-0e6435ea5428', '6dfb132c-ccdc-44fa-957f-24323f040922'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:39:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-79717d76-fa08-4085-b6d5-9ce6b7fa4113 tempest-VolumesTestJSON-502494852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-79717d76-fa08-4085-b6d5-9ce6b7fa4113 tempest-VolumesTestJSON-502494852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:42 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-79717d76-fa08-4085-b6d5-9ce6b7fa4113 tempest-VolumesTestJSON-502494852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:39:42 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-79717d76-fa08-4085-b6d5-9ce6b7fa4113 tempest-VolumesTestJSON-502494852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:39:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-79717d76-fa08-4085-b6d5-9ce6b7fa4113 tempest-VolumesTestJSON-502494852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-79717d76-fa08-4085-b6d5-9ce6b7fa4113 tempest-VolumesTestJSON-502494852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:42 devstack sudo[99683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:39:42 devstack sudo[99683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:42 devstack sudo[99683]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-79717d76-fa08-4085-b6d5-9ce6b7fa4113 tempest-VolumesTestJSON-502494852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.332s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:42 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-79717d76-fa08-4085-b6d5-9ce6b7fa4113 tempest-VolumesTestJSON-502494852 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:39:42 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-79717d76-fa08-4085-b6d5-9ce6b7fa4113 tempest-VolumesTestJSON-502494852 None] Deleted volume successfully. Nov 03 07:39:42 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-79717d76-fa08-4085-b6d5-9ce6b7fa4113 tempest-VolumesTestJSON-502494852 None] Lock "cinder-af70401d-30c8-4e82-9e9e-89da231266ae-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:44 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:SELECT=92,cinder:UPDATE=94,cinder:DELETE=6,cinder:INSERT=27 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:39:44 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d883996-88e0-40d5-933c-79fcd848d3e9 tempest-VolumeTypesAccessTest-2090363701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:39:44 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-2d883996-88e0-40d5-933c-79fcd848d3e9 tempest-VolumeTypesAccessTest-2090363701 None] Flow 'volume_create_manager' (986d5763-fff6-405d-91b3-fbd2938d6261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:39:44 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-2d883996-88e0-40d5-933c-79fcd848d3e9 tempest-VolumeTypesAccessTest-2090363701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3223fd1a-d887-481b-b4ab-56cda765dbc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:44 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-2d883996-88e0-40d5-933c-79fcd848d3e9 tempest-VolumeTypesAccessTest-2090363701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3223fd1a-d887-481b-b4ab-56cda765dbc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:39:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-503725746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10f72d2b-7dad-42d1-8aed-44609376f363,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d4486890b5440c985d1a6e11a83bdce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:39:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:39:44Z,use_quota=True,user_id='bd23e170263f40799b589f137126288f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f72e139-3674-49df-8fac-9150c065a4e0),volume_type_id=4f72e139-3674-49df-8fac-9150c065a4e0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:44 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-2d883996-88e0-40d5-933c-79fcd848d3e9 tempest-VolumeTypesAccessTest-2090363701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (034a2dcc-95ea-4295-a120-7947093b702a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:44 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-2d883996-88e0-40d5-933c-79fcd848d3e9 tempest-VolumeTypesAccessTest-2090363701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (034a2dcc-95ea-4295-a120-7947093b702a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:44 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-2d883996-88e0-40d5-933c-79fcd848d3e9 tempest-VolumeTypesAccessTest-2090363701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af23d8d2-31fd-40eb-a200-0afafeda6511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:44 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-2d883996-88e0-40d5-933c-79fcd848d3e9 tempest-VolumeTypesAccessTest-2090363701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af23d8d2-31fd-40eb-a200-0afafeda6511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10f72d2b-7dad-42d1-8aed-44609376f363', 'volume_name': 'volume-10f72d2b-7dad-42d1-8aed-44609376f363', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:44 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-2d883996-88e0-40d5-933c-79fcd848d3e9 tempest-VolumeTypesAccessTest-2090363701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a69af5ee-3c2c-41b7-906c-34fb345a6583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:44 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-2d883996-88e0-40d5-933c-79fcd848d3e9 tempest-VolumeTypesAccessTest-2090363701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a69af5ee-3c2c-41b7-906c-34fb345a6583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:44 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-2d883996-88e0-40d5-933c-79fcd848d3e9 tempest-VolumeTypesAccessTest-2090363701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59e57d17-2995-47a4-9578-9bb43cf2b43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:44 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-2d883996-88e0-40d5-933c-79fcd848d3e9 tempest-VolumeTypesAccessTest-2090363701 None] Volume 10f72d2b-7dad-42d1-8aed-44609376f363: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10f72d2b-7dad-42d1-8aed-44609376f363', 'volume_size': 1} Nov 03 07:39:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-2d883996-88e0-40d5-933c-79fcd848d3e9 tempest-VolumeTypesAccessTest-2090363701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-2d883996-88e0-40d5-933c-79fcd848d3e9 tempest-VolumeTypesAccessTest-2090363701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:44 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-2d883996-88e0-40d5-933c-79fcd848d3e9 tempest-VolumeTypesAccessTest-2090363701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:39:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-503725746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10f72d2b-7dad-42d1-8aed-44609376f363,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d4486890b5440c985d1a6e11a83bdce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:39:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:39:44Z,use_quota=True,user_id='bd23e170263f40799b589f137126288f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f72e139-3674-49df-8fac-9150c065a4e0),volume_type_id=4f72e139-3674-49df-8fac-9150c065a4e0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:39:44 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-2d883996-88e0-40d5-933c-79fcd848d3e9 tempest-VolumeTypesAccessTest-2090363701 None] Creating volume 10f72d2b-7dad-42d1-8aed-44609376f363 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:39:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-2d883996-88e0-40d5-933c-79fcd848d3e9 tempest-VolumeTypesAccessTest-2090363701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-2d883996-88e0-40d5-933c-79fcd848d3e9 tempest-VolumeTypesAccessTest-2090363701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:44 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-2d883996-88e0-40d5-933c-79fcd848d3e9 tempest-VolumeTypesAccessTest-2090363701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:39:44 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-2d883996-88e0-40d5-933c-79fcd848d3e9 tempest-VolumeTypesAccessTest-2090363701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:39:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-2d883996-88e0-40d5-933c-79fcd848d3e9 tempest-VolumeTypesAccessTest-2090363701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:44 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-2d883996-88e0-40d5-933c-79fcd848d3e9 tempest-VolumeTypesAccessTest-2090363701 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:39:44 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-2d883996-88e0-40d5-933c-79fcd848d3e9 tempest-VolumeTypesAccessTest-2090363701 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:39:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2d883996-88e0-40d5-933c-79fcd848d3e9 tempest-VolumeTypesAccessTest-2090363701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-10f72d2b-7dad-42d1-8aed-44609376f363 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:44 devstack sudo[99686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-10f72d2b-7dad-42d1-8aed-44609376f363 1073741824 Nov 03 07:39:44 devstack sudo[99686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:45 devstack sudo[99686]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2d883996-88e0-40d5-933c-79fcd848d3e9 tempest-VolumeTypesAccessTest-2090363701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-10f72d2b-7dad-42d1-8aed-44609376f363 1073741824" returned: 0 in 0.709s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2d883996-88e0-40d5-933c-79fcd848d3e9 tempest-VolumeTypesAccessTest-2090363701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-10f72d2b-7dad-42d1-8aed-44609376f363 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:45 devstack sudo[99692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-10f72d2b-7dad-42d1-8aed-44609376f363 Nov 03 07:39:45 devstack sudo[99692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:45 devstack sudo[99692]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2d883996-88e0-40d5-933c-79fcd848d3e9 tempest-VolumeTypesAccessTest-2090363701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-10f72d2b-7dad-42d1-8aed-44609376f363" returned: 0 in 0.409s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:45 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-2d883996-88e0-40d5-933c-79fcd848d3e9 tempest-VolumeTypesAccessTest-2090363701 None] <== create_volume: return (1254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:39:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-2d883996-88e0-40d5-933c-79fcd848d3e9 tempest-VolumeTypesAccessTest-2090363701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.256s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:45 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-2d883996-88e0-40d5-933c-79fcd848d3e9 tempest-VolumeTypesAccessTest-2090363701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59e57d17-2995-47a4-9578-9bb43cf2b43c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10f72d2b-7dad-42d1-8aed-44609376f363', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:45 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-2d883996-88e0-40d5-933c-79fcd848d3e9 tempest-VolumeTypesAccessTest-2090363701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a04261ac-aa42-43ec-835b-e0a666612c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:45 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:UPDATE=99,cinder:SELECT=98,cinder:INSERT=27,cinder:DELETE=5 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:39:45 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-2d883996-88e0-40d5-933c-79fcd848d3e9 tempest-VolumeTypesAccessTest-2090363701 None] Volume volume-10f72d2b-7dad-42d1-8aed-44609376f363 (10f72d2b-7dad-42d1-8aed-44609376f363): created successfully Nov 03 07:39:45 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-2d883996-88e0-40d5-933c-79fcd848d3e9 tempest-VolumeTypesAccessTest-2090363701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a04261ac-aa42-43ec-835b-e0a666612c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:45 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-2d883996-88e0-40d5-933c-79fcd848d3e9 tempest-VolumeTypesAccessTest-2090363701 None] Flow 'volume_create_manager' (986d5763-fff6-405d-91b3-fbd2938d6261) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:39:45 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-2d883996-88e0-40d5-933c-79fcd848d3e9 tempest-VolumeTypesAccessTest-2090363701 None] Created volume successfully. Nov 03 07:39:46 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-9c017e7b-6ede-4d89-b60b-14dd447481c5 tempest-VolumeTypesAccessTest-2090363701 None] Acquiring lock "cinder-10f72d2b-7dad-42d1-8aed-44609376f363-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:46 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-9c017e7b-6ede-4d89-b60b-14dd447481c5 tempest-VolumeTypesAccessTest-2090363701 None] Lock "cinder-10f72d2b-7dad-42d1-8aed-44609376f363-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:46 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-9c017e7b-6ede-4d89-b60b-14dd447481c5 tempest-VolumeTypesAccessTest-2090363701 None] Acquiring lock "cinder-quobyte-10f72d2b-7dad-42d1-8aed-44609376f363" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:46 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-9c017e7b-6ede-4d89-b60b-14dd447481c5 tempest-VolumeTypesAccessTest-2090363701 None] Lock "cinder-quobyte-10f72d2b-7dad-42d1-8aed-44609376f363" acquired by "delete_volume" :: waited 0.033s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:47 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa4a3815-1af1-4e48-9b13-678238669deb]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:39:47 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9c017e7b-6ede-4d89-b60b-14dd447481c5 tempest-VolumeTypesAccessTest-2090363701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-10f72d2b-7dad-42d1-8aed-44609376f363 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:47 devstack sudo[99720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-10f72d2b-7dad-42d1-8aed-44609376f363 Nov 03 07:39:47 devstack sudo[99720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:47 devstack sudo[99720]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:47 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9c017e7b-6ede-4d89-b60b-14dd447481c5 tempest-VolumeTypesAccessTest-2090363701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-10f72d2b-7dad-42d1-8aed-44609376f363" returned: 0 in 0.599s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:47 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9c017e7b-6ede-4d89-b60b-14dd447481c5 tempest-VolumeTypesAccessTest-2090363701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-10f72d2b-7dad-42d1-8aed-44609376f363 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:47 devstack sudo[99728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-10f72d2b-7dad-42d1-8aed-44609376f363 Nov 03 07:39:47 devstack sudo[99728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:47 devstack sudo[99728]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:47 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9c017e7b-6ede-4d89-b60b-14dd447481c5 tempest-VolumeTypesAccessTest-2090363701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-10f72d2b-7dad-42d1-8aed-44609376f363" returned: 0 in 0.385s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:48 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-9c017e7b-6ede-4d89-b60b-14dd447481c5 tempest-VolumeTypesAccessTest-2090363701 None] Lock "cinder-quobyte-10f72d2b-7dad-42d1-8aed-44609376f363" released by "delete_volume" :: held 1.056s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:48 devstack cinder-volume[86875]: WARNING cinder.quota [None req-9c017e7b-6ede-4d89-b60b-14dd447481c5 tempest-VolumeTypesAccessTest-2090363701 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-2006739466 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-2006739466, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:39:48 devstack cinder-volume[86875]: WARNING cinder.quota [None req-9c017e7b-6ede-4d89-b60b-14dd447481c5 tempest-VolumeTypesAccessTest-2090363701 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-2006739466 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-2006739466, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:39:48 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-9c017e7b-6ede-4d89-b60b-14dd447481c5 tempest-VolumeTypesAccessTest-2090363701 None] Created reservations ['1eacfd2e-60ad-419d-a729-beb4b041a832', 'd1366e50-ec5c-4443-92e1-a888e9121af2', 'db0fcd14-fd1a-46ce-8d5e-f87ceeee26a8', '1c3c0489-d645-4150-b325-a665b0bae1cd'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:39:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-9c017e7b-6ede-4d89-b60b-14dd447481c5 tempest-VolumeTypesAccessTest-2090363701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-9c017e7b-6ede-4d89-b60b-14dd447481c5 tempest-VolumeTypesAccessTest-2090363701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:48 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-9c017e7b-6ede-4d89-b60b-14dd447481c5 tempest-VolumeTypesAccessTest-2090363701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:39:48 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-9c017e7b-6ede-4d89-b60b-14dd447481c5 tempest-VolumeTypesAccessTest-2090363701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:39:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-9c017e7b-6ede-4d89-b60b-14dd447481c5 tempest-VolumeTypesAccessTest-2090363701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9c017e7b-6ede-4d89-b60b-14dd447481c5 tempest-VolumeTypesAccessTest-2090363701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:48 devstack sudo[99733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:39:48 devstack sudo[99733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:48 devstack sudo[99733]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9c017e7b-6ede-4d89-b60b-14dd447481c5 tempest-VolumeTypesAccessTest-2090363701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.329s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:48 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-9c017e7b-6ede-4d89-b60b-14dd447481c5 tempest-VolumeTypesAccessTest-2090363701 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:39:48 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-9c017e7b-6ede-4d89-b60b-14dd447481c5 tempest-VolumeTypesAccessTest-2090363701 None] Deleted volume successfully. Nov 03 07:39:48 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-9c017e7b-6ede-4d89-b60b-14dd447481c5 tempest-VolumeTypesAccessTest-2090363701 None] Lock "cinder-10f72d2b-7dad-42d1-8aed-44609376f363-delete_volume" released by "delete_volume" :: held 1.776s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:39:50 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-a9e50326-f45a-4378-a657-8e66dff92e32 tempest-GroupSnapshotsTest-2057469718 None] Group tempest-GroupSnapshotsTest-Group-540324893: creating Nov 03 07:39:50 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-a9e50326-f45a-4378-a657-8e66dff92e32 tempest-GroupSnapshotsTest-2057469718 None] Group tempest-GroupSnapshotsTest-Group-540324893: created successfully Nov 03 07:39:50 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-a9e50326-f45a-4378-a657-8e66dff92e32 tempest-GroupSnapshotsTest-2057469718 None] Create group completed successfully. Nov 03 07:39:52 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-35fed779-ccd5-46cd-a009-dd6b6c8a6a35 tempest-GroupSnapshotsTest-2057469718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:39:52 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-35fed779-ccd5-46cd-a009-dd6b6c8a6a35 tempest-GroupSnapshotsTest-2057469718 None] Flow 'volume_create_manager' (352ecadf-c4d7-4ded-a895-5f867c3d5424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:39:52 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-35fed779-ccd5-46cd-a009-dd6b6c8a6a35 tempest-GroupSnapshotsTest-2057469718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebe0faf0-4ed9-4342-ad74-55cd111d68d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:52 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-35fed779-ccd5-46cd-a009-dd6b6c8a6a35 tempest-GroupSnapshotsTest-2057469718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebe0faf0-4ed9-4342-ad74-55cd111d68d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:39:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1693737187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a6ca29b4-c625-42e8-8e5e-b8326698d1eb,host='devstack@QuobyteHD#QuobyteHD',id=0d554143-6300-4bd2-be87-f614c4a5c9d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dd42ab5a85040a9adc8ffeaf25d6eb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:39:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:39:52Z,use_quota=True,user_id='e3a8a7d1442949fcb5edf34738d8686a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3039e79-62a2-4d6e-b8e2-78914e9dbb95),volume_type_id=e3039e79-62a2-4d6e-b8e2-78914e9dbb95)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:52 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-35fed779-ccd5-46cd-a009-dd6b6c8a6a35 tempest-GroupSnapshotsTest-2057469718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c009dde-1bc2-4ede-a7ee-db7eb6ffb62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:52 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-35fed779-ccd5-46cd-a009-dd6b6c8a6a35 tempest-GroupSnapshotsTest-2057469718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c009dde-1bc2-4ede-a7ee-db7eb6ffb62e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:52 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-35fed779-ccd5-46cd-a009-dd6b6c8a6a35 tempest-GroupSnapshotsTest-2057469718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d9581e7-d582-4fe6-b2ab-e9cc6ab0e5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:52 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-35fed779-ccd5-46cd-a009-dd6b6c8a6a35 tempest-GroupSnapshotsTest-2057469718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d9581e7-d582-4fe6-b2ab-e9cc6ab0e5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d554143-6300-4bd2-be87-f614c4a5c9d9', 'volume_name': 'volume-0d554143-6300-4bd2-be87-f614c4a5c9d9', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:52 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-35fed779-ccd5-46cd-a009-dd6b6c8a6a35 tempest-GroupSnapshotsTest-2057469718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df6ca74e-b362-44f5-a509-a1dc11bbac2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:52 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-35fed779-ccd5-46cd-a009-dd6b6c8a6a35 tempest-GroupSnapshotsTest-2057469718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df6ca74e-b362-44f5-a509-a1dc11bbac2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:52 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-35fed779-ccd5-46cd-a009-dd6b6c8a6a35 tempest-GroupSnapshotsTest-2057469718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eab22ea9-ecad-4741-8024-f70a4ad7cc3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:52 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-35fed779-ccd5-46cd-a009-dd6b6c8a6a35 tempest-GroupSnapshotsTest-2057469718 None] Volume 0d554143-6300-4bd2-be87-f614c4a5c9d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d554143-6300-4bd2-be87-f614c4a5c9d9', 'volume_size': 1} Nov 03 07:39:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-35fed779-ccd5-46cd-a009-dd6b6c8a6a35 tempest-GroupSnapshotsTest-2057469718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-35fed779-ccd5-46cd-a009-dd6b6c8a6a35 tempest-GroupSnapshotsTest-2057469718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:52 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-35fed779-ccd5-46cd-a009-dd6b6c8a6a35 tempest-GroupSnapshotsTest-2057469718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a6ca29b4-c625-42e8-8e5e-b8326698d1eb,created_at=2026-11-03T06:39:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1693737187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a6ca29b4-c625-42e8-8e5e-b8326698d1eb,host='devstack@QuobyteHD#QuobyteHD',id=0d554143-6300-4bd2-be87-f614c4a5c9d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dd42ab5a85040a9adc8ffeaf25d6eb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:39:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:39:52Z,use_quota=True,user_id='e3a8a7d1442949fcb5edf34738d8686a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3039e79-62a2-4d6e-b8e2-78914e9dbb95),volume_type_id=e3039e79-62a2-4d6e-b8e2-78914e9dbb95)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:39:52 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-35fed779-ccd5-46cd-a009-dd6b6c8a6a35 tempest-GroupSnapshotsTest-2057469718 None] Creating volume 0d554143-6300-4bd2-be87-f614c4a5c9d9 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:39:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-35fed779-ccd5-46cd-a009-dd6b6c8a6a35 tempest-GroupSnapshotsTest-2057469718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-35fed779-ccd5-46cd-a009-dd6b6c8a6a35 tempest-GroupSnapshotsTest-2057469718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:52 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-35fed779-ccd5-46cd-a009-dd6b6c8a6a35 tempest-GroupSnapshotsTest-2057469718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:39:52 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-35fed779-ccd5-46cd-a009-dd6b6c8a6a35 tempest-GroupSnapshotsTest-2057469718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:39:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-35fed779-ccd5-46cd-a009-dd6b6c8a6a35 tempest-GroupSnapshotsTest-2057469718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:52 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-35fed779-ccd5-46cd-a009-dd6b6c8a6a35 tempest-GroupSnapshotsTest-2057469718 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:39:52 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-35fed779-ccd5-46cd-a009-dd6b6c8a6a35 tempest-GroupSnapshotsTest-2057469718 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:39:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-35fed779-ccd5-46cd-a009-dd6b6c8a6a35 tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d554143-6300-4bd2-be87-f614c4a5c9d9 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:52 devstack sudo[99749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d554143-6300-4bd2-be87-f614c4a5c9d9 1073741824 Nov 03 07:39:52 devstack sudo[99749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:53 devstack sudo[99749]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-35fed779-ccd5-46cd-a009-dd6b6c8a6a35 tempest-GroupSnapshotsTest-2057469718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d554143-6300-4bd2-be87-f614c4a5c9d9 1073741824" returned: 0 in 0.560s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-35fed779-ccd5-46cd-a009-dd6b6c8a6a35 tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d554143-6300-4bd2-be87-f614c4a5c9d9 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:53 devstack sudo[99755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d554143-6300-4bd2-be87-f614c4a5c9d9 Nov 03 07:39:53 devstack sudo[99755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:53 devstack sudo[99755]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-35fed779-ccd5-46cd-a009-dd6b6c8a6a35 tempest-GroupSnapshotsTest-2057469718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d554143-6300-4bd2-be87-f614c4a5c9d9" returned: 0 in 0.296s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:53 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-35fed779-ccd5-46cd-a009-dd6b6c8a6a35 tempest-GroupSnapshotsTest-2057469718 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:39:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-35fed779-ccd5-46cd-a009-dd6b6c8a6a35 tempest-GroupSnapshotsTest-2057469718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-35fed779-ccd5-46cd-a009-dd6b6c8a6a35 tempest-GroupSnapshotsTest-2057469718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eab22ea9-ecad-4741-8024-f70a4ad7cc3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d554143-6300-4bd2-be87-f614c4a5c9d9', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-35fed779-ccd5-46cd-a009-dd6b6c8a6a35 tempest-GroupSnapshotsTest-2057469718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (628d041b-2986-433f-9038-45a4af67f6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:39:53 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-35fed779-ccd5-46cd-a009-dd6b6c8a6a35 tempest-GroupSnapshotsTest-2057469718 None] Volume volume-0d554143-6300-4bd2-be87-f614c4a5c9d9 (0d554143-6300-4bd2-be87-f614c4a5c9d9): created successfully Nov 03 07:39:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-35fed779-ccd5-46cd-a009-dd6b6c8a6a35 tempest-GroupSnapshotsTest-2057469718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (628d041b-2986-433f-9038-45a4af67f6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:39:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-35fed779-ccd5-46cd-a009-dd6b6c8a6a35 tempest-GroupSnapshotsTest-2057469718 None] Flow 'volume_create_manager' (352ecadf-c4d7-4ded-a895-5f867c3d5424) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:39:53 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-35fed779-ccd5-46cd-a009-dd6b6c8a6a35 tempest-GroupSnapshotsTest-2057469718 None] Created volume successfully. Nov 03 07:39:54 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-8ccee485-7b9e-4aa2-aae1-51141fac1926 tempest-GroupSnapshotsTest-2057469718 None] GroupSnapshot 8d36fb50-247b-41fb-87a2-8ccca7203f99: creating. Nov 03 07:39:54 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-8ccee485-7b9e-4aa2-aae1-51141fac1926 tempest-GroupSnapshotsTest-2057469718 None] Group snapshot 8d36fb50-247b-41fb-87a2-8ccca7203f99: creating. {{(pid=86875) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 03 07:39:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-8ccee485-7b9e-4aa2-aae1-51141fac1926 tempest-GroupSnapshotsTest-2057469718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-8ccee485-7b9e-4aa2-aae1-51141fac1926 tempest-GroupSnapshotsTest-2057469718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:54 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-8ccee485-7b9e-4aa2-aae1-51141fac1926 tempest-GroupSnapshotsTest-2057469718 None] Creating offline snapshot f7816690-7415-4ed4-a6dd-30558b7e6d06 of volume 0d554143-6300-4bd2-be87-f614c4a5c9d9 {{(pid=86875) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:39:54 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d8b090-5c23-468e-8237-bf1cc11d72ec]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:39:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8ccee485-7b9e-4aa2-aae1-51141fac1926 tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d554143-6300-4bd2-be87-f614c4a5c9d9 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:54 devstack sudo[99758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d554143-6300-4bd2-be87-f614c4a5c9d9 Nov 03 07:39:54 devstack sudo[99758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:54 devstack sudo[99758]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8ccee485-7b9e-4aa2-aae1-51141fac1926 tempest-GroupSnapshotsTest-2057469718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d554143-6300-4bd2-be87-f614c4a5c9d9" returned: 0 in 0.540s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8ccee485-7b9e-4aa2-aae1-51141fac1926 tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d554143-6300-4bd2-be87-f614c4a5c9d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d554143-6300-4bd2-be87-f614c4a5c9d9.f7816690-7415-4ed4-a6dd-30558b7e6d06 1G {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:54 devstack sudo[99763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d554143-6300-4bd2-be87-f614c4a5c9d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d554143-6300-4bd2-be87-f614c4a5c9d9.f7816690-7415-4ed4-a6dd-30558b7e6d06 1G Nov 03 07:39:54 devstack sudo[99763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:55 devstack sudo[99763]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8ccee485-7b9e-4aa2-aae1-51141fac1926 tempest-GroupSnapshotsTest-2057469718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d554143-6300-4bd2-be87-f614c4a5c9d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d554143-6300-4bd2-be87-f614c4a5c9d9.f7816690-7415-4ed4-a6dd-30558b7e6d06 1G" returned: 0 in 0.658s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8ccee485-7b9e-4aa2-aae1-51141fac1926 tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d554143-6300-4bd2-be87-f614c4a5c9d9 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d554143-6300-4bd2-be87-f614c4a5c9d9.f7816690-7415-4ed4-a6dd-30558b7e6d06 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:55 devstack sudo[99769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d554143-6300-4bd2-be87-f614c4a5c9d9 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d554143-6300-4bd2-be87-f614c4a5c9d9.f7816690-7415-4ed4-a6dd-30558b7e6d06 Nov 03 07:39:55 devstack sudo[99769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:55 devstack sudo[99769]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8ccee485-7b9e-4aa2-aae1-51141fac1926 tempest-GroupSnapshotsTest-2057469718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d554143-6300-4bd2-be87-f614c4a5c9d9 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d554143-6300-4bd2-be87-f614c4a5c9d9.f7816690-7415-4ed4-a6dd-30558b7e6d06" returned: 0 in 0.498s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:55 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-8ccee485-7b9e-4aa2-aae1-51141fac1926 tempest-GroupSnapshotsTest-2057469718 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d554143-6300-4bd2-be87-f614c4a5c9d9.f7816690-7415-4ed4-a6dd-30558b7e6d06 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 07:39:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8ccee485-7b9e-4aa2-aae1-51141fac1926 tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d554143-6300-4bd2-be87-f614c4a5c9d9.f7816690-7415-4ed4-a6dd-30558b7e6d06 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:56 devstack sudo[99774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d554143-6300-4bd2-be87-f614c4a5c9d9.f7816690-7415-4ed4-a6dd-30558b7e6d06 Nov 03 07:39:56 devstack sudo[99774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:56 devstack sudo[99774]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8ccee485-7b9e-4aa2-aae1-51141fac1926 tempest-GroupSnapshotsTest-2057469718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d554143-6300-4bd2-be87-f614c4a5c9d9.f7816690-7415-4ed4-a6dd-30558b7e6d06" returned: 0 in 0.346s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8ccee485-7b9e-4aa2-aae1-51141fac1926 tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d554143-6300-4bd2-be87-f614c4a5c9d9.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:56 devstack sudo[99777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d554143-6300-4bd2-be87-f614c4a5c9d9.info Nov 03 07:39:56 devstack sudo[99777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:56 devstack sudo[99777]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8ccee485-7b9e-4aa2-aae1-51141fac1926 tempest-GroupSnapshotsTest-2057469718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d554143-6300-4bd2-be87-f614c4a5c9d9.info" returned: 0 in 0.439s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:56 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-8ccee485-7b9e-4aa2-aae1-51141fac1926 tempest-GroupSnapshotsTest-2057469718 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d554143-6300-4bd2-be87-f614c4a5c9d9.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 07:39:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8ccee485-7b9e-4aa2-aae1-51141fac1926 tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d554143-6300-4bd2-be87-f614c4a5c9d9.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:39:56 devstack sudo[99780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d554143-6300-4bd2-be87-f614c4a5c9d9.info Nov 03 07:39:56 devstack sudo[99780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:39:57 devstack sudo[99780]: pam_unix(sudo:session): session closed for user root Nov 03 07:39:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8ccee485-7b9e-4aa2-aae1-51141fac1926 tempest-GroupSnapshotsTest-2057469718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d554143-6300-4bd2-be87-f614c4a5c9d9.info" returned: 0 in 0.510s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:39:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-8ccee485-7b9e-4aa2-aae1-51141fac1926 tempest-GroupSnapshotsTest-2057469718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.148s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:57 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-8ccee485-7b9e-4aa2-aae1-51141fac1926 tempest-GroupSnapshotsTest-2057469718 None] group_snapshot 8d36fb50-247b-41fb-87a2-8ccca7203f99: created successfully Nov 03 07:39:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-86b3d82f-fe56-45f2-a8c7-3a6aa68839d5 tempest-GroupSnapshotsTest-2057469718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-86b3d82f-fe56-45f2-a8c7-3a6aa68839d5 tempest-GroupSnapshotsTest-2057469718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:59 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-86b3d82f-fe56-45f2-a8c7-3a6aa68839d5 tempest-GroupSnapshotsTest-2057469718 None] Acquiring lock "cinder-quobyte-f7816690-7415-4ed4-a6dd-30558b7e6d06-1673fa44-d373-44ba-bb5d-7fc0770d3d49" by "_create_volume_from_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:59 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-86b3d82f-fe56-45f2-a8c7-3a6aa68839d5 tempest-GroupSnapshotsTest-2057469718 None] Lock "cinder-quobyte-f7816690-7415-4ed4-a6dd-30558b7e6d06-1673fa44-d373-44ba-bb5d-7fc0770d3d49" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:59 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-86b3d82f-fe56-45f2-a8c7-3a6aa68839d5 tempest-GroupSnapshotsTest-2057469718 None] Creating volume 1673fa44-d373-44ba-bb5d-7fc0770d3d49 from snapshot f7816690-7415-4ed4-a6dd-30558b7e6d06 {{(pid=86875) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 07:39:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-86b3d82f-fe56-45f2-a8c7-3a6aa68839d5 tempest-GroupSnapshotsTest-2057469718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-86b3d82f-fe56-45f2-a8c7-3a6aa68839d5 tempest-GroupSnapshotsTest-2057469718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:59 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-86b3d82f-fe56-45f2-a8c7-3a6aa68839d5 tempest-GroupSnapshotsTest-2057469718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:39:59 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-86b3d82f-fe56-45f2-a8c7-3a6aa68839d5 tempest-GroupSnapshotsTest-2057469718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:39:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-86b3d82f-fe56-45f2-a8c7-3a6aa68839d5 tempest-GroupSnapshotsTest-2057469718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:59 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-86b3d82f-fe56-45f2-a8c7-3a6aa68839d5 tempest-GroupSnapshotsTest-2057469718 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:39:59 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-86b3d82f-fe56-45f2-a8c7-3a6aa68839d5 tempest-GroupSnapshotsTest-2057469718 None] Acquiring lock "cinder-quobyte-1673fa44-d373-44ba-bb5d-7fc0770d3d49" by "_copy_volume_from_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:39:59 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-86b3d82f-fe56-45f2-a8c7-3a6aa68839d5 tempest-GroupSnapshotsTest-2057469718 None] Lock "cinder-quobyte-1673fa44-d373-44ba-bb5d-7fc0770d3d49" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:39:59 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-86b3d82f-fe56-45f2-a8c7-3a6aa68839d5 tempest-GroupSnapshotsTest-2057469718 None] snapshot: f7816690-7415-4ed4-a6dd-30558b7e6d06, volume: 1673fa44-d373-44ba-bb5d-7fc0770d3d49, {{(pid=86875) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 07:39:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-86b3d82f-fe56-45f2-a8c7-3a6aa68839d5 tempest-GroupSnapshotsTest-2057469718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:39:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-86b3d82f-fe56-45f2-a8c7-3a6aa68839d5 tempest-GroupSnapshotsTest-2057469718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:39:59 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-86b3d82f-fe56-45f2-a8c7-3a6aa68839d5 tempest-GroupSnapshotsTest-2057469718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:39:59 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-86b3d82f-fe56-45f2-a8c7-3a6aa68839d5 tempest-GroupSnapshotsTest-2057469718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:39:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-86b3d82f-fe56-45f2-a8c7-3a6aa68839d5 tempest-GroupSnapshotsTest-2057469718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:39:59 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53e634e-b4cc-4464-9573-1fafcc284729]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:39:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-86b3d82f-fe56-45f2-a8c7-3a6aa68839d5 tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d554143-6300-4bd2-be87-f614c4a5c9d9.f7816690-7415-4ed4-a6dd-30558b7e6d06 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:00 devstack sudo[99788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d554143-6300-4bd2-be87-f614c4a5c9d9.f7816690-7415-4ed4-a6dd-30558b7e6d06 Nov 03 07:40:00 devstack sudo[99788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:00 devstack sudo[99788]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-86b3d82f-fe56-45f2-a8c7-3a6aa68839d5 tempest-GroupSnapshotsTest-2057469718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d554143-6300-4bd2-be87-f614c4a5c9d9.f7816690-7415-4ed4-a6dd-30558b7e6d06" returned: 0 in 0.741s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:00 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-86b3d82f-fe56-45f2-a8c7-3a6aa68839d5 tempest-GroupSnapshotsTest-2057469718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d554143-6300-4bd2-be87-f614c4a5c9d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:40:00 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4fa654a-ccaa-49c3-b446-9dc9db6a8f10]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:40:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-86b3d82f-fe56-45f2-a8c7-3a6aa68839d5 tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d554143-6300-4bd2-be87-f614c4a5c9d9 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:00 devstack sudo[99793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d554143-6300-4bd2-be87-f614c4a5c9d9 Nov 03 07:40:00 devstack sudo[99793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:01 devstack sudo[99793]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-86b3d82f-fe56-45f2-a8c7-3a6aa68839d5 tempest-GroupSnapshotsTest-2057469718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d554143-6300-4bd2-be87-f614c4a5c9d9" returned: 0 in 0.650s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:01 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-86b3d82f-fe56-45f2-a8c7-3a6aa68839d5 tempest-GroupSnapshotsTest-2057469718 None] will copy from snapshot at /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d554143-6300-4bd2-be87-f614c4a5c9d9 {{(pid=86875) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 07:40:01 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-86b3d82f-fe56-45f2-a8c7-3a6aa68839d5 tempest-GroupSnapshotsTest-2057469718 None] Creating direct copy from snapshot {{(pid=86875) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 07:40:01 devstack cinder-volume[86875]: DEBUG cinder.utils [None req-86b3d82f-fe56-45f2-a8c7-3a6aa68839d5 tempest-GroupSnapshotsTest-2057469718 None] Path /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1673fa44-d373-44ba-bb5d-7fc0770d3d49 not found in is_blk_device check {{(pid=86875) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 07:40:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-86b3d82f-fe56-45f2-a8c7-3a6aa68839d5 tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d554143-6300-4bd2-be87-f614c4a5c9d9 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1673fa44-d373-44ba-bb5d-7fc0770d3d49 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:01 devstack sudo[99798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d554143-6300-4bd2-be87-f614c4a5c9d9 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1673fa44-d373-44ba-bb5d-7fc0770d3d49 Nov 03 07:40:01 devstack sudo[99798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:03 devstack cinder-volume[86875]: DEBUG oslo_service.periodic_task [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86875) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:40:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:40:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:40:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:03 devstack sudo[99811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:40:03 devstack sudo[99811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:04 devstack sudo[99811]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.845s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:04 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:40:04 devstack cinder-volume[86875]: DEBUG oslo_service.periodic_task [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running periodic task VolumeManager._thread_info {{(pid=86875) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:40:04 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] thread count: 28 {{(pid=86875) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:40:04 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] thread info: [<_MainThread(MainThread, started 125626325639296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86875) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:40:09 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:DELETE=2,cinder:UPDATE=15,cinder:SELECT=15,cinder:INSERT=2 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:40:09 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:SELECT=21,cinder:UPDATE=16,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:40:10 devstack sudo[99798]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-86b3d82f-fe56-45f2-a8c7-3a6aa68839d5 tempest-GroupSnapshotsTest-2057469718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d554143-6300-4bd2-be87-f614c4a5c9d9 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1673fa44-d373-44ba-bb5d-7fc0770d3d49" returned: 0 in 8.970s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:10 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-86b3d82f-fe56-45f2-a8c7-3a6aa68839d5 tempest-GroupSnapshotsTest-2057469718 None] Image conversion details: src /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d554143-6300-4bd2-be87-f614c4a5c9d9, size 1024.00 MB, duration 8.97 sec, destination /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1673fa44-d373-44ba-bb5d-7fc0770d3d49 {{(pid=86875) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:40:10 devstack cinder-volume[86875]: INFO cinder.image.image_utils [None req-86b3d82f-fe56-45f2-a8c7-3a6aa68839d5 tempest-GroupSnapshotsTest-2057469718 None] Converted 1024.00 MB image at 114.14 MB/s Nov 03 07:40:10 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-86b3d82f-fe56-45f2-a8c7-3a6aa68839d5 tempest-GroupSnapshotsTest-2057469718 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1673fa44-d373-44ba-bb5d-7fc0770d3d49 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 07:40:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-86b3d82f-fe56-45f2-a8c7-3a6aa68839d5 tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1673fa44-d373-44ba-bb5d-7fc0770d3d49 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:10 devstack sudo[99815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1673fa44-d373-44ba-bb5d-7fc0770d3d49 Nov 03 07:40:10 devstack sudo[99815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:10 devstack sudo[99815]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-86b3d82f-fe56-45f2-a8c7-3a6aa68839d5 tempest-GroupSnapshotsTest-2057469718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1673fa44-d373-44ba-bb5d-7fc0770d3d49" returned: 0 in 0.288s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:10 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-86b3d82f-fe56-45f2-a8c7-3a6aa68839d5 tempest-GroupSnapshotsTest-2057469718 None] Lock "cinder-quobyte-1673fa44-d373-44ba-bb5d-7fc0770d3d49" released by "_copy_volume_from_snapshot" :: held 10.836s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:40:10 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-86b3d82f-fe56-45f2-a8c7-3a6aa68839d5 tempest-GroupSnapshotsTest-2057469718 None] Lock "cinder-quobyte-f7816690-7415-4ed4-a6dd-30558b7e6d06-1673fa44-d373-44ba-bb5d-7fc0770d3d49" released by "_create_volume_from_snapshot" :: held 10.923s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:40:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-86b3d82f-fe56-45f2-a8c7-3a6aa68839d5 tempest-GroupSnapshotsTest-2057469718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.953s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:10 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-86b3d82f-fe56-45f2-a8c7-3a6aa68839d5 tempest-GroupSnapshotsTest-2057469718 None] Create group from source-snapshot-8d36fb50-247b-41fb-87a2-8ccca7203f99 completed successfully. Nov 03 07:40:11 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-6a74bebb-cec2-4ba2-a166-e11d38f170f7 tempest-GroupSnapshotsTest-2057469718 None] Acquiring lock "cinder-quobyte-1673fa44-d373-44ba-bb5d-7fc0770d3d49" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:40:11 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-6a74bebb-cec2-4ba2-a166-e11d38f170f7 tempest-GroupSnapshotsTest-2057469718 None] Lock "cinder-quobyte-1673fa44-d373-44ba-bb5d-7fc0770d3d49" acquired by "delete_volume" :: waited 0.022s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:40:11 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e2d696-9c04-4864-9259-f7bb5800effc]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:40:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6a74bebb-cec2-4ba2-a166-e11d38f170f7 tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1673fa44-d373-44ba-bb5d-7fc0770d3d49 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:12 devstack sudo[99824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1673fa44-d373-44ba-bb5d-7fc0770d3d49 Nov 03 07:40:12 devstack sudo[99824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:12 devstack sudo[99824]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:12 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6a74bebb-cec2-4ba2-a166-e11d38f170f7 tempest-GroupSnapshotsTest-2057469718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1673fa44-d373-44ba-bb5d-7fc0770d3d49" returned: 0 in 0.597s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:12 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6a74bebb-cec2-4ba2-a166-e11d38f170f7 tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1673fa44-d373-44ba-bb5d-7fc0770d3d49 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:12 devstack sudo[99832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1673fa44-d373-44ba-bb5d-7fc0770d3d49 Nov 03 07:40:12 devstack sudo[99832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:12 devstack sudo[99832]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:12 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6a74bebb-cec2-4ba2-a166-e11d38f170f7 tempest-GroupSnapshotsTest-2057469718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1673fa44-d373-44ba-bb5d-7fc0770d3d49" returned: 0 in 0.404s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:12 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-6a74bebb-cec2-4ba2-a166-e11d38f170f7 tempest-GroupSnapshotsTest-2057469718 None] Lock "cinder-quobyte-1673fa44-d373-44ba-bb5d-7fc0770d3d49" released by "delete_volume" :: held 1.120s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:40:13 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-6a74bebb-cec2-4ba2-a166-e11d38f170f7 tempest-GroupSnapshotsTest-2057469718 None] Created reservations ['d743375a-0204-4025-a0a7-49b864802e15'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:40:13 devstack cinder-volume[86875]: WARNING cinder.quota [None req-6a74bebb-cec2-4ba2-a166-e11d38f170f7 tempest-GroupSnapshotsTest-2057469718 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-635600012 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-635600012, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:40:13 devstack cinder-volume[86875]: WARNING cinder.quota [None req-6a74bebb-cec2-4ba2-a166-e11d38f170f7 tempest-GroupSnapshotsTest-2057469718 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-635600012 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-635600012, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:40:13 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-6a74bebb-cec2-4ba2-a166-e11d38f170f7 tempest-GroupSnapshotsTest-2057469718 None] Created reservations ['92afd02c-39b4-4a33-a2f3-57048d0ec6d6', '3ae646da-af3a-49ef-b281-23ae750de6f5', '44c9b33f-5311-450b-a4f9-b051a362985d', 'ce128f2f-8fda-45bd-ad16-2d01f72028e2'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:40:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-6a74bebb-cec2-4ba2-a166-e11d38f170f7 tempest-GroupSnapshotsTest-2057469718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-6a74bebb-cec2-4ba2-a166-e11d38f170f7 tempest-GroupSnapshotsTest-2057469718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:13 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-6a74bebb-cec2-4ba2-a166-e11d38f170f7 tempest-GroupSnapshotsTest-2057469718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:40:13 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-6a74bebb-cec2-4ba2-a166-e11d38f170f7 tempest-GroupSnapshotsTest-2057469718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:40:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-6a74bebb-cec2-4ba2-a166-e11d38f170f7 tempest-GroupSnapshotsTest-2057469718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6a74bebb-cec2-4ba2-a166-e11d38f170f7 tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:13 devstack sudo[99838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:40:13 devstack sudo[99838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:13 devstack sudo[99838]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6a74bebb-cec2-4ba2-a166-e11d38f170f7 tempest-GroupSnapshotsTest-2057469718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.344s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:13 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-6a74bebb-cec2-4ba2-a166-e11d38f170f7 tempest-GroupSnapshotsTest-2057469718 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:40:13 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-6a74bebb-cec2-4ba2-a166-e11d38f170f7 tempest-GroupSnapshotsTest-2057469718 None] Delete group completed successfully. Nov 03 07:40:14 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-2d131afd-3b9a-47c2-90f6-e58b57c5f8cb tempest-GroupSnapshotsTest-2057469718 None] group_snapshot 8d36fb50-247b-41fb-87a2-8ccca7203f99: deleting Nov 03 07:40:14 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-2d131afd-3b9a-47c2-90f6-e58b57c5f8cb tempest-GroupSnapshotsTest-2057469718 None] group_snapshot 8d36fb50-247b-41fb-87a2-8ccca7203f99: deleting {{(pid=86875) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 03 07:40:14 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-2d131afd-3b9a-47c2-90f6-e58b57c5f8cb tempest-GroupSnapshotsTest-2057469718 None] Acquiring lock "cinder-quobyte-0d554143-6300-4bd2-be87-f614c4a5c9d9" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:40:14 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-2d131afd-3b9a-47c2-90f6-e58b57c5f8cb tempest-GroupSnapshotsTest-2057469718 None] Lock "cinder-quobyte-0d554143-6300-4bd2-be87-f614c4a5c9d9" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:40:14 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-2d131afd-3b9a-47c2-90f6-e58b57c5f8cb tempest-GroupSnapshotsTest-2057469718 None] Acquiring lock "cinder-quobyte-f7816690-7415-4ed4-a6dd-30558b7e6d06" by "_delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:40:14 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-2d131afd-3b9a-47c2-90f6-e58b57c5f8cb tempest-GroupSnapshotsTest-2057469718 None] Lock "cinder-quobyte-f7816690-7415-4ed4-a6dd-30558b7e6d06" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:40:14 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-2d131afd-3b9a-47c2-90f6-e58b57c5f8cb tempest-GroupSnapshotsTest-2057469718 None] Deleting offline snapshot f7816690-7415-4ed4-a6dd-30558b7e6d06 of volume 0d554143-6300-4bd2-be87-f614c4a5c9d9 {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:40:14 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-2d131afd-3b9a-47c2-90f6-e58b57c5f8cb tempest-GroupSnapshotsTest-2057469718 None] snapshot_file for this snap is: volume-0d554143-6300-4bd2-be87-f614c4a5c9d9.f7816690-7415-4ed4-a6dd-30558b7e6d06 {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:40:14 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[6786d079-1778-4e5f-8983-f4933140c1ea]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:40:14 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2d131afd-3b9a-47c2-90f6-e58b57c5f8cb tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d554143-6300-4bd2-be87-f614c4a5c9d9.f7816690-7415-4ed4-a6dd-30558b7e6d06 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:14 devstack sudo[99844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d554143-6300-4bd2-be87-f614c4a5c9d9.f7816690-7415-4ed4-a6dd-30558b7e6d06 Nov 03 07:40:14 devstack sudo[99844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:15 devstack sudo[99844]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2d131afd-3b9a-47c2-90f6-e58b57c5f8cb tempest-GroupSnapshotsTest-2057469718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d554143-6300-4bd2-be87-f614c4a5c9d9.f7816690-7415-4ed4-a6dd-30558b7e6d06" returned: 0 in 0.769s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:15 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-2d131afd-3b9a-47c2-90f6-e58b57c5f8cb tempest-GroupSnapshotsTest-2057469718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d554143-6300-4bd2-be87-f614c4a5c9d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:40:15 devstack cinder-volume[86875]: INFO cinder.volume.manager [req-2db79657-198a-43b5-b45e-37faf30884ac req-6726f4ad-2f70-460e-8d89-5e8bd45e1af8 tempest-TestShelveInstance-2081252662 None] Terminate volume connection completed successfully. Nov 03 07:40:15 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-2db79657-198a-43b5-b45e-37faf30884ac req-6726f4ad-2f70-460e-8d89-5e8bd45e1af8 tempest-TestShelveInstance-2081252662 None] Deleting attachment 9296d669-4be0-43be-bf3a-0ac538d7a704. {{(pid=86875) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:40:15 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d7c24c-517e-4c20-bbdb-b220475bc0a1]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:40:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2d131afd-3b9a-47c2-90f6-e58b57c5f8cb tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d554143-6300-4bd2-be87-f614c4a5c9d9 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:15 devstack sudo[99865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d554143-6300-4bd2-be87-f614c4a5c9d9 Nov 03 07:40:15 devstack sudo[99865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:16 devstack sudo[99865]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2d131afd-3b9a-47c2-90f6-e58b57c5f8cb tempest-GroupSnapshotsTest-2057469718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d554143-6300-4bd2-be87-f614c4a5c9d9" returned: 0 in 0.807s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2d131afd-3b9a-47c2-90f6-e58b57c5f8cb tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d554143-6300-4bd2-be87-f614c4a5c9d9.f7816690-7415-4ed4-a6dd-30558b7e6d06 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:16 devstack sudo[99871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d554143-6300-4bd2-be87-f614c4a5c9d9.f7816690-7415-4ed4-a6dd-30558b7e6d06 Nov 03 07:40:16 devstack sudo[99871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:16 devstack sudo[99871]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2d131afd-3b9a-47c2-90f6-e58b57c5f8cb tempest-GroupSnapshotsTest-2057469718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d554143-6300-4bd2-be87-f614c4a5c9d9.f7816690-7415-4ed4-a6dd-30558b7e6d06" returned: 0 in 0.488s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2d131afd-3b9a-47c2-90f6-e58b57c5f8cb tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d554143-6300-4bd2-be87-f614c4a5c9d9.f7816690-7415-4ed4-a6dd-30558b7e6d06 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:16 devstack sudo[99883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d554143-6300-4bd2-be87-f614c4a5c9d9.f7816690-7415-4ed4-a6dd-30558b7e6d06 Nov 03 07:40:16 devstack sudo[99883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:17 devstack sudo[99883]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2d131afd-3b9a-47c2-90f6-e58b57c5f8cb tempest-GroupSnapshotsTest-2057469718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d554143-6300-4bd2-be87-f614c4a5c9d9.f7816690-7415-4ed4-a6dd-30558b7e6d06" returned: 0 in 0.349s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:17 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-2d131afd-3b9a-47c2-90f6-e58b57c5f8cb tempest-GroupSnapshotsTest-2057469718 None] Lock "cinder-quobyte-f7816690-7415-4ed4-a6dd-30558b7e6d06" released by "_delete_snapshot" :: held 2.582s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:40:17 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-2d131afd-3b9a-47c2-90f6-e58b57c5f8cb tempest-GroupSnapshotsTest-2057469718 None] Lock "cinder-quobyte-0d554143-6300-4bd2-be87-f614c4a5c9d9" released by "delete_snapshot" :: held 2.616s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:40:17 devstack cinder-volume[86875]: WARNING cinder.quota [None req-2d131afd-3b9a-47c2-90f6-e58b57c5f8cb tempest-GroupSnapshotsTest-2057469718 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-635600012 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-635600012, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:40:17 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-2d131afd-3b9a-47c2-90f6-e58b57c5f8cb tempest-GroupSnapshotsTest-2057469718 None] Created reservations ['a21fb8b0-b2f8-4cdb-a2af-225399734b38', '4e246fa2-11da-48b5-98f9-026ab2ac2879', '94196dc1-0294-4fe1-9393-d9cda1f37f04', '8d3057bb-3fbf-4153-90d3-d987200acbe3'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:40:17 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-2d131afd-3b9a-47c2-90f6-e58b57c5f8cb tempest-GroupSnapshotsTest-2057469718 None] group_snapshot 8d36fb50-247b-41fb-87a2-8ccca7203f99: deleted successfully Nov 03 07:40:18 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-1d545c01-55db-4102-bf9d-fba2175bfe7c tempest-GroupSnapshotsTest-2057469718 None] Acquiring lock "cinder-quobyte-0d554143-6300-4bd2-be87-f614c4a5c9d9" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:40:18 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-1d545c01-55db-4102-bf9d-fba2175bfe7c tempest-GroupSnapshotsTest-2057469718 None] Lock "cinder-quobyte-0d554143-6300-4bd2-be87-f614c4a5c9d9" acquired by "delete_volume" :: waited 0.039s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:40:18 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7e269b-5d24-48b6-8de5-23259193c0b4]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:40:18 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1d545c01-55db-4102-bf9d-fba2175bfe7c tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d554143-6300-4bd2-be87-f614c4a5c9d9 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:18 devstack sudo[99887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d554143-6300-4bd2-be87-f614c4a5c9d9 Nov 03 07:40:18 devstack sudo[99887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:19 devstack sudo[99887]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:19 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1d545c01-55db-4102-bf9d-fba2175bfe7c tempest-GroupSnapshotsTest-2057469718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d554143-6300-4bd2-be87-f614c4a5c9d9" returned: 0 in 0.654s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:19 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1d545c01-55db-4102-bf9d-fba2175bfe7c tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d554143-6300-4bd2-be87-f614c4a5c9d9 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:19 devstack sudo[99895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d554143-6300-4bd2-be87-f614c4a5c9d9 Nov 03 07:40:19 devstack sudo[99895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:19 devstack sudo[99895]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:19 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1d545c01-55db-4102-bf9d-fba2175bfe7c tempest-GroupSnapshotsTest-2057469718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0d554143-6300-4bd2-be87-f614c4a5c9d9" returned: 0 in 0.419s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:19 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-1d545c01-55db-4102-bf9d-fba2175bfe7c tempest-GroupSnapshotsTest-2057469718 None] Lock "cinder-quobyte-0d554143-6300-4bd2-be87-f614c4a5c9d9" released by "delete_volume" :: held 1.220s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:40:20 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-1d545c01-55db-4102-bf9d-fba2175bfe7c tempest-GroupSnapshotsTest-2057469718 None] Created reservations ['24ff006d-fd1a-4c30-a106-8317956a8940'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:40:20 devstack cinder-volume[86875]: WARNING cinder.db.api [None req-1d545c01-55db-4102-bf9d-fba2175bfe7c tempest-GroupSnapshotsTest-2057469718 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-635600012'] Nov 03 07:40:20 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-1d545c01-55db-4102-bf9d-fba2175bfe7c tempest-GroupSnapshotsTest-2057469718 None] Created reservations ['d1f3d67b-5837-48c8-b32c-bce92d6c21cb', '2475e53c-0140-4f54-9dcd-245935fbefa1', '4bd3f0b6-bdf7-44b4-a65b-483e20c400e1', 'd8c25c19-28d1-4be8-af65-5fc6f759e3c8'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:40:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-1d545c01-55db-4102-bf9d-fba2175bfe7c tempest-GroupSnapshotsTest-2057469718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-1d545c01-55db-4102-bf9d-fba2175bfe7c tempest-GroupSnapshotsTest-2057469718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:20 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-1d545c01-55db-4102-bf9d-fba2175bfe7c tempest-GroupSnapshotsTest-2057469718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:40:20 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-1d545c01-55db-4102-bf9d-fba2175bfe7c tempest-GroupSnapshotsTest-2057469718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:40:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-1d545c01-55db-4102-bf9d-fba2175bfe7c tempest-GroupSnapshotsTest-2057469718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1d545c01-55db-4102-bf9d-fba2175bfe7c tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:20 devstack sudo[99900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:40:20 devstack sudo[99900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:20 devstack sudo[99900]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1d545c01-55db-4102-bf9d-fba2175bfe7c tempest-GroupSnapshotsTest-2057469718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.481s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:20 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-1d545c01-55db-4102-bf9d-fba2175bfe7c tempest-GroupSnapshotsTest-2057469718 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:40:20 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-1d545c01-55db-4102-bf9d-fba2175bfe7c tempest-GroupSnapshotsTest-2057469718 None] Delete group completed successfully. Nov 03 07:40:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-dea4c171-8ffa-473d-a163-ac7bfd4e88cf req-30cf8e80-d0eb-43f0-b51a-7d6d2f99e515 tempest-TestShelveInstance-2081252662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-dea4c171-8ffa-473d-a163-ac7bfd4e88cf req-30cf8e80-d0eb-43f0-b51a-7d6d2f99e515 tempest-TestShelveInstance-2081252662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-dea4c171-8ffa-473d-a163-ac7bfd4e88cf req-30cf8e80-d0eb-43f0-b51a-7d6d2f99e515 tempest-TestShelveInstance-2081252662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:21 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-dea4c171-8ffa-473d-a163-ac7bfd4e88cf req-30cf8e80-d0eb-43f0-b51a-7d6d2f99e515 tempest-TestShelveInstance-2081252662 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1', 'name': 'volume-442c9ef6-b786-4e22-b5e3-e222b7b63413', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '271b3f5d-b98f-4bf5-8e8b-be747f047e0c', 'enforce_multipath': True} {{(pid=86875) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:40:21 devstack cinder-volume[86875]: INFO cinder.volume.manager [req-dea4c171-8ffa-473d-a163-ac7bfd4e88cf req-30cf8e80-d0eb-43f0-b51a-7d6d2f99e515 tempest-TestShelveInstance-2081252662 None] attachment_update completed successfully. Nov 03 07:40:22 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-971927e3-2722-497f-8416-361d0fdbe051 tempest-GroupSnapshotsTest-2057469718 None] Group tempest-GroupSnapshotsTest-Group-1115904514: creating Nov 03 07:40:22 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-971927e3-2722-497f-8416-361d0fdbe051 tempest-GroupSnapshotsTest-2057469718 None] Group tempest-GroupSnapshotsTest-Group-1115904514: created successfully Nov 03 07:40:22 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-971927e3-2722-497f-8416-361d0fdbe051 tempest-GroupSnapshotsTest-2057469718 None] Create group completed successfully. Nov 03 07:40:23 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-b01f6645-6c93-4443-9e62-40ad0d19e821 tempest-TestImageHashVerification-445051293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:40:23 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b01f6645-6c93-4443-9e62-40ad0d19e821 tempest-TestImageHashVerification-445051293 None] Flow 'volume_create_manager' (aeab7485-bfc6-4ca1-a67a-997e899c57f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:40:23 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b01f6645-6c93-4443-9e62-40ad0d19e821 tempest-TestImageHashVerification-445051293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01763eed-a4bd-41f5-9489-8d611971c053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:23 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b01f6645-6c93-4443-9e62-40ad0d19e821 tempest-TestImageHashVerification-445051293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01763eed-a4bd-41f5-9489-8d611971c053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:40:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1500335130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b07832e1-579e-47c0-b525-a6bc12aa1e84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da3503204fd54634b4e71fa5dbaaefa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:40:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:40:23Z,use_quota=True,user_id='ad5c3478f0b14745823dfcf5192c3fe1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:23 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b01f6645-6c93-4443-9e62-40ad0d19e821 tempest-TestImageHashVerification-445051293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ece4cbd-30a9-48ac-9090-b0aad5be0ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:23 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b01f6645-6c93-4443-9e62-40ad0d19e821 tempest-TestImageHashVerification-445051293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ece4cbd-30a9-48ac-9090-b0aad5be0ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:23 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b01f6645-6c93-4443-9e62-40ad0d19e821 tempest-TestImageHashVerification-445051293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e25b0ab-4c28-4897-8969-71817eb53972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:23 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b01f6645-6c93-4443-9e62-40ad0d19e821 tempest-TestImageHashVerification-445051293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e25b0ab-4c28-4897-8969-71817eb53972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b07832e1-579e-47c0-b525-a6bc12aa1e84', 'volume_name': 'volume-b07832e1-579e-47c0-b525-a6bc12aa1e84', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:23 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b01f6645-6c93-4443-9e62-40ad0d19e821 tempest-TestImageHashVerification-445051293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef1af8a0-079d-49dc-97df-d6788e9b5a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:23 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b01f6645-6c93-4443-9e62-40ad0d19e821 tempest-TestImageHashVerification-445051293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef1af8a0-079d-49dc-97df-d6788e9b5a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:23 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b01f6645-6c93-4443-9e62-40ad0d19e821 tempest-TestImageHashVerification-445051293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99600627-b09a-4702-a98e-4569e78eedcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:23 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-b01f6645-6c93-4443-9e62-40ad0d19e821 tempest-TestImageHashVerification-445051293 None] Volume b07832e1-579e-47c0-b525-a6bc12aa1e84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b07832e1-579e-47c0-b525-a6bc12aa1e84', 'volume_size': 1} Nov 03 07:40:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b01f6645-6c93-4443-9e62-40ad0d19e821 tempest-TestImageHashVerification-445051293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b01f6645-6c93-4443-9e62-40ad0d19e821 tempest-TestImageHashVerification-445051293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:23 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b01f6645-6c93-4443-9e62-40ad0d19e821 tempest-TestImageHashVerification-445051293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:40:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1500335130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b07832e1-579e-47c0-b525-a6bc12aa1e84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da3503204fd54634b4e71fa5dbaaefa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:40:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:40:23Z,use_quota=True,user_id='ad5c3478f0b14745823dfcf5192c3fe1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:40:23 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-b01f6645-6c93-4443-9e62-40ad0d19e821 tempest-TestImageHashVerification-445051293 None] Creating volume b07832e1-579e-47c0-b525-a6bc12aa1e84 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:40:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b01f6645-6c93-4443-9e62-40ad0d19e821 tempest-TestImageHashVerification-445051293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b01f6645-6c93-4443-9e62-40ad0d19e821 tempest-TestImageHashVerification-445051293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:23 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b01f6645-6c93-4443-9e62-40ad0d19e821 tempest-TestImageHashVerification-445051293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:40:23 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b01f6645-6c93-4443-9e62-40ad0d19e821 tempest-TestImageHashVerification-445051293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:40:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b01f6645-6c93-4443-9e62-40ad0d19e821 tempest-TestImageHashVerification-445051293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:23 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b01f6645-6c93-4443-9e62-40ad0d19e821 tempest-TestImageHashVerification-445051293 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:40:23 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-b01f6645-6c93-4443-9e62-40ad0d19e821 tempest-TestImageHashVerification-445051293 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:40:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b01f6645-6c93-4443-9e62-40ad0d19e821 tempest-TestImageHashVerification-445051293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b07832e1-579e-47c0-b525-a6bc12aa1e84 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:23 devstack sudo[99947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b07832e1-579e-47c0-b525-a6bc12aa1e84 1073741824 Nov 03 07:40:23 devstack sudo[99947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:23 devstack sudo[99947]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b01f6645-6c93-4443-9e62-40ad0d19e821 tempest-TestImageHashVerification-445051293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b07832e1-579e-47c0-b525-a6bc12aa1e84 1073741824" returned: 0 in 0.521s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b01f6645-6c93-4443-9e62-40ad0d19e821 tempest-TestImageHashVerification-445051293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b07832e1-579e-47c0-b525-a6bc12aa1e84 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:23 devstack sudo[99953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b07832e1-579e-47c0-b525-a6bc12aa1e84 Nov 03 07:40:23 devstack sudo[99953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:24 devstack sudo[99953]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b01f6645-6c93-4443-9e62-40ad0d19e821 tempest-TestImageHashVerification-445051293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b07832e1-579e-47c0-b525-a6bc12aa1e84" returned: 0 in 0.407s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:24 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b01f6645-6c93-4443-9e62-40ad0d19e821 tempest-TestImageHashVerification-445051293 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:40:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b01f6645-6c93-4443-9e62-40ad0d19e821 tempest-TestImageHashVerification-445051293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b01f6645-6c93-4443-9e62-40ad0d19e821 tempest-TestImageHashVerification-445051293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99600627-b09a-4702-a98e-4569e78eedcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b07832e1-579e-47c0-b525-a6bc12aa1e84', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b01f6645-6c93-4443-9e62-40ad0d19e821 tempest-TestImageHashVerification-445051293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (370996c1-1b87-44b5-8d1d-258924c27e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:24 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-b01f6645-6c93-4443-9e62-40ad0d19e821 tempest-TestImageHashVerification-445051293 None] Volume volume-b07832e1-579e-47c0-b525-a6bc12aa1e84 (b07832e1-579e-47c0-b525-a6bc12aa1e84): created successfully Nov 03 07:40:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b01f6645-6c93-4443-9e62-40ad0d19e821 tempest-TestImageHashVerification-445051293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (370996c1-1b87-44b5-8d1d-258924c27e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b01f6645-6c93-4443-9e62-40ad0d19e821 tempest-TestImageHashVerification-445051293 None] Flow 'volume_create_manager' (aeab7485-bfc6-4ca1-a67a-997e899c57f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:40:24 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-b01f6645-6c93-4443-9e62-40ad0d19e821 tempest-TestImageHashVerification-445051293 None] Created volume successfully. Nov 03 07:40:24 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-0945da70-824d-4ae7-9717-7056450fcdcf tempest-GroupSnapshotsTest-2057469718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:40:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0945da70-824d-4ae7-9717-7056450fcdcf tempest-GroupSnapshotsTest-2057469718 None] Flow 'volume_create_manager' (f52cbb91-c981-4dc4-beec-93cc72132714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:40:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0945da70-824d-4ae7-9717-7056450fcdcf tempest-GroupSnapshotsTest-2057469718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12d8291a-9603-40f9-929b-22e685f23c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0945da70-824d-4ae7-9717-7056450fcdcf tempest-GroupSnapshotsTest-2057469718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12d8291a-9603-40f9-929b-22e685f23c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:40:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-265726986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2602dbf4-4b2d-48bd-a83b-19835d0fb1da,host='devstack@QuobyteHD#QuobyteHD',id=9f5bad02-8bcf-42d0-80ca-b69637cc4ae6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dd42ab5a85040a9adc8ffeaf25d6eb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:40:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:40:24Z,use_quota=True,user_id='e3a8a7d1442949fcb5edf34738d8686a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dd303d0-df1c-4bc5-b303-651b666a3440),volume_type_id=4dd303d0-df1c-4bc5-b303-651b666a3440)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0945da70-824d-4ae7-9717-7056450fcdcf tempest-GroupSnapshotsTest-2057469718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f81dfe58-1247-4eae-b609-a7b4be54c029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0945da70-824d-4ae7-9717-7056450fcdcf tempest-GroupSnapshotsTest-2057469718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f81dfe58-1247-4eae-b609-a7b4be54c029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0945da70-824d-4ae7-9717-7056450fcdcf tempest-GroupSnapshotsTest-2057469718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69b5819b-f922-4592-92f3-cfbc66e47548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0945da70-824d-4ae7-9717-7056450fcdcf tempest-GroupSnapshotsTest-2057469718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69b5819b-f922-4592-92f3-cfbc66e47548) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f5bad02-8bcf-42d0-80ca-b69637cc4ae6', 'volume_name': 'volume-9f5bad02-8bcf-42d0-80ca-b69637cc4ae6', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0945da70-824d-4ae7-9717-7056450fcdcf tempest-GroupSnapshotsTest-2057469718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d09ae2e8-efe2-47f1-aa71-483196358f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0945da70-824d-4ae7-9717-7056450fcdcf tempest-GroupSnapshotsTest-2057469718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d09ae2e8-efe2-47f1-aa71-483196358f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0945da70-824d-4ae7-9717-7056450fcdcf tempest-GroupSnapshotsTest-2057469718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5db45964-fb7d-450b-ac65-871d19a0d94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:24 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-0945da70-824d-4ae7-9717-7056450fcdcf tempest-GroupSnapshotsTest-2057469718 None] Volume 9f5bad02-8bcf-42d0-80ca-b69637cc4ae6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f5bad02-8bcf-42d0-80ca-b69637cc4ae6', 'volume_size': 1} Nov 03 07:40:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0945da70-824d-4ae7-9717-7056450fcdcf tempest-GroupSnapshotsTest-2057469718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0945da70-824d-4ae7-9717-7056450fcdcf tempest-GroupSnapshotsTest-2057469718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:24 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-0945da70-824d-4ae7-9717-7056450fcdcf tempest-GroupSnapshotsTest-2057469718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2602dbf4-4b2d-48bd-a83b-19835d0fb1da,created_at=2026-11-03T06:40:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-265726986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2602dbf4-4b2d-48bd-a83b-19835d0fb1da,host='devstack@QuobyteHD#QuobyteHD',id=9f5bad02-8bcf-42d0-80ca-b69637cc4ae6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dd42ab5a85040a9adc8ffeaf25d6eb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:40:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:40:24Z,use_quota=True,user_id='e3a8a7d1442949fcb5edf34738d8686a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dd303d0-df1c-4bc5-b303-651b666a3440),volume_type_id=4dd303d0-df1c-4bc5-b303-651b666a3440)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:40:24 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-0945da70-824d-4ae7-9717-7056450fcdcf tempest-GroupSnapshotsTest-2057469718 None] Creating volume 9f5bad02-8bcf-42d0-80ca-b69637cc4ae6 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:40:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0945da70-824d-4ae7-9717-7056450fcdcf tempest-GroupSnapshotsTest-2057469718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0945da70-824d-4ae7-9717-7056450fcdcf tempest-GroupSnapshotsTest-2057469718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:24 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-0945da70-824d-4ae7-9717-7056450fcdcf tempest-GroupSnapshotsTest-2057469718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:40:24 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-0945da70-824d-4ae7-9717-7056450fcdcf tempest-GroupSnapshotsTest-2057469718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:40:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0945da70-824d-4ae7-9717-7056450fcdcf tempest-GroupSnapshotsTest-2057469718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:24 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-0945da70-824d-4ae7-9717-7056450fcdcf tempest-GroupSnapshotsTest-2057469718 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:40:24 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-0945da70-824d-4ae7-9717-7056450fcdcf tempest-GroupSnapshotsTest-2057469718 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:40:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0945da70-824d-4ae7-9717-7056450fcdcf tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f5bad02-8bcf-42d0-80ca-b69637cc4ae6 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:24 devstack sudo[99957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f5bad02-8bcf-42d0-80ca-b69637cc4ae6 1073741824 Nov 03 07:40:24 devstack sudo[99957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:25 devstack sudo[99957]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0945da70-824d-4ae7-9717-7056450fcdcf tempest-GroupSnapshotsTest-2057469718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f5bad02-8bcf-42d0-80ca-b69637cc4ae6 1073741824" returned: 0 in 0.544s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0945da70-824d-4ae7-9717-7056450fcdcf tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f5bad02-8bcf-42d0-80ca-b69637cc4ae6 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:25 devstack sudo[99964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f5bad02-8bcf-42d0-80ca-b69637cc4ae6 Nov 03 07:40:25 devstack sudo[99964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:25 devstack sudo[99964]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0945da70-824d-4ae7-9717-7056450fcdcf tempest-GroupSnapshotsTest-2057469718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f5bad02-8bcf-42d0-80ca-b69637cc4ae6" returned: 0 in 0.495s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:25 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-0945da70-824d-4ae7-9717-7056450fcdcf tempest-GroupSnapshotsTest-2057469718 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:40:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0945da70-824d-4ae7-9717-7056450fcdcf tempest-GroupSnapshotsTest-2057469718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:25 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0945da70-824d-4ae7-9717-7056450fcdcf tempest-GroupSnapshotsTest-2057469718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5db45964-fb7d-450b-ac65-871d19a0d94d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f5bad02-8bcf-42d0-80ca-b69637cc4ae6', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:25 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0945da70-824d-4ae7-9717-7056450fcdcf tempest-GroupSnapshotsTest-2057469718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49d952a9-5828-4eb4-b8e5-3040915af637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:25 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-0945da70-824d-4ae7-9717-7056450fcdcf tempest-GroupSnapshotsTest-2057469718 None] Volume volume-9f5bad02-8bcf-42d0-80ca-b69637cc4ae6 (9f5bad02-8bcf-42d0-80ca-b69637cc4ae6): created successfully Nov 03 07:40:25 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0945da70-824d-4ae7-9717-7056450fcdcf tempest-GroupSnapshotsTest-2057469718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49d952a9-5828-4eb4-b8e5-3040915af637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:25 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0945da70-824d-4ae7-9717-7056450fcdcf tempest-GroupSnapshotsTest-2057469718 None] Flow 'volume_create_manager' (f52cbb91-c981-4dc4-beec-93cc72132714) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:40:25 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-0945da70-824d-4ae7-9717-7056450fcdcf tempest-GroupSnapshotsTest-2057469718 None] Created volume successfully. Nov 03 07:40:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-07da2550-1615-4131-90f7-e650ca922465 tempest-TestImageHashVerification-445051293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-07da2550-1615-4131-90f7-e650ca922465 tempest-TestImageHashVerification-445051293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.004s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:27 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c47cca-9411-44f0-aaee-4087307fb57e]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:40:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-07da2550-1615-4131-90f7-e650ca922465 tempest-TestImageHashVerification-445051293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b07832e1-579e-47c0-b525-a6bc12aa1e84 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:27 devstack sudo[100445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b07832e1-579e-47c0-b525-a6bc12aa1e84 Nov 03 07:40:27 devstack sudo[100445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:27 devstack sudo[100445]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-07da2550-1615-4131-90f7-e650ca922465 tempest-TestImageHashVerification-445051293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b07832e1-579e-47c0-b525-a6bc12aa1e84" returned: 0 in 0.606s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:27 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab3cc1b-1bf4-4ccc-9308-ac318186a0a0]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:40:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-07da2550-1615-4131-90f7-e650ca922465 tempest-TestImageHashVerification-445051293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b07832e1-579e-47c0-b525-a6bc12aa1e84 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:28 devstack sudo[100451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b07832e1-579e-47c0-b525-a6bc12aa1e84 Nov 03 07:40:28 devstack sudo[100451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:28 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1dd7e2f-53d3-4c91-a452-27faab6bcd5a tempest-GroupSnapshotsTest-2057469718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:40:28 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c1dd7e2f-53d3-4c91-a452-27faab6bcd5a tempest-GroupSnapshotsTest-2057469718 None] Flow 'volume_create_manager' (119f9440-eb74-4c98-a253-8f0e6e4034d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:40:28 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c1dd7e2f-53d3-4c91-a452-27faab6bcd5a tempest-GroupSnapshotsTest-2057469718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (655bdb2c-707b-49c4-b73a-a4f6de150753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:28 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c1dd7e2f-53d3-4c91-a452-27faab6bcd5a tempest-GroupSnapshotsTest-2057469718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (655bdb2c-707b-49c4-b73a-a4f6de150753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:40:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-321297409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2602dbf4-4b2d-48bd-a83b-19835d0fb1da,host='devstack@QuobyteHD#QuobyteHD',id=1ed9f564-34be-4940-a9db-4a0700c356b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dd42ab5a85040a9adc8ffeaf25d6eb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:40:29Z,use_quota=True,user_id='e3a8a7d1442949fcb5edf34738d8686a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dd303d0-df1c-4bc5-b303-651b666a3440),volume_type_id=4dd303d0-df1c-4bc5-b303-651b666a3440)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:28 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c1dd7e2f-53d3-4c91-a452-27faab6bcd5a tempest-GroupSnapshotsTest-2057469718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20a56096-5715-4b6e-b639-6dcd2322cc55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:28 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c1dd7e2f-53d3-4c91-a452-27faab6bcd5a tempest-GroupSnapshotsTest-2057469718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20a56096-5715-4b6e-b639-6dcd2322cc55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:28 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c1dd7e2f-53d3-4c91-a452-27faab6bcd5a tempest-GroupSnapshotsTest-2057469718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (789220ec-46b9-4cf7-bda1-a00fb44848b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:28 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c1dd7e2f-53d3-4c91-a452-27faab6bcd5a tempest-GroupSnapshotsTest-2057469718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (789220ec-46b9-4cf7-bda1-a00fb44848b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ed9f564-34be-4940-a9db-4a0700c356b0', 'volume_name': 'volume-1ed9f564-34be-4940-a9db-4a0700c356b0', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:28 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c1dd7e2f-53d3-4c91-a452-27faab6bcd5a tempest-GroupSnapshotsTest-2057469718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c635b4a-26f7-439d-a930-8d07ceab5d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:28 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c1dd7e2f-53d3-4c91-a452-27faab6bcd5a tempest-GroupSnapshotsTest-2057469718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c635b4a-26f7-439d-a930-8d07ceab5d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:28 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c1dd7e2f-53d3-4c91-a452-27faab6bcd5a tempest-GroupSnapshotsTest-2057469718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (101fa72a-f156-476c-8a8c-db68ab202d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:28 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-c1dd7e2f-53d3-4c91-a452-27faab6bcd5a tempest-GroupSnapshotsTest-2057469718 None] Volume 1ed9f564-34be-4940-a9db-4a0700c356b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ed9f564-34be-4940-a9db-4a0700c356b0', 'volume_size': 1} Nov 03 07:40:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-c1dd7e2f-53d3-4c91-a452-27faab6bcd5a tempest-GroupSnapshotsTest-2057469718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:28 devstack sudo[100451]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-07da2550-1615-4131-90f7-e650ca922465 tempest-TestImageHashVerification-445051293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b07832e1-579e-47c0-b525-a6bc12aa1e84" returned: 0 in 0.967s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-07da2550-1615-4131-90f7-e650ca922465 tempest-TestImageHashVerification-445051293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b07832e1-579e-47c0-b525-a6bc12aa1e84 /opt/stack/data/cinder/conversion/b07832e1-579e-47c0-b525-a6bc12aa1e84.temp_image.a862703c-8b78-42bd-9f1b-0059a36b0fe7elsuffts.img {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:28 devstack sudo[100460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b07832e1-579e-47c0-b525-a6bc12aa1e84 /opt/stack/data/cinder/conversion/b07832e1-579e-47c0-b525-a6bc12aa1e84.temp_image.a862703c-8b78-42bd-9f1b-0059a36b0fe7elsuffts.img Nov 03 07:40:28 devstack sudo[100460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:34 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd7c9802-fc03-42a9-9112-43c4b227d47a tempest-SnapshotMetadataTestJSON-1138617744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:40:34 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fd7c9802-fc03-42a9-9112-43c4b227d47a tempest-SnapshotMetadataTestJSON-1138617744 None] Flow 'volume_create_manager' (b72e4cfc-0625-47d3-9e79-b74a4e307e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:40:34 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fd7c9802-fc03-42a9-9112-43c4b227d47a tempest-SnapshotMetadataTestJSON-1138617744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64fec9be-d054-4a1d-b091-23aa0aa3e3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:34 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fd7c9802-fc03-42a9-9112-43c4b227d47a tempest-SnapshotMetadataTestJSON-1138617744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64fec9be-d054-4a1d-b091-23aa0aa3e3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:40:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-555478388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4186966-31bd-493f-b3fe-692c9852bf30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2891253c022348b08ea62fbc18c7a388',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:40:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:40:34Z,use_quota=True,user_id='4a17d55aca6440989fdb46ff1007b7f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:34 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fd7c9802-fc03-42a9-9112-43c4b227d47a tempest-SnapshotMetadataTestJSON-1138617744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50917d58-41b5-44ac-80d0-8bac70dda82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:34 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fd7c9802-fc03-42a9-9112-43c4b227d47a tempest-SnapshotMetadataTestJSON-1138617744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50917d58-41b5-44ac-80d0-8bac70dda82e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:34 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fd7c9802-fc03-42a9-9112-43c4b227d47a tempest-SnapshotMetadataTestJSON-1138617744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea2a03e7-79e3-4491-8f2d-cd0c8ebfaab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:34 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fd7c9802-fc03-42a9-9112-43c4b227d47a tempest-SnapshotMetadataTestJSON-1138617744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea2a03e7-79e3-4491-8f2d-cd0c8ebfaab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4186966-31bd-493f-b3fe-692c9852bf30', 'volume_name': 'volume-f4186966-31bd-493f-b3fe-692c9852bf30', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:34 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fd7c9802-fc03-42a9-9112-43c4b227d47a tempest-SnapshotMetadataTestJSON-1138617744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70f6c9f3-1368-4be3-8ede-6254f5a3f248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:34 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fd7c9802-fc03-42a9-9112-43c4b227d47a tempest-SnapshotMetadataTestJSON-1138617744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70f6c9f3-1368-4be3-8ede-6254f5a3f248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:34 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fd7c9802-fc03-42a9-9112-43c4b227d47a tempest-SnapshotMetadataTestJSON-1138617744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80250cd3-76ad-41ab-8ef8-6c05cf2bbba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:34 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-fd7c9802-fc03-42a9-9112-43c4b227d47a tempest-SnapshotMetadataTestJSON-1138617744 None] Volume f4186966-31bd-493f-b3fe-692c9852bf30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4186966-31bd-493f-b3fe-692c9852bf30', 'volume_size': 1} Nov 03 07:40:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-fd7c9802-fc03-42a9-9112-43c4b227d47a tempest-SnapshotMetadataTestJSON-1138617744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:38 devstack sudo[100460]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-07da2550-1615-4131-90f7-e650ca922465 tempest-TestImageHashVerification-445051293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b07832e1-579e-47c0-b525-a6bc12aa1e84 /opt/stack/data/cinder/conversion/b07832e1-579e-47c0-b525-a6bc12aa1e84.temp_image.a862703c-8b78-42bd-9f1b-0059a36b0fe7elsuffts.img" returned: 0 in 9.317s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:38 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[512b90f5-384d-409a-95f1-c60832294658]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:40:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-07da2550-1615-4131-90f7-e650ca922465 tempest-TestImageHashVerification-445051293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b07832e1-579e-47c0-b525-a6bc12aa1e84 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:38 devstack sudo[100480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b07832e1-579e-47c0-b525-a6bc12aa1e84 Nov 03 07:40:38 devstack sudo[100480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:38 devstack sudo[100480]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-07da2550-1615-4131-90f7-e650ca922465 tempest-TestImageHashVerification-445051293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b07832e1-579e-47c0-b525-a6bc12aa1e84" returned: 0 in 0.523s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:38 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-07da2550-1615-4131-90f7-e650ca922465 tempest-TestImageHashVerification-445051293 None] Image conversion details: src /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b07832e1-579e-47c0-b525-a6bc12aa1e84, size 1024.00 MB, duration 9.32 sec, destination /opt/stack/data/cinder/conversion/b07832e1-579e-47c0-b525-a6bc12aa1e84.temp_image.a862703c-8b78-42bd-9f1b-0059a36b0fe7elsuffts.img {{(pid=86875) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:40:38 devstack cinder-volume[86875]: INFO cinder.image.image_utils [None req-07da2550-1615-4131-90f7-e650ca922465 tempest-TestImageHashVerification-445051293 None] Converted 1024.00 MB image at 109.90 MB/s Nov 03 07:40:38 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-07da2550-1615-4131-90f7-e650ca922465 tempest-TestImageHashVerification-445051293 None] a862703c-8b78-42bd-9f1b-0059a36b0fe7 was raw, no need to convert to raw {{(pid=86875) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 03 07:40:44 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:SELECT=47,cinder:UPDATE=35,cinder:INSERT=7,cinder:DELETE=2 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:40:48 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:UPDATE=44,cinder:INSERT=10,cinder:SELECT=40 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:40:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-07da2550-1615-4131-90f7-e650ca922465 tempest-TestImageHashVerification-445051293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 31.595s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-07da2550-1615-4131-90f7-e650ca922465 tempest-TestImageHashVerification-445051293 None] Uploaded volume to glance image-id: a862703c-8b78-42bd-9f1b-0059a36b0fe7. {{(pid=86875) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 03 07:40:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-c1dd7e2f-53d3-4c91-a452-27faab6bcd5a tempest-GroupSnapshotsTest-2057469718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 30.130s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:58 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-c1dd7e2f-53d3-4c91-a452-27faab6bcd5a tempest-GroupSnapshotsTest-2057469718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2602dbf4-4b2d-48bd-a83b-19835d0fb1da,created_at=2026-11-03T06:40:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-321297409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2602dbf4-4b2d-48bd-a83b-19835d0fb1da,host='devstack@QuobyteHD#QuobyteHD',id=1ed9f564-34be-4940-a9db-4a0700c356b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dd42ab5a85040a9adc8ffeaf25d6eb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:40:29Z,use_quota=True,user_id='e3a8a7d1442949fcb5edf34738d8686a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dd303d0-df1c-4bc5-b303-651b666a3440),volume_type_id=4dd303d0-df1c-4bc5-b303-651b666a3440)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:40:58 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-c1dd7e2f-53d3-4c91-a452-27faab6bcd5a tempest-GroupSnapshotsTest-2057469718 None] Creating volume 1ed9f564-34be-4940-a9db-4a0700c356b0 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:40:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-c1dd7e2f-53d3-4c91-a452-27faab6bcd5a tempest-GroupSnapshotsTest-2057469718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-c1dd7e2f-53d3-4c91-a452-27faab6bcd5a tempest-GroupSnapshotsTest-2057469718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:58 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-c1dd7e2f-53d3-4c91-a452-27faab6bcd5a tempest-GroupSnapshotsTest-2057469718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:40:58 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-c1dd7e2f-53d3-4c91-a452-27faab6bcd5a tempest-GroupSnapshotsTest-2057469718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:40:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-c1dd7e2f-53d3-4c91-a452-27faab6bcd5a tempest-GroupSnapshotsTest-2057469718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:58 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-c1dd7e2f-53d3-4c91-a452-27faab6bcd5a tempest-GroupSnapshotsTest-2057469718 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:40:58 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-c1dd7e2f-53d3-4c91-a452-27faab6bcd5a tempest-GroupSnapshotsTest-2057469718 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:40:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c1dd7e2f-53d3-4c91-a452-27faab6bcd5a tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1ed9f564-34be-4940-a9db-4a0700c356b0 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:58 devstack sudo[100525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1ed9f564-34be-4940-a9db-4a0700c356b0 1073741824 Nov 03 07:40:58 devstack sudo[100525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:58 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-07da2550-1615-4131-90f7-e650ca922465 tempest-TestImageHashVerification-445051293 None] Copy volume to image completed successfully. Nov 03 07:40:59 devstack sudo[100525]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c1dd7e2f-53d3-4c91-a452-27faab6bcd5a tempest-GroupSnapshotsTest-2057469718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1ed9f564-34be-4940-a9db-4a0700c356b0 1073741824" returned: 0 in 0.454s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c1dd7e2f-53d3-4c91-a452-27faab6bcd5a tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1ed9f564-34be-4940-a9db-4a0700c356b0 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:59 devstack sudo[100531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1ed9f564-34be-4940-a9db-4a0700c356b0 Nov 03 07:40:59 devstack sudo[100531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:59 devstack sudo[100531]: pam_unix(sudo:session): session closed for user root Nov 03 07:40:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c1dd7e2f-53d3-4c91-a452-27faab6bcd5a tempest-GroupSnapshotsTest-2057469718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1ed9f564-34be-4940-a9db-4a0700c356b0" returned: 0 in 0.264s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:40:59 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-c1dd7e2f-53d3-4c91-a452-27faab6bcd5a tempest-GroupSnapshotsTest-2057469718 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:40:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-c1dd7e2f-53d3-4c91-a452-27faab6bcd5a tempest-GroupSnapshotsTest-2057469718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-fd7c9802-fc03-42a9-9112-43c4b227d47a tempest-SnapshotMetadataTestJSON-1138617744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 25.467s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:59 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-fd7c9802-fc03-42a9-9112-43c4b227d47a tempest-SnapshotMetadataTestJSON-1138617744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:40:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-555478388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4186966-31bd-493f-b3fe-692c9852bf30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2891253c022348b08ea62fbc18c7a388',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:40:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:40:34Z,use_quota=True,user_id='4a17d55aca6440989fdb46ff1007b7f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:40:59 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-fd7c9802-fc03-42a9-9112-43c4b227d47a tempest-SnapshotMetadataTestJSON-1138617744 None] Creating volume f4186966-31bd-493f-b3fe-692c9852bf30 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:40:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-fd7c9802-fc03-42a9-9112-43c4b227d47a tempest-SnapshotMetadataTestJSON-1138617744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:40:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-fd7c9802-fc03-42a9-9112-43c4b227d47a tempest-SnapshotMetadataTestJSON-1138617744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:40:59 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-fd7c9802-fc03-42a9-9112-43c4b227d47a tempest-SnapshotMetadataTestJSON-1138617744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:40:59 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-fd7c9802-fc03-42a9-9112-43c4b227d47a tempest-SnapshotMetadataTestJSON-1138617744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:40:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-fd7c9802-fc03-42a9-9112-43c4b227d47a tempest-SnapshotMetadataTestJSON-1138617744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:40:59 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-fd7c9802-fc03-42a9-9112-43c4b227d47a tempest-SnapshotMetadataTestJSON-1138617744 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:40:59 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-fd7c9802-fc03-42a9-9112-43c4b227d47a tempest-SnapshotMetadataTestJSON-1138617744 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:40:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fd7c9802-fc03-42a9-9112-43c4b227d47a tempest-SnapshotMetadataTestJSON-1138617744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f4186966-31bd-493f-b3fe-692c9852bf30 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:59 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d13b2339-ef68-4682-b721-be8edaa90a5c tempest-TestImageHashVerification-445051293 None] Acquiring lock "cinder-b07832e1-579e-47c0-b525-a6bc12aa1e84-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:40:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c1dd7e2f-53d3-4c91-a452-27faab6bcd5a tempest-GroupSnapshotsTest-2057469718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (101fa72a-f156-476c-8a8c-db68ab202d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ed9f564-34be-4940-a9db-4a0700c356b0', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:59 devstack sudo[100534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f4186966-31bd-493f-b3fe-692c9852bf30 1073741824 Nov 03 07:40:59 devstack sudo[100534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:40:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c1dd7e2f-53d3-4c91-a452-27faab6bcd5a tempest-GroupSnapshotsTest-2057469718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f785f42-f3a3-4715-83cd-997dc4cc4210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:40:59 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d13b2339-ef68-4682-b721-be8edaa90a5c tempest-TestImageHashVerification-445051293 None] Lock "cinder-b07832e1-579e-47c0-b525-a6bc12aa1e84-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:40:59 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-c1dd7e2f-53d3-4c91-a452-27faab6bcd5a tempest-GroupSnapshotsTest-2057469718 None] Volume volume-1ed9f564-34be-4940-a9db-4a0700c356b0 (1ed9f564-34be-4940-a9db-4a0700c356b0): created successfully Nov 03 07:40:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c1dd7e2f-53d3-4c91-a452-27faab6bcd5a tempest-GroupSnapshotsTest-2057469718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f785f42-f3a3-4715-83cd-997dc4cc4210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:40:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c1dd7e2f-53d3-4c91-a452-27faab6bcd5a tempest-GroupSnapshotsTest-2057469718 None] Flow 'volume_create_manager' (119f9440-eb74-4c98-a253-8f0e6e4034d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:40:59 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-c1dd7e2f-53d3-4c91-a452-27faab6bcd5a tempest-GroupSnapshotsTest-2057469718 None] Created volume successfully. Nov 03 07:40:59 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d13b2339-ef68-4682-b721-be8edaa90a5c tempest-TestImageHashVerification-445051293 None] Acquiring lock "cinder-quobyte-b07832e1-579e-47c0-b525-a6bc12aa1e84" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:40:59 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d13b2339-ef68-4682-b721-be8edaa90a5c tempest-TestImageHashVerification-445051293 None] Lock "cinder-quobyte-b07832e1-579e-47c0-b525-a6bc12aa1e84" acquired by "delete_volume" :: waited 0.029s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:40:59 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f31b9bf-9ed6-4e25-b943-4e42ef7a0ca3]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:40:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d13b2339-ef68-4682-b721-be8edaa90a5c tempest-TestImageHashVerification-445051293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b07832e1-579e-47c0-b525-a6bc12aa1e84 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:40:59 devstack sudo[100536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b07832e1-579e-47c0-b525-a6bc12aa1e84 Nov 03 07:40:59 devstack sudo[100536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:00 devstack sudo[100534]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fd7c9802-fc03-42a9-9112-43c4b227d47a tempest-SnapshotMetadataTestJSON-1138617744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f4186966-31bd-493f-b3fe-692c9852bf30 1073741824" returned: 0 in 0.436s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fd7c9802-fc03-42a9-9112-43c4b227d47a tempest-SnapshotMetadataTestJSON-1138617744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f4186966-31bd-493f-b3fe-692c9852bf30 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:00 devstack sudo[100541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f4186966-31bd-493f-b3fe-692c9852bf30 Nov 03 07:41:00 devstack sudo[100541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:00 devstack sudo[100536]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d13b2339-ef68-4682-b721-be8edaa90a5c tempest-TestImageHashVerification-445051293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b07832e1-579e-47c0-b525-a6bc12aa1e84" returned: 0 in 0.407s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d13b2339-ef68-4682-b721-be8edaa90a5c tempest-TestImageHashVerification-445051293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b07832e1-579e-47c0-b525-a6bc12aa1e84 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:00 devstack sudo[100546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b07832e1-579e-47c0-b525-a6bc12aa1e84 Nov 03 07:41:00 devstack sudo[100546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:00 devstack sudo[100541]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fd7c9802-fc03-42a9-9112-43c4b227d47a tempest-SnapshotMetadataTestJSON-1138617744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f4186966-31bd-493f-b3fe-692c9852bf30" returned: 0 in 0.250s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:00 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-fd7c9802-fc03-42a9-9112-43c4b227d47a tempest-SnapshotMetadataTestJSON-1138617744 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:41:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-fd7c9802-fc03-42a9-9112-43c4b227d47a tempest-SnapshotMetadataTestJSON-1138617744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fd7c9802-fc03-42a9-9112-43c4b227d47a tempest-SnapshotMetadataTestJSON-1138617744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80250cd3-76ad-41ab-8ef8-6c05cf2bbba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4186966-31bd-493f-b3fe-692c9852bf30', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fd7c9802-fc03-42a9-9112-43c4b227d47a tempest-SnapshotMetadataTestJSON-1138617744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f4990cf-3075-49dc-8503-718d0f5ea24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:00 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-fd7c9802-fc03-42a9-9112-43c4b227d47a tempest-SnapshotMetadataTestJSON-1138617744 None] Volume volume-f4186966-31bd-493f-b3fe-692c9852bf30 (f4186966-31bd-493f-b3fe-692c9852bf30): created successfully Nov 03 07:41:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fd7c9802-fc03-42a9-9112-43c4b227d47a tempest-SnapshotMetadataTestJSON-1138617744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f4990cf-3075-49dc-8503-718d0f5ea24e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fd7c9802-fc03-42a9-9112-43c4b227d47a tempest-SnapshotMetadataTestJSON-1138617744 None] Flow 'volume_create_manager' (b72e4cfc-0625-47d3-9e79-b74a4e307e15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:00 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-fd7c9802-fc03-42a9-9112-43c4b227d47a tempest-SnapshotMetadataTestJSON-1138617744 None] Created volume successfully. Nov 03 07:41:00 devstack sudo[100546]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d13b2339-ef68-4682-b721-be8edaa90a5c tempest-TestImageHashVerification-445051293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b07832e1-579e-47c0-b525-a6bc12aa1e84" returned: 0 in 0.267s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:00 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d13b2339-ef68-4682-b721-be8edaa90a5c tempest-TestImageHashVerification-445051293 None] Lock "cinder-quobyte-b07832e1-579e-47c0-b525-a6bc12aa1e84" released by "delete_volume" :: held 0.714s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:00 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-d13b2339-ef68-4682-b721-be8edaa90a5c tempest-TestImageHashVerification-445051293 None] Created reservations ['cd47d356-d5cf-409f-8fa5-1a04de427bb4', 'ea3b03ec-b0ac-42c3-b5e3-9f6f6d9c31b3', '5c122903-6027-4c1c-b5d5-ad5fe859f23c', 'e63faf68-8cd9-4ac8-bb88-720c57e4a9f7'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:41:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-d13b2339-ef68-4682-b721-be8edaa90a5c tempest-TestImageHashVerification-445051293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-d13b2339-ef68-4682-b721-be8edaa90a5c tempest-TestImageHashVerification-445051293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:00 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-d13b2339-ef68-4682-b721-be8edaa90a5c tempest-TestImageHashVerification-445051293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:00 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-d13b2339-ef68-4682-b721-be8edaa90a5c tempest-TestImageHashVerification-445051293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-d13b2339-ef68-4682-b721-be8edaa90a5c tempest-TestImageHashVerification-445051293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d13b2339-ef68-4682-b721-be8edaa90a5c tempest-TestImageHashVerification-445051293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:00 devstack sudo[100550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:41:00 devstack sudo[100550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:00 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-ebf7d615-d040-4c07-aa45-bde7f6a3fb8f tempest-GroupSnapshotsTest-2057469718 None] Update group completed successfully. Nov 03 07:41:00 devstack sudo[100550]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d13b2339-ef68-4682-b721-be8edaa90a5c tempest-TestImageHashVerification-445051293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.287s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:00 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-d13b2339-ef68-4682-b721-be8edaa90a5c tempest-TestImageHashVerification-445051293 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:41:00 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-d13b2339-ef68-4682-b721-be8edaa90a5c tempest-TestImageHashVerification-445051293 None] Deleted volume successfully. Nov 03 07:41:01 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d13b2339-ef68-4682-b721-be8edaa90a5c tempest-TestImageHashVerification-445051293 None] Lock "cinder-b07832e1-579e-47c0-b525-a6bc12aa1e84-delete_volume" released by "delete_volume" :: held 1.281s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-db4c8901-6bc1-45a5-b001-16cc06117392 tempest-SnapshotMetadataTestJSON-1138617744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-db4c8901-6bc1-45a5-b001-16cc06117392 tempest-SnapshotMetadataTestJSON-1138617744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:01 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-db4c8901-6bc1-45a5-b001-16cc06117392 tempest-SnapshotMetadataTestJSON-1138617744 None] Creating offline snapshot 5b517f6c-843f-4da4-92e7-1645dfe17d55 of volume f4186966-31bd-493f-b3fe-692c9852bf30 {{(pid=86875) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:41:01 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f577531-5625-4e2a-a296-820755f25dbc]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-db4c8901-6bc1-45a5-b001-16cc06117392 tempest-SnapshotMetadataTestJSON-1138617744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f4186966-31bd-493f-b3fe-692c9852bf30 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:01 devstack sudo[100553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f4186966-31bd-493f-b3fe-692c9852bf30 Nov 03 07:41:01 devstack sudo[100553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:01 devstack sudo[100553]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-db4c8901-6bc1-45a5-b001-16cc06117392 tempest-SnapshotMetadataTestJSON-1138617744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f4186966-31bd-493f-b3fe-692c9852bf30" returned: 0 in 0.430s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-db4c8901-6bc1-45a5-b001-16cc06117392 tempest-SnapshotMetadataTestJSON-1138617744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f4186966-31bd-493f-b3fe-692c9852bf30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f4186966-31bd-493f-b3fe-692c9852bf30.5b517f6c-843f-4da4-92e7-1645dfe17d55 1G {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:01 devstack sudo[100559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f4186966-31bd-493f-b3fe-692c9852bf30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f4186966-31bd-493f-b3fe-692c9852bf30.5b517f6c-843f-4da4-92e7-1645dfe17d55 1G Nov 03 07:41:01 devstack sudo[100559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:02 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-1494dffb-c7bf-4bfc-907f-cf3a3d294c5a tempest-GroupSnapshotsTest-2057469718 None] Update group completed successfully. Nov 03 07:41:02 devstack sudo[100559]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-db4c8901-6bc1-45a5-b001-16cc06117392 tempest-SnapshotMetadataTestJSON-1138617744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f4186966-31bd-493f-b3fe-692c9852bf30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f4186966-31bd-493f-b3fe-692c9852bf30.5b517f6c-843f-4da4-92e7-1645dfe17d55 1G" returned: 0 in 0.481s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-db4c8901-6bc1-45a5-b001-16cc06117392 tempest-SnapshotMetadataTestJSON-1138617744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4186966-31bd-493f-b3fe-692c9852bf30 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f4186966-31bd-493f-b3fe-692c9852bf30.5b517f6c-843f-4da4-92e7-1645dfe17d55 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:02 devstack sudo[100565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4186966-31bd-493f-b3fe-692c9852bf30 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f4186966-31bd-493f-b3fe-692c9852bf30.5b517f6c-843f-4da4-92e7-1645dfe17d55 Nov 03 07:41:02 devstack sudo[100565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:02 devstack sudo[100565]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-db4c8901-6bc1-45a5-b001-16cc06117392 tempest-SnapshotMetadataTestJSON-1138617744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4186966-31bd-493f-b3fe-692c9852bf30 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f4186966-31bd-493f-b3fe-692c9852bf30.5b517f6c-843f-4da4-92e7-1645dfe17d55" returned: 0 in 0.288s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:02 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-db4c8901-6bc1-45a5-b001-16cc06117392 tempest-SnapshotMetadataTestJSON-1138617744 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f4186966-31bd-493f-b3fe-692c9852bf30.5b517f6c-843f-4da4-92e7-1645dfe17d55 is being set with open permissions: ugo+rw Nov 03 07:41:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-db4c8901-6bc1-45a5-b001-16cc06117392 tempest-SnapshotMetadataTestJSON-1138617744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f4186966-31bd-493f-b3fe-692c9852bf30.5b517f6c-843f-4da4-92e7-1645dfe17d55 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:02 devstack sudo[100570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f4186966-31bd-493f-b3fe-692c9852bf30.5b517f6c-843f-4da4-92e7-1645dfe17d55 Nov 03 07:41:02 devstack sudo[100570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:02 devstack sudo[100570]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-db4c8901-6bc1-45a5-b001-16cc06117392 tempest-SnapshotMetadataTestJSON-1138617744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f4186966-31bd-493f-b3fe-692c9852bf30.5b517f6c-843f-4da4-92e7-1645dfe17d55" returned: 0 in 0.284s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-db4c8901-6bc1-45a5-b001-16cc06117392 tempest-SnapshotMetadataTestJSON-1138617744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f4186966-31bd-493f-b3fe-692c9852bf30.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:02 devstack sudo[100574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f4186966-31bd-493f-b3fe-692c9852bf30.info Nov 03 07:41:02 devstack sudo[100574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:03 devstack sudo[100574]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-db4c8901-6bc1-45a5-b001-16cc06117392 tempest-SnapshotMetadataTestJSON-1138617744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f4186966-31bd-493f-b3fe-692c9852bf30.info" returned: 0 in 0.335s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:03 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-db4c8901-6bc1-45a5-b001-16cc06117392 tempest-SnapshotMetadataTestJSON-1138617744 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f4186966-31bd-493f-b3fe-692c9852bf30.info is being set with open permissions: ugo+rw Nov 03 07:41:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-db4c8901-6bc1-45a5-b001-16cc06117392 tempest-SnapshotMetadataTestJSON-1138617744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f4186966-31bd-493f-b3fe-692c9852bf30.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:03 devstack sudo[100577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f4186966-31bd-493f-b3fe-692c9852bf30.info Nov 03 07:41:03 devstack sudo[100577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:03 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-8c8b377d-bbb6-4218-895d-f47be333ab3d tempest-GroupSnapshotsTest-2057469718 None] Update group completed successfully. Nov 03 07:41:03 devstack sudo[100577]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-db4c8901-6bc1-45a5-b001-16cc06117392 tempest-SnapshotMetadataTestJSON-1138617744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f4186966-31bd-493f-b3fe-692c9852bf30.info" returned: 0 in 0.320s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-db4c8901-6bc1-45a5-b001-16cc06117392 tempest-SnapshotMetadataTestJSON-1138617744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.240s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:03 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-db4c8901-6bc1-45a5-b001-16cc06117392 tempest-SnapshotMetadataTestJSON-1138617744 None] Create snapshot completed successfully Nov 03 07:41:03 devstack cinder-volume[86875]: DEBUG oslo_service.periodic_task [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86875) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:41:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:03 devstack sudo[100580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:41:03 devstack sudo[100580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:03 devstack sudo[100580]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.292s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:03 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:41:03 devstack cinder-volume[86875]: DEBUG oslo_service.periodic_task [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running periodic task VolumeManager._thread_info {{(pid=86875) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:41:03 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] thread count: 28 {{(pid=86875) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:41:03 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] thread info: [<_MainThread(MainThread, started 125626325639296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86875) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:41:04 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-a45e032b-154a-4eeb-bae5-cb14c23d8405 tempest-GroupSnapshotsTest-2057469718 None] Update group completed successfully. Nov 03 07:41:05 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-be4ffa47-a8c1-48e2-898b-3ef8d1a23d85 tempest-SnapshotMetadataTestJSON-1138617744 None] Acquiring lock "cinder-5b517f6c-843f-4da4-92e7-1645dfe17d55-delete_snapshot" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:05 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-be4ffa47-a8c1-48e2-898b-3ef8d1a23d85 tempest-SnapshotMetadataTestJSON-1138617744 None] Lock "cinder-5b517f6c-843f-4da4-92e7-1645dfe17d55-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:05 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-be4ffa47-a8c1-48e2-898b-3ef8d1a23d85 tempest-SnapshotMetadataTestJSON-1138617744 None] Acquiring lock "cinder-quobyte-f4186966-31bd-493f-b3fe-692c9852bf30" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:05 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-be4ffa47-a8c1-48e2-898b-3ef8d1a23d85 tempest-SnapshotMetadataTestJSON-1138617744 None] Lock "cinder-quobyte-f4186966-31bd-493f-b3fe-692c9852bf30" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:05 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-be4ffa47-a8c1-48e2-898b-3ef8d1a23d85 tempest-SnapshotMetadataTestJSON-1138617744 None] Acquiring lock "cinder-quobyte-5b517f6c-843f-4da4-92e7-1645dfe17d55" by "_delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:05 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-be4ffa47-a8c1-48e2-898b-3ef8d1a23d85 tempest-SnapshotMetadataTestJSON-1138617744 None] Lock "cinder-quobyte-5b517f6c-843f-4da4-92e7-1645dfe17d55" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:05 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-be4ffa47-a8c1-48e2-898b-3ef8d1a23d85 tempest-SnapshotMetadataTestJSON-1138617744 None] Deleting offline snapshot 5b517f6c-843f-4da4-92e7-1645dfe17d55 of volume f4186966-31bd-493f-b3fe-692c9852bf30 {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:41:05 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-be4ffa47-a8c1-48e2-898b-3ef8d1a23d85 tempest-SnapshotMetadataTestJSON-1138617744 None] snapshot_file for this snap is: volume-f4186966-31bd-493f-b3fe-692c9852bf30.5b517f6c-843f-4da4-92e7-1645dfe17d55 {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:41:05 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[1451b6ec-3320-4655-a894-c6575cf81422]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-be4ffa47-a8c1-48e2-898b-3ef8d1a23d85 tempest-SnapshotMetadataTestJSON-1138617744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f4186966-31bd-493f-b3fe-692c9852bf30.5b517f6c-843f-4da4-92e7-1645dfe17d55 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:05 devstack sudo[100587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f4186966-31bd-493f-b3fe-692c9852bf30.5b517f6c-843f-4da4-92e7-1645dfe17d55 Nov 03 07:41:05 devstack sudo[100587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:05 devstack sudo[100587]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-be4ffa47-a8c1-48e2-898b-3ef8d1a23d85 tempest-SnapshotMetadataTestJSON-1138617744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f4186966-31bd-493f-b3fe-692c9852bf30.5b517f6c-843f-4da4-92e7-1645dfe17d55" returned: 0 in 0.590s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:05 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-be4ffa47-a8c1-48e2-898b-3ef8d1a23d85 tempest-SnapshotMetadataTestJSON-1138617744 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4186966-31bd-493f-b3fe-692c9852bf30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:41:06 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d26946-902b-4cf6-86b6-0e311ec05a76]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-be4ffa47-a8c1-48e2-898b-3ef8d1a23d85 tempest-SnapshotMetadataTestJSON-1138617744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f4186966-31bd-493f-b3fe-692c9852bf30 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:06 devstack sudo[100593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f4186966-31bd-493f-b3fe-692c9852bf30 Nov 03 07:41:06 devstack sudo[100593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:06 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-8c3c4c02-971a-4146-9894-3f5e70d0ec3a tempest-GroupSnapshotsTest-2057469718 None] GroupSnapshot 8cb21f2b-9e02-425c-a0c6-82e97507bb42: creating. Nov 03 07:41:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-8c3c4c02-971a-4146-9894-3f5e70d0ec3a tempest-GroupSnapshotsTest-2057469718 None] Group snapshot 8cb21f2b-9e02-425c-a0c6-82e97507bb42: creating. {{(pid=86875) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 03 07:41:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-8c3c4c02-971a-4146-9894-3f5e70d0ec3a tempest-GroupSnapshotsTest-2057469718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-8c3c4c02-971a-4146-9894-3f5e70d0ec3a tempest-GroupSnapshotsTest-2057469718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:06 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-8c3c4c02-971a-4146-9894-3f5e70d0ec3a tempest-GroupSnapshotsTest-2057469718 None] Creating offline snapshot 646019c5-928e-413a-bfb7-adf858fec7a2 of volume 1ed9f564-34be-4940-a9db-4a0700c356b0 {{(pid=86875) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:41:06 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[0827bd5b-6c03-4055-a3ad-9a3b77570d2f]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8c3c4c02-971a-4146-9894-3f5e70d0ec3a tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1ed9f564-34be-4940-a9db-4a0700c356b0 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:06 devstack sudo[100595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1ed9f564-34be-4940-a9db-4a0700c356b0 Nov 03 07:41:06 devstack sudo[100595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:06 devstack sudo[100593]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-be4ffa47-a8c1-48e2-898b-3ef8d1a23d85 tempest-SnapshotMetadataTestJSON-1138617744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f4186966-31bd-493f-b3fe-692c9852bf30" returned: 0 in 0.526s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-be4ffa47-a8c1-48e2-898b-3ef8d1a23d85 tempest-SnapshotMetadataTestJSON-1138617744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f4186966-31bd-493f-b3fe-692c9852bf30.5b517f6c-843f-4da4-92e7-1645dfe17d55 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:06 devstack sudo[100601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f4186966-31bd-493f-b3fe-692c9852bf30.5b517f6c-843f-4da4-92e7-1645dfe17d55 Nov 03 07:41:06 devstack sudo[100601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:06 devstack sudo[100595]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8c3c4c02-971a-4146-9894-3f5e70d0ec3a tempest-GroupSnapshotsTest-2057469718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1ed9f564-34be-4940-a9db-4a0700c356b0" returned: 0 in 0.537s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8c3c4c02-971a-4146-9894-3f5e70d0ec3a tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1ed9f564-34be-4940-a9db-4a0700c356b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1ed9f564-34be-4940-a9db-4a0700c356b0.646019c5-928e-413a-bfb7-adf858fec7a2 1G {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:06 devstack sudo[100610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1ed9f564-34be-4940-a9db-4a0700c356b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1ed9f564-34be-4940-a9db-4a0700c356b0.646019c5-928e-413a-bfb7-adf858fec7a2 1G Nov 03 07:41:06 devstack sudo[100610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:07 devstack sudo[100601]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-be4ffa47-a8c1-48e2-898b-3ef8d1a23d85 tempest-SnapshotMetadataTestJSON-1138617744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f4186966-31bd-493f-b3fe-692c9852bf30.5b517f6c-843f-4da4-92e7-1645dfe17d55" returned: 0 in 0.598s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-be4ffa47-a8c1-48e2-898b-3ef8d1a23d85 tempest-SnapshotMetadataTestJSON-1138617744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f4186966-31bd-493f-b3fe-692c9852bf30.5b517f6c-843f-4da4-92e7-1645dfe17d55 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:07 devstack sudo[100614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f4186966-31bd-493f-b3fe-692c9852bf30.5b517f6c-843f-4da4-92e7-1645dfe17d55 Nov 03 07:41:07 devstack sudo[100614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:07 devstack sudo[100614]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-be4ffa47-a8c1-48e2-898b-3ef8d1a23d85 tempest-SnapshotMetadataTestJSON-1138617744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f4186966-31bd-493f-b3fe-692c9852bf30.5b517f6c-843f-4da4-92e7-1645dfe17d55" returned: 0 in 0.319s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:07 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-be4ffa47-a8c1-48e2-898b-3ef8d1a23d85 tempest-SnapshotMetadataTestJSON-1138617744 None] Lock "cinder-quobyte-5b517f6c-843f-4da4-92e7-1645dfe17d55" released by "_delete_snapshot" :: held 2.246s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:07 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-be4ffa47-a8c1-48e2-898b-3ef8d1a23d85 tempest-SnapshotMetadataTestJSON-1138617744 None] Lock "cinder-quobyte-f4186966-31bd-493f-b3fe-692c9852bf30" released by "delete_snapshot" :: held 2.292s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:07 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-be4ffa47-a8c1-48e2-898b-3ef8d1a23d85 tempest-SnapshotMetadataTestJSON-1138617744 None] Created reservations ['1fdd5c7e-5ec8-41c1-baf6-20e1c825afb4', '996ac3f4-b249-49c0-ab07-3ba2dd0168b8', '82565e5a-1823-4dc2-bb30-7cea19416184', 'a5686aa4-9430-4a42-b208-efd453b70ba5'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:41:07 devstack sudo[100610]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8c3c4c02-971a-4146-9894-3f5e70d0ec3a tempest-GroupSnapshotsTest-2057469718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1ed9f564-34be-4940-a9db-4a0700c356b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1ed9f564-34be-4940-a9db-4a0700c356b0.646019c5-928e-413a-bfb7-adf858fec7a2 1G" returned: 0 in 1.006s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8c3c4c02-971a-4146-9894-3f5e70d0ec3a tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ed9f564-34be-4940-a9db-4a0700c356b0 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1ed9f564-34be-4940-a9db-4a0700c356b0.646019c5-928e-413a-bfb7-adf858fec7a2 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:07 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-be4ffa47-a8c1-48e2-898b-3ef8d1a23d85 tempest-SnapshotMetadataTestJSON-1138617744 None] Delete snapshot completed successfully. Nov 03 07:41:07 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-be4ffa47-a8c1-48e2-898b-3ef8d1a23d85 tempest-SnapshotMetadataTestJSON-1138617744 None] Lock "cinder-5b517f6c-843f-4da4-92e7-1645dfe17d55-delete_snapshot" released by "delete_snapshot" :: held 2.616s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:07 devstack sudo[100643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ed9f564-34be-4940-a9db-4a0700c356b0 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1ed9f564-34be-4940-a9db-4a0700c356b0.646019c5-928e-413a-bfb7-adf858fec7a2 Nov 03 07:41:07 devstack sudo[100643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:08 devstack sudo[100643]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8c3c4c02-971a-4146-9894-3f5e70d0ec3a tempest-GroupSnapshotsTest-2057469718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ed9f564-34be-4940-a9db-4a0700c356b0 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1ed9f564-34be-4940-a9db-4a0700c356b0.646019c5-928e-413a-bfb7-adf858fec7a2" returned: 0 in 0.369s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:08 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-8c3c4c02-971a-4146-9894-3f5e70d0ec3a tempest-GroupSnapshotsTest-2057469718 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1ed9f564-34be-4940-a9db-4a0700c356b0.646019c5-928e-413a-bfb7-adf858fec7a2 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 07:41:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8c3c4c02-971a-4146-9894-3f5e70d0ec3a tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1ed9f564-34be-4940-a9db-4a0700c356b0.646019c5-928e-413a-bfb7-adf858fec7a2 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:08 devstack sudo[100650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1ed9f564-34be-4940-a9db-4a0700c356b0.646019c5-928e-413a-bfb7-adf858fec7a2 Nov 03 07:41:08 devstack sudo[100650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:08 devstack sudo[100650]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8c3c4c02-971a-4146-9894-3f5e70d0ec3a tempest-GroupSnapshotsTest-2057469718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1ed9f564-34be-4940-a9db-4a0700c356b0.646019c5-928e-413a-bfb7-adf858fec7a2" returned: 0 in 0.391s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8c3c4c02-971a-4146-9894-3f5e70d0ec3a tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1ed9f564-34be-4940-a9db-4a0700c356b0.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:08 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ac0abc5f-8b28-4a3e-8fba-51cd6f0c3383 tempest-SnapshotMetadataTestJSON-1138617744 None] Acquiring lock "cinder-f4186966-31bd-493f-b3fe-692c9852bf30-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:08 devstack sudo[100654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1ed9f564-34be-4940-a9db-4a0700c356b0.info Nov 03 07:41:08 devstack sudo[100654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:08 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ac0abc5f-8b28-4a3e-8fba-51cd6f0c3383 tempest-SnapshotMetadataTestJSON-1138617744 None] Lock "cinder-f4186966-31bd-493f-b3fe-692c9852bf30-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:08 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ac0abc5f-8b28-4a3e-8fba-51cd6f0c3383 tempest-SnapshotMetadataTestJSON-1138617744 None] Acquiring lock "cinder-quobyte-f4186966-31bd-493f-b3fe-692c9852bf30" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:08 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ac0abc5f-8b28-4a3e-8fba-51cd6f0c3383 tempest-SnapshotMetadataTestJSON-1138617744 None] Lock "cinder-quobyte-f4186966-31bd-493f-b3fe-692c9852bf30" acquired by "delete_volume" :: waited 0.030s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:08 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf78000-fedd-4f54-95c8-56a2584840c2]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ac0abc5f-8b28-4a3e-8fba-51cd6f0c3383 tempest-SnapshotMetadataTestJSON-1138617744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f4186966-31bd-493f-b3fe-692c9852bf30 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:09 devstack sudo[100654]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:09 devstack sudo[100656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f4186966-31bd-493f-b3fe-692c9852bf30 Nov 03 07:41:09 devstack sudo[100656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8c3c4c02-971a-4146-9894-3f5e70d0ec3a tempest-GroupSnapshotsTest-2057469718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1ed9f564-34be-4940-a9db-4a0700c356b0.info" returned: 0 in 0.453s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:09 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-8c3c4c02-971a-4146-9894-3f5e70d0ec3a tempest-GroupSnapshotsTest-2057469718 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1ed9f564-34be-4940-a9db-4a0700c356b0.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 07:41:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8c3c4c02-971a-4146-9894-3f5e70d0ec3a tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1ed9f564-34be-4940-a9db-4a0700c356b0.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:09 devstack sudo[100660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1ed9f564-34be-4940-a9db-4a0700c356b0.info Nov 03 07:41:09 devstack sudo[100660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:09 devstack sudo[100660]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8c3c4c02-971a-4146-9894-3f5e70d0ec3a tempest-GroupSnapshotsTest-2057469718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1ed9f564-34be-4940-a9db-4a0700c356b0.info" returned: 0 in 0.373s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-8c3c4c02-971a-4146-9894-3f5e70d0ec3a tempest-GroupSnapshotsTest-2057469718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.265s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-8c3c4c02-971a-4146-9894-3f5e70d0ec3a tempest-GroupSnapshotsTest-2057469718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-8c3c4c02-971a-4146-9894-3f5e70d0ec3a tempest-GroupSnapshotsTest-2057469718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:09 devstack cinder-volume[86875]: INFO cinder.volume.manager [req-4bae9369-e78d-4b76-93f1-b73c1956553b req-848103f7-5f74-4874-b697-2606dabaa2a4 tempest-TestShelveInstance-2081252662 None] Terminate volume connection completed successfully. Nov 03 07:41:09 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-4bae9369-e78d-4b76-93f1-b73c1956553b req-848103f7-5f74-4874-b697-2606dabaa2a4 tempest-TestShelveInstance-2081252662 None] Deleting attachment 271b3f5d-b98f-4bf5-8e8b-be747f047e0c. {{(pid=86875) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:41:09 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-8c3c4c02-971a-4146-9894-3f5e70d0ec3a tempest-GroupSnapshotsTest-2057469718 None] Creating offline snapshot f95a0412-06a0-49e2-8e3f-e056b6627ee0 of volume 9f5bad02-8bcf-42d0-80ca-b69637cc4ae6 {{(pid=86875) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:41:09 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a8aca0-60ee-4b20-8f3b-2d1af8cc8d8a]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8c3c4c02-971a-4146-9894-3f5e70d0ec3a tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f5bad02-8bcf-42d0-80ca-b69637cc4ae6 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:09 devstack sudo[100656]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ac0abc5f-8b28-4a3e-8fba-51cd6f0c3383 tempest-SnapshotMetadataTestJSON-1138617744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f4186966-31bd-493f-b3fe-692c9852bf30" returned: 0 in 0.719s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ac0abc5f-8b28-4a3e-8fba-51cd6f0c3383 tempest-SnapshotMetadataTestJSON-1138617744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f4186966-31bd-493f-b3fe-692c9852bf30 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:09 devstack sudo[100668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f4186966-31bd-493f-b3fe-692c9852bf30 Nov 03 07:41:09 devstack sudo[100668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:09 devstack sudo[100667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f5bad02-8bcf-42d0-80ca-b69637cc4ae6 Nov 03 07:41:09 devstack sudo[100667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:09 devstack cinder-volume[86875]: DEBUG cinder.coordination [req-4bae9369-e78d-4b76-93f1-b73c1956553b req-3b8f9641-967a-4755-b874-901c1d915621 tempest-TestShelveInstance-2081252662 None] Acquiring lock "cinder-442c9ef6-b786-4e22-b5e3-e222b7b63413-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:09 devstack cinder-volume[86875]: DEBUG cinder.coordination [req-4bae9369-e78d-4b76-93f1-b73c1956553b req-3b8f9641-967a-4755-b874-901c1d915621 tempest-TestShelveInstance-2081252662 None] Lock "cinder-442c9ef6-b786-4e22-b5e3-e222b7b63413-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:09 devstack cinder-volume[86875]: DEBUG cinder.coordination [req-4bae9369-e78d-4b76-93f1-b73c1956553b req-3b8f9641-967a-4755-b874-901c1d915621 tempest-TestShelveInstance-2081252662 None] Acquiring lock "cinder-quobyte-442c9ef6-b786-4e22-b5e3-e222b7b63413" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:09 devstack cinder-volume[86875]: DEBUG cinder.coordination [req-4bae9369-e78d-4b76-93f1-b73c1956553b req-3b8f9641-967a-4755-b874-901c1d915621 tempest-TestShelveInstance-2081252662 None] Lock "cinder-quobyte-442c9ef6-b786-4e22-b5e3-e222b7b63413" acquired by "delete_volume" :: waited 0.036s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:09 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f77e7f-d61e-425f-83b4-45bd87538d82]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [req-4bae9369-e78d-4b76-93f1-b73c1956553b req-3b8f9641-967a-4755-b874-901c1d915621 tempest-TestShelveInstance-2081252662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-442c9ef6-b786-4e22-b5e3-e222b7b63413 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:10 devstack sudo[100668]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ac0abc5f-8b28-4a3e-8fba-51cd6f0c3383 tempest-SnapshotMetadataTestJSON-1138617744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f4186966-31bd-493f-b3fe-692c9852bf30" returned: 0 in 0.467s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:10 devstack sudo[100667]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8c3c4c02-971a-4146-9894-3f5e70d0ec3a tempest-GroupSnapshotsTest-2057469718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f5bad02-8bcf-42d0-80ca-b69637cc4ae6" returned: 0 in 0.542s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8c3c4c02-971a-4146-9894-3f5e70d0ec3a tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f5bad02-8bcf-42d0-80ca-b69637cc4ae6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f5bad02-8bcf-42d0-80ca-b69637cc4ae6.f95a0412-06a0-49e2-8e3f-e056b6627ee0 1G {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:10 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ac0abc5f-8b28-4a3e-8fba-51cd6f0c3383 tempest-SnapshotMetadataTestJSON-1138617744 None] Lock "cinder-quobyte-f4186966-31bd-493f-b3fe-692c9852bf30" released by "delete_volume" :: held 1.316s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:10 devstack sudo[100672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-442c9ef6-b786-4e22-b5e3-e222b7b63413 Nov 03 07:41:10 devstack sudo[100672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:10 devstack sudo[100676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f5bad02-8bcf-42d0-80ca-b69637cc4ae6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f5bad02-8bcf-42d0-80ca-b69637cc4ae6.f95a0412-06a0-49e2-8e3f-e056b6627ee0 1G Nov 03 07:41:10 devstack sudo[100676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:10 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-ac0abc5f-8b28-4a3e-8fba-51cd6f0c3383 tempest-SnapshotMetadataTestJSON-1138617744 None] Created reservations ['000d78e5-83e8-4f10-bd45-2d0320153a32', 'bfc4d5df-19f8-412b-b541-3e07f24b7a39', 'd04db4e8-fc9a-442a-a3a8-7d1c55d7bcdc', 'c30b0d58-fe2e-433a-b2a9-611e0050cc15'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:41:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-ac0abc5f-8b28-4a3e-8fba-51cd6f0c3383 tempest-SnapshotMetadataTestJSON-1138617744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-ac0abc5f-8b28-4a3e-8fba-51cd6f0c3383 tempest-SnapshotMetadataTestJSON-1138617744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:10 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-ac0abc5f-8b28-4a3e-8fba-51cd6f0c3383 tempest-SnapshotMetadataTestJSON-1138617744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:10 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-ac0abc5f-8b28-4a3e-8fba-51cd6f0c3383 tempest-SnapshotMetadataTestJSON-1138617744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-ac0abc5f-8b28-4a3e-8fba-51cd6f0c3383 tempest-SnapshotMetadataTestJSON-1138617744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ac0abc5f-8b28-4a3e-8fba-51cd6f0c3383 tempest-SnapshotMetadataTestJSON-1138617744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:10 devstack sudo[100679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:41:10 devstack sudo[100679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:10 devstack sudo[100672]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [req-4bae9369-e78d-4b76-93f1-b73c1956553b req-3b8f9641-967a-4755-b874-901c1d915621 tempest-TestShelveInstance-2081252662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-442c9ef6-b786-4e22-b5e3-e222b7b63413" returned: 0 in 0.723s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [req-4bae9369-e78d-4b76-93f1-b73c1956553b req-3b8f9641-967a-4755-b874-901c1d915621 tempest-TestShelveInstance-2081252662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-442c9ef6-b786-4e22-b5e3-e222b7b63413 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:10 devstack sudo[100689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-442c9ef6-b786-4e22-b5e3-e222b7b63413 Nov 03 07:41:10 devstack sudo[100689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:10 devstack sudo[100679]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ac0abc5f-8b28-4a3e-8fba-51cd6f0c3383 tempest-SnapshotMetadataTestJSON-1138617744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.414s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:10 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-ac0abc5f-8b28-4a3e-8fba-51cd6f0c3383 tempest-SnapshotMetadataTestJSON-1138617744 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:41:10 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-ac0abc5f-8b28-4a3e-8fba-51cd6f0c3383 tempest-SnapshotMetadataTestJSON-1138617744 None] Deleted volume successfully. Nov 03 07:41:10 devstack sudo[100676]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8c3c4c02-971a-4146-9894-3f5e70d0ec3a tempest-GroupSnapshotsTest-2057469718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f5bad02-8bcf-42d0-80ca-b69637cc4ae6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f5bad02-8bcf-42d0-80ca-b69637cc4ae6.f95a0412-06a0-49e2-8e3f-e056b6627ee0 1G" returned: 0 in 0.746s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8c3c4c02-971a-4146-9894-3f5e70d0ec3a tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f5bad02-8bcf-42d0-80ca-b69637cc4ae6 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f5bad02-8bcf-42d0-80ca-b69637cc4ae6.f95a0412-06a0-49e2-8e3f-e056b6627ee0 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:10 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ac0abc5f-8b28-4a3e-8fba-51cd6f0c3383 tempest-SnapshotMetadataTestJSON-1138617744 None] Lock "cinder-f4186966-31bd-493f-b3fe-692c9852bf30-delete_volume" released by "delete_volume" :: held 2.177s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:10 devstack sudo[100692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f5bad02-8bcf-42d0-80ca-b69637cc4ae6 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f5bad02-8bcf-42d0-80ca-b69637cc4ae6.f95a0412-06a0-49e2-8e3f-e056b6627ee0 Nov 03 07:41:10 devstack sudo[100692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:11 devstack sudo[100689]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [req-4bae9369-e78d-4b76-93f1-b73c1956553b req-3b8f9641-967a-4755-b874-901c1d915621 tempest-TestShelveInstance-2081252662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-442c9ef6-b786-4e22-b5e3-e222b7b63413" returned: 0 in 0.429s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:11 devstack cinder-volume[86875]: DEBUG cinder.coordination [req-4bae9369-e78d-4b76-93f1-b73c1956553b req-3b8f9641-967a-4755-b874-901c1d915621 tempest-TestShelveInstance-2081252662 None] Lock "cinder-quobyte-442c9ef6-b786-4e22-b5e3-e222b7b63413" released by "delete_volume" :: held 1.239s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:11 devstack cinder-volume[86875]: DEBUG cinder.quota [req-4bae9369-e78d-4b76-93f1-b73c1956553b req-3b8f9641-967a-4755-b874-901c1d915621 tempest-TestShelveInstance-2081252662 None] Created reservations ['fd8a1a30-7396-4eef-b822-347109eeeb3e', '5683e032-a6a8-45b7-b5e7-280be6c170e0', '78257814-93e4-457f-8f9d-9b1fb710e1c1', '6a81a5da-9e37-4e6f-aa9f-b93ed8ee16d1'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:41:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-4bae9369-e78d-4b76-93f1-b73c1956553b req-3b8f9641-967a-4755-b874-901c1d915621 tempest-TestShelveInstance-2081252662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-4bae9369-e78d-4b76-93f1-b73c1956553b req-3b8f9641-967a-4755-b874-901c1d915621 tempest-TestShelveInstance-2081252662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:11 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [req-4bae9369-e78d-4b76-93f1-b73c1956553b req-3b8f9641-967a-4755-b874-901c1d915621 tempest-TestShelveInstance-2081252662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:11 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [req-4bae9369-e78d-4b76-93f1-b73c1956553b req-3b8f9641-967a-4755-b874-901c1d915621 tempest-TestShelveInstance-2081252662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-4bae9369-e78d-4b76-93f1-b73c1956553b req-3b8f9641-967a-4755-b874-901c1d915621 tempest-TestShelveInstance-2081252662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [req-4bae9369-e78d-4b76-93f1-b73c1956553b req-3b8f9641-967a-4755-b874-901c1d915621 tempest-TestShelveInstance-2081252662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:11 devstack sudo[100692]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8c3c4c02-971a-4146-9894-3f5e70d0ec3a tempest-GroupSnapshotsTest-2057469718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f5bad02-8bcf-42d0-80ca-b69637cc4ae6 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f5bad02-8bcf-42d0-80ca-b69637cc4ae6.f95a0412-06a0-49e2-8e3f-e056b6627ee0" returned: 0 in 0.537s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:11 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-8c3c4c02-971a-4146-9894-3f5e70d0ec3a tempest-GroupSnapshotsTest-2057469718 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f5bad02-8bcf-42d0-80ca-b69637cc4ae6.f95a0412-06a0-49e2-8e3f-e056b6627ee0 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 07:41:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8c3c4c02-971a-4146-9894-3f5e70d0ec3a tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f5bad02-8bcf-42d0-80ca-b69637cc4ae6.f95a0412-06a0-49e2-8e3f-e056b6627ee0 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:11 devstack sudo[100698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:41:11 devstack sudo[100698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:11 devstack sudo[100700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f5bad02-8bcf-42d0-80ca-b69637cc4ae6.f95a0412-06a0-49e2-8e3f-e056b6627ee0 Nov 03 07:41:11 devstack sudo[100700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:11 devstack sudo[100698]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [req-4bae9369-e78d-4b76-93f1-b73c1956553b req-3b8f9641-967a-4755-b874-901c1d915621 tempest-TestShelveInstance-2081252662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.426s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:11 devstack cinder-volume[86875]: DEBUG cinder.manager [req-4bae9369-e78d-4b76-93f1-b73c1956553b req-3b8f9641-967a-4755-b874-901c1d915621 tempest-TestShelveInstance-2081252662 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:41:11 devstack cinder-volume[86875]: INFO cinder.volume.manager [req-4bae9369-e78d-4b76-93f1-b73c1956553b req-3b8f9641-967a-4755-b874-901c1d915621 tempest-TestShelveInstance-2081252662 None] Deleted volume successfully. Nov 03 07:41:11 devstack cinder-volume[86875]: DEBUG cinder.coordination [req-4bae9369-e78d-4b76-93f1-b73c1956553b req-3b8f9641-967a-4755-b874-901c1d915621 tempest-TestShelveInstance-2081252662 None] Lock "cinder-442c9ef6-b786-4e22-b5e3-e222b7b63413-delete_volume" released by "delete_volume" :: held 2.085s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:11 devstack sudo[100700]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8c3c4c02-971a-4146-9894-3f5e70d0ec3a tempest-GroupSnapshotsTest-2057469718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f5bad02-8bcf-42d0-80ca-b69637cc4ae6.f95a0412-06a0-49e2-8e3f-e056b6627ee0" returned: 0 in 0.485s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8c3c4c02-971a-4146-9894-3f5e70d0ec3a tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f5bad02-8bcf-42d0-80ca-b69637cc4ae6.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:12 devstack sudo[100704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f5bad02-8bcf-42d0-80ca-b69637cc4ae6.info Nov 03 07:41:12 devstack sudo[100704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:12 devstack sudo[100704]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:12 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8c3c4c02-971a-4146-9894-3f5e70d0ec3a tempest-GroupSnapshotsTest-2057469718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f5bad02-8bcf-42d0-80ca-b69637cc4ae6.info" returned: 0 in 0.416s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:12 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-8c3c4c02-971a-4146-9894-3f5e70d0ec3a tempest-GroupSnapshotsTest-2057469718 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f5bad02-8bcf-42d0-80ca-b69637cc4ae6.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 07:41:12 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8c3c4c02-971a-4146-9894-3f5e70d0ec3a tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f5bad02-8bcf-42d0-80ca-b69637cc4ae6.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:12 devstack sudo[100707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f5bad02-8bcf-42d0-80ca-b69637cc4ae6.info Nov 03 07:41:12 devstack sudo[100707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:12 devstack sudo[100707]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:12 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8c3c4c02-971a-4146-9894-3f5e70d0ec3a tempest-GroupSnapshotsTest-2057469718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f5bad02-8bcf-42d0-80ca-b69637cc4ae6.info" returned: 0 in 0.378s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:12 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-8c3c4c02-971a-4146-9894-3f5e70d0ec3a tempest-GroupSnapshotsTest-2057469718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.270s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:12 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-8c3c4c02-971a-4146-9894-3f5e70d0ec3a tempest-GroupSnapshotsTest-2057469718 None] group_snapshot 8cb21f2b-9e02-425c-a0c6-82e97507bb42: created successfully Nov 03 07:41:14 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-7098803d-7425-4f6a-845f-2684043a0723 tempest-GroupSnapshotsTest-2057469718 None] group_snapshot 8cb21f2b-9e02-425c-a0c6-82e97507bb42: deleting Nov 03 07:41:14 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7098803d-7425-4f6a-845f-2684043a0723 tempest-GroupSnapshotsTest-2057469718 None] group_snapshot 8cb21f2b-9e02-425c-a0c6-82e97507bb42: deleting {{(pid=86875) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 03 07:41:14 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-7098803d-7425-4f6a-845f-2684043a0723 tempest-GroupSnapshotsTest-2057469718 None] Acquiring lock "cinder-quobyte-1ed9f564-34be-4940-a9db-4a0700c356b0" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:14 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-7098803d-7425-4f6a-845f-2684043a0723 tempest-GroupSnapshotsTest-2057469718 None] Lock "cinder-quobyte-1ed9f564-34be-4940-a9db-4a0700c356b0" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:14 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-7098803d-7425-4f6a-845f-2684043a0723 tempest-GroupSnapshotsTest-2057469718 None] Acquiring lock "cinder-quobyte-646019c5-928e-413a-bfb7-adf858fec7a2" by "_delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:14 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-7098803d-7425-4f6a-845f-2684043a0723 tempest-GroupSnapshotsTest-2057469718 None] Lock "cinder-quobyte-646019c5-928e-413a-bfb7-adf858fec7a2" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:14 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-7098803d-7425-4f6a-845f-2684043a0723 tempest-GroupSnapshotsTest-2057469718 None] Deleting offline snapshot 646019c5-928e-413a-bfb7-adf858fec7a2 of volume 1ed9f564-34be-4940-a9db-4a0700c356b0 {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:41:14 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-7098803d-7425-4f6a-845f-2684043a0723 tempest-GroupSnapshotsTest-2057469718 None] snapshot_file for this snap is: volume-1ed9f564-34be-4940-a9db-4a0700c356b0.646019c5-928e-413a-bfb7-adf858fec7a2 {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:41:14 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5103dbe-967d-449c-89a8-5570c1a10705]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:14 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7098803d-7425-4f6a-845f-2684043a0723 tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1ed9f564-34be-4940-a9db-4a0700c356b0.646019c5-928e-413a-bfb7-adf858fec7a2 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:14 devstack sudo[100712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1ed9f564-34be-4940-a9db-4a0700c356b0.646019c5-928e-413a-bfb7-adf858fec7a2 Nov 03 07:41:14 devstack sudo[100712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:14 devstack sudo[100712]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:14 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7098803d-7425-4f6a-845f-2684043a0723 tempest-GroupSnapshotsTest-2057469718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1ed9f564-34be-4940-a9db-4a0700c356b0.646019c5-928e-413a-bfb7-adf858fec7a2" returned: 0 in 0.515s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:14 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-7098803d-7425-4f6a-845f-2684043a0723 tempest-GroupSnapshotsTest-2057469718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ed9f564-34be-4940-a9db-4a0700c356b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:41:14 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbccc5e7-023c-46a8-b8bc-314697319cc7]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:14 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7098803d-7425-4f6a-845f-2684043a0723 tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1ed9f564-34be-4940-a9db-4a0700c356b0 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:14 devstack sudo[100718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1ed9f564-34be-4940-a9db-4a0700c356b0 Nov 03 07:41:14 devstack sudo[100718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:15 devstack sudo[100718]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7098803d-7425-4f6a-845f-2684043a0723 tempest-GroupSnapshotsTest-2057469718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1ed9f564-34be-4940-a9db-4a0700c356b0" returned: 0 in 0.475s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7098803d-7425-4f6a-845f-2684043a0723 tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1ed9f564-34be-4940-a9db-4a0700c356b0.646019c5-928e-413a-bfb7-adf858fec7a2 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:15 devstack sudo[100724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1ed9f564-34be-4940-a9db-4a0700c356b0.646019c5-928e-413a-bfb7-adf858fec7a2 Nov 03 07:41:15 devstack sudo[100724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:15 devstack sudo[100724]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7098803d-7425-4f6a-845f-2684043a0723 tempest-GroupSnapshotsTest-2057469718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1ed9f564-34be-4940-a9db-4a0700c356b0.646019c5-928e-413a-bfb7-adf858fec7a2" returned: 0 in 0.538s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7098803d-7425-4f6a-845f-2684043a0723 tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1ed9f564-34be-4940-a9db-4a0700c356b0.646019c5-928e-413a-bfb7-adf858fec7a2 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:15 devstack sudo[100730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1ed9f564-34be-4940-a9db-4a0700c356b0.646019c5-928e-413a-bfb7-adf858fec7a2 Nov 03 07:41:15 devstack sudo[100730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:16 devstack sudo[100730]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7098803d-7425-4f6a-845f-2684043a0723 tempest-GroupSnapshotsTest-2057469718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1ed9f564-34be-4940-a9db-4a0700c356b0.646019c5-928e-413a-bfb7-adf858fec7a2" returned: 0 in 0.310s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:16 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-7098803d-7425-4f6a-845f-2684043a0723 tempest-GroupSnapshotsTest-2057469718 None] Lock "cinder-quobyte-646019c5-928e-413a-bfb7-adf858fec7a2" released by "_delete_snapshot" :: held 2.036s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:16 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-7098803d-7425-4f6a-845f-2684043a0723 tempest-GroupSnapshotsTest-2057469718 None] Lock "cinder-quobyte-1ed9f564-34be-4940-a9db-4a0700c356b0" released by "delete_snapshot" :: held 2.066s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:16 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-7098803d-7425-4f6a-845f-2684043a0723 tempest-GroupSnapshotsTest-2057469718 None] Acquiring lock "cinder-quobyte-9f5bad02-8bcf-42d0-80ca-b69637cc4ae6" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:16 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-7098803d-7425-4f6a-845f-2684043a0723 tempest-GroupSnapshotsTest-2057469718 None] Lock "cinder-quobyte-9f5bad02-8bcf-42d0-80ca-b69637cc4ae6" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:16 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-7098803d-7425-4f6a-845f-2684043a0723 tempest-GroupSnapshotsTest-2057469718 None] Acquiring lock "cinder-quobyte-f95a0412-06a0-49e2-8e3f-e056b6627ee0" by "_delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:16 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-7098803d-7425-4f6a-845f-2684043a0723 tempest-GroupSnapshotsTest-2057469718 None] Lock "cinder-quobyte-f95a0412-06a0-49e2-8e3f-e056b6627ee0" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:16 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-7098803d-7425-4f6a-845f-2684043a0723 tempest-GroupSnapshotsTest-2057469718 None] Deleting offline snapshot f95a0412-06a0-49e2-8e3f-e056b6627ee0 of volume 9f5bad02-8bcf-42d0-80ca-b69637cc4ae6 {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:41:16 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-7098803d-7425-4f6a-845f-2684043a0723 tempest-GroupSnapshotsTest-2057469718 None] snapshot_file for this snap is: volume-9f5bad02-8bcf-42d0-80ca-b69637cc4ae6.f95a0412-06a0-49e2-8e3f-e056b6627ee0 {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:41:16 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c076942-890e-42c8-b9bf-d34293f3948b]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7098803d-7425-4f6a-845f-2684043a0723 tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f5bad02-8bcf-42d0-80ca-b69637cc4ae6.f95a0412-06a0-49e2-8e3f-e056b6627ee0 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:16 devstack sudo[100733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f5bad02-8bcf-42d0-80ca-b69637cc4ae6.f95a0412-06a0-49e2-8e3f-e056b6627ee0 Nov 03 07:41:16 devstack sudo[100733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:16 devstack sudo[100733]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7098803d-7425-4f6a-845f-2684043a0723 tempest-GroupSnapshotsTest-2057469718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f5bad02-8bcf-42d0-80ca-b69637cc4ae6.f95a0412-06a0-49e2-8e3f-e056b6627ee0" returned: 0 in 0.530s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:16 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-7098803d-7425-4f6a-845f-2684043a0723 tempest-GroupSnapshotsTest-2057469718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f5bad02-8bcf-42d0-80ca-b69637cc4ae6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:41:16 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[df638a9e-f602-4833-b490-955bff7153da]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7098803d-7425-4f6a-845f-2684043a0723 tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f5bad02-8bcf-42d0-80ca-b69637cc4ae6 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:17 devstack sudo[100745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f5bad02-8bcf-42d0-80ca-b69637cc4ae6 Nov 03 07:41:17 devstack sudo[100745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:17 devstack sudo[100745]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7098803d-7425-4f6a-845f-2684043a0723 tempest-GroupSnapshotsTest-2057469718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f5bad02-8bcf-42d0-80ca-b69637cc4ae6" returned: 0 in 0.466s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7098803d-7425-4f6a-845f-2684043a0723 tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f5bad02-8bcf-42d0-80ca-b69637cc4ae6.f95a0412-06a0-49e2-8e3f-e056b6627ee0 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:17 devstack sudo[100750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f5bad02-8bcf-42d0-80ca-b69637cc4ae6.f95a0412-06a0-49e2-8e3f-e056b6627ee0 Nov 03 07:41:17 devstack sudo[100750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:18 devstack sudo[100750]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:18 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7098803d-7425-4f6a-845f-2684043a0723 tempest-GroupSnapshotsTest-2057469718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f5bad02-8bcf-42d0-80ca-b69637cc4ae6.f95a0412-06a0-49e2-8e3f-e056b6627ee0" returned: 0 in 0.562s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:18 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7098803d-7425-4f6a-845f-2684043a0723 tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f5bad02-8bcf-42d0-80ca-b69637cc4ae6.f95a0412-06a0-49e2-8e3f-e056b6627ee0 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:18 devstack sudo[100756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f5bad02-8bcf-42d0-80ca-b69637cc4ae6.f95a0412-06a0-49e2-8e3f-e056b6627ee0 Nov 03 07:41:18 devstack sudo[100756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:18 devstack sudo[100756]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:18 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7098803d-7425-4f6a-845f-2684043a0723 tempest-GroupSnapshotsTest-2057469718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f5bad02-8bcf-42d0-80ca-b69637cc4ae6.f95a0412-06a0-49e2-8e3f-e056b6627ee0" returned: 0 in 0.354s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:18 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-7098803d-7425-4f6a-845f-2684043a0723 tempest-GroupSnapshotsTest-2057469718 None] Lock "cinder-quobyte-f95a0412-06a0-49e2-8e3f-e056b6627ee0" released by "_delete_snapshot" :: held 2.137s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:18 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-7098803d-7425-4f6a-845f-2684043a0723 tempest-GroupSnapshotsTest-2057469718 None] Lock "cinder-quobyte-9f5bad02-8bcf-42d0-80ca-b69637cc4ae6" released by "delete_snapshot" :: held 2.180s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:18 devstack cinder-volume[86875]: WARNING cinder.quota [None req-7098803d-7425-4f6a-845f-2684043a0723 tempest-GroupSnapshotsTest-2057469718 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2110474391 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2110474391, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:41:18 devstack cinder-volume[86875]: WARNING cinder.quota [None req-7098803d-7425-4f6a-845f-2684043a0723 tempest-GroupSnapshotsTest-2057469718 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2110474391 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2110474391, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:41:18 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-7098803d-7425-4f6a-845f-2684043a0723 tempest-GroupSnapshotsTest-2057469718 None] Created reservations ['893dbe91-a8d6-4c8d-b6f5-c22e7775e313', 'c7fe70f0-94dd-4d3b-a7ca-d7642f2e8434', 'aa839cb3-d34b-4354-964c-81df956c2c7e', '1120a35c-3311-448b-87f3-f93264209ab4'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:41:18 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-7098803d-7425-4f6a-845f-2684043a0723 tempest-GroupSnapshotsTest-2057469718 None] Created reservations ['e84334cf-67cd-4fba-9003-94bef0c9cb59', 'd2836e22-6322-488a-b5e4-2f75ecaca57a', '721b7c07-9bf0-4e7e-91a8-11513af9b590', 'fb7b8088-f0ad-4b31-b678-852a4062712a'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:41:18 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-7098803d-7425-4f6a-845f-2684043a0723 tempest-GroupSnapshotsTest-2057469718 None] group_snapshot 8cb21f2b-9e02-425c-a0c6-82e97507bb42: deleted successfully Nov 03 07:41:20 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bda0b78-47af-41be-bd15-cd723892c8aa tempest-VolumesTransfersV355Test-1860743629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:41:20 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3bda0b78-47af-41be-bd15-cd723892c8aa tempest-VolumesTransfersV355Test-1860743629 None] Flow 'volume_create_manager' (c758bb06-28dc-4c6b-bea4-4af97a43f05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:20 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3bda0b78-47af-41be-bd15-cd723892c8aa tempest-VolumesTransfersV355Test-1860743629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4b88eb3-5d5b-4974-9e74-f27b289aa7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:20 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3bda0b78-47af-41be-bd15-cd723892c8aa tempest-VolumesTransfersV355Test-1860743629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4b88eb3-5d5b-4974-9e74-f27b289aa7f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1660026772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb005148-da00-4bdd-9035-41751cb3e5a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4b7fd9773f54cc88a1ad8c0787e956f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:20Z,use_quota=True,user_id='66f0feb4f4014c6ca4dcb12ec395bf0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:20 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3bda0b78-47af-41be-bd15-cd723892c8aa tempest-VolumesTransfersV355Test-1860743629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bffd0fc1-9f6b-4f2e-a418-56495e5f6575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:20 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3bda0b78-47af-41be-bd15-cd723892c8aa tempest-VolumesTransfersV355Test-1860743629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bffd0fc1-9f6b-4f2e-a418-56495e5f6575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:20 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3bda0b78-47af-41be-bd15-cd723892c8aa tempest-VolumesTransfersV355Test-1860743629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b12db41d-d115-4113-8a6e-69b722f1ad5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:20 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3bda0b78-47af-41be-bd15-cd723892c8aa tempest-VolumesTransfersV355Test-1860743629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b12db41d-d115-4113-8a6e-69b722f1ad5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb005148-da00-4bdd-9035-41751cb3e5a5', 'volume_name': 'volume-eb005148-da00-4bdd-9035-41751cb3e5a5', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:20 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3bda0b78-47af-41be-bd15-cd723892c8aa tempest-VolumesTransfersV355Test-1860743629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aab8cef9-8a34-4fdc-8894-b3810fcce4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:20 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3bda0b78-47af-41be-bd15-cd723892c8aa tempest-VolumesTransfersV355Test-1860743629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aab8cef9-8a34-4fdc-8894-b3810fcce4d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:20 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3bda0b78-47af-41be-bd15-cd723892c8aa tempest-VolumesTransfersV355Test-1860743629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10d3c8bb-430b-4276-8a0e-a6f493eb08e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:20 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-3bda0b78-47af-41be-bd15-cd723892c8aa tempest-VolumesTransfersV355Test-1860743629 None] Volume eb005148-da00-4bdd-9035-41751cb3e5a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb005148-da00-4bdd-9035-41751cb3e5a5', 'volume_size': 1} Nov 03 07:41:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3bda0b78-47af-41be-bd15-cd723892c8aa tempest-VolumesTransfersV355Test-1860743629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3bda0b78-47af-41be-bd15-cd723892c8aa tempest-VolumesTransfersV355Test-1860743629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:20 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-3bda0b78-47af-41be-bd15-cd723892c8aa tempest-VolumesTransfersV355Test-1860743629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1660026772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb005148-da00-4bdd-9035-41751cb3e5a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4b7fd9773f54cc88a1ad8c0787e956f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:20Z,use_quota=True,user_id='66f0feb4f4014c6ca4dcb12ec395bf0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:41:20 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-3bda0b78-47af-41be-bd15-cd723892c8aa tempest-VolumesTransfersV355Test-1860743629 None] Creating volume eb005148-da00-4bdd-9035-41751cb3e5a5 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:41:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3bda0b78-47af-41be-bd15-cd723892c8aa tempest-VolumesTransfersV355Test-1860743629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3bda0b78-47af-41be-bd15-cd723892c8aa tempest-VolumesTransfersV355Test-1860743629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:20 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-3bda0b78-47af-41be-bd15-cd723892c8aa tempest-VolumesTransfersV355Test-1860743629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:20 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-3bda0b78-47af-41be-bd15-cd723892c8aa tempest-VolumesTransfersV355Test-1860743629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3bda0b78-47af-41be-bd15-cd723892c8aa tempest-VolumesTransfersV355Test-1860743629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:20 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-3bda0b78-47af-41be-bd15-cd723892c8aa tempest-VolumesTransfersV355Test-1860743629 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:41:20 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-3bda0b78-47af-41be-bd15-cd723892c8aa tempest-VolumesTransfersV355Test-1860743629 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:41:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3bda0b78-47af-41be-bd15-cd723892c8aa tempest-VolumesTransfersV355Test-1860743629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-eb005148-da00-4bdd-9035-41751cb3e5a5 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:20 devstack sudo[100761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-eb005148-da00-4bdd-9035-41751cb3e5a5 1073741824 Nov 03 07:41:20 devstack sudo[100761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:20 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-8a30e28b-b6b8-45ca-b2c1-46723dc38894 tempest-GroupSnapshotsTest-2057469718 None] Acquiring lock "cinder-quobyte-1ed9f564-34be-4940-a9db-4a0700c356b0" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:20 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-8a30e28b-b6b8-45ca-b2c1-46723dc38894 tempest-GroupSnapshotsTest-2057469718 None] Lock "cinder-quobyte-1ed9f564-34be-4940-a9db-4a0700c356b0" acquired by "delete_volume" :: waited 0.028s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:20 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31198ce-69bb-4bf4-94fa-9a820f6d2500]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8a30e28b-b6b8-45ca-b2c1-46723dc38894 tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1ed9f564-34be-4940-a9db-4a0700c356b0 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:20 devstack sudo[100763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1ed9f564-34be-4940-a9db-4a0700c356b0 Nov 03 07:41:20 devstack sudo[100763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:21 devstack sudo[100761]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3bda0b78-47af-41be-bd15-cd723892c8aa tempest-VolumesTransfersV355Test-1860743629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-eb005148-da00-4bdd-9035-41751cb3e5a5 1073741824" returned: 0 in 0.738s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:21 devstack sudo[100763]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8a30e28b-b6b8-45ca-b2c1-46723dc38894 tempest-GroupSnapshotsTest-2057469718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1ed9f564-34be-4940-a9db-4a0700c356b0" returned: 0 in 0.531s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8a30e28b-b6b8-45ca-b2c1-46723dc38894 tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1ed9f564-34be-4940-a9db-4a0700c356b0 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:21 devstack sudo[100772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1ed9f564-34be-4940-a9db-4a0700c356b0 Nov 03 07:41:21 devstack sudo[100772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3bda0b78-47af-41be-bd15-cd723892c8aa tempest-VolumesTransfersV355Test-1860743629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-eb005148-da00-4bdd-9035-41751cb3e5a5 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:21 devstack sudo[100774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-eb005148-da00-4bdd-9035-41751cb3e5a5 Nov 03 07:41:21 devstack sudo[100774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:21 devstack sudo[100772]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8a30e28b-b6b8-45ca-b2c1-46723dc38894 tempest-GroupSnapshotsTest-2057469718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-1ed9f564-34be-4940-a9db-4a0700c356b0" returned: 0 in 0.349s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:21 devstack sudo[100774]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3bda0b78-47af-41be-bd15-cd723892c8aa tempest-VolumesTransfersV355Test-1860743629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-eb005148-da00-4bdd-9035-41751cb3e5a5" returned: 0 in 0.325s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:21 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-3bda0b78-47af-41be-bd15-cd723892c8aa tempest-VolumesTransfersV355Test-1860743629 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:41:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3bda0b78-47af-41be-bd15-cd723892c8aa tempest-VolumesTransfersV355Test-1860743629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:21 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-8a30e28b-b6b8-45ca-b2c1-46723dc38894 tempest-GroupSnapshotsTest-2057469718 None] Lock "cinder-quobyte-1ed9f564-34be-4940-a9db-4a0700c356b0" released by "delete_volume" :: held 0.997s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:21 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-8a30e28b-b6b8-45ca-b2c1-46723dc38894 tempest-GroupSnapshotsTest-2057469718 None] Acquiring lock "cinder-quobyte-9f5bad02-8bcf-42d0-80ca-b69637cc4ae6" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:21 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3bda0b78-47af-41be-bd15-cd723892c8aa tempest-VolumesTransfersV355Test-1860743629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10d3c8bb-430b-4276-8a0e-a6f493eb08e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb005148-da00-4bdd-9035-41751cb3e5a5', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:21 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3bda0b78-47af-41be-bd15-cd723892c8aa tempest-VolumesTransfersV355Test-1860743629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (549cdb83-93d4-403e-b8e7-35a5cdccdf17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:21 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-8a30e28b-b6b8-45ca-b2c1-46723dc38894 tempest-GroupSnapshotsTest-2057469718 None] Lock "cinder-quobyte-9f5bad02-8bcf-42d0-80ca-b69637cc4ae6" acquired by "delete_volume" :: waited 0.034s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:21 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[f940bf5f-e5d0-49e9-b4fe-31a0816936d5]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8a30e28b-b6b8-45ca-b2c1-46723dc38894 tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f5bad02-8bcf-42d0-80ca-b69637cc4ae6 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:21 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-3bda0b78-47af-41be-bd15-cd723892c8aa tempest-VolumesTransfersV355Test-1860743629 None] Volume volume-eb005148-da00-4bdd-9035-41751cb3e5a5 (eb005148-da00-4bdd-9035-41751cb3e5a5): created successfully Nov 03 07:41:21 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3bda0b78-47af-41be-bd15-cd723892c8aa tempest-VolumesTransfersV355Test-1860743629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (549cdb83-93d4-403e-b8e7-35a5cdccdf17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:21 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3bda0b78-47af-41be-bd15-cd723892c8aa tempest-VolumesTransfersV355Test-1860743629 None] Flow 'volume_create_manager' (c758bb06-28dc-4c6b-bea4-4af97a43f05c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:21 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-3bda0b78-47af-41be-bd15-cd723892c8aa tempest-VolumesTransfersV355Test-1860743629 None] Created volume successfully. Nov 03 07:41:21 devstack sudo[100778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f5bad02-8bcf-42d0-80ca-b69637cc4ae6 Nov 03 07:41:21 devstack sudo[100778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:22 devstack sudo[100778]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8a30e28b-b6b8-45ca-b2c1-46723dc38894 tempest-GroupSnapshotsTest-2057469718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f5bad02-8bcf-42d0-80ca-b69637cc4ae6" returned: 0 in 0.602s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8a30e28b-b6b8-45ca-b2c1-46723dc38894 tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f5bad02-8bcf-42d0-80ca-b69637cc4ae6 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:22 devstack sudo[100795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f5bad02-8bcf-42d0-80ca-b69637cc4ae6 Nov 03 07:41:22 devstack sudo[100795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:22 devstack sudo[100795]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8a30e28b-b6b8-45ca-b2c1-46723dc38894 tempest-GroupSnapshotsTest-2057469718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f5bad02-8bcf-42d0-80ca-b69637cc4ae6" returned: 0 in 0.399s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:22 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-8a30e28b-b6b8-45ca-b2c1-46723dc38894 tempest-GroupSnapshotsTest-2057469718 None] Lock "cinder-quobyte-9f5bad02-8bcf-42d0-80ca-b69637cc4ae6" released by "delete_volume" :: held 1.153s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:22 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-8a30e28b-b6b8-45ca-b2c1-46723dc38894 tempest-GroupSnapshotsTest-2057469718 None] Created reservations ['a6c89271-843d-4ced-a404-bb00dcf2b051'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:41:22 devstack cinder-volume[86875]: WARNING cinder.quota [None req-8a30e28b-b6b8-45ca-b2c1-46723dc38894 tempest-GroupSnapshotsTest-2057469718 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2110474391 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2110474391, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:41:22 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-8a30e28b-b6b8-45ca-b2c1-46723dc38894 tempest-GroupSnapshotsTest-2057469718 None] Created reservations ['ee8ae247-1e8c-4e55-b928-e10163056c7d', 'c0c63109-c55f-4417-942c-3d1f44d27953', 'cdf6be36-23d5-4fc1-a3e9-516a098fc2dd', 'ec22d689-031f-4170-a0fe-809fa852b992'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:41:23 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-8a30e28b-b6b8-45ca-b2c1-46723dc38894 tempest-GroupSnapshotsTest-2057469718 None] Created reservations ['7d44ad87-b584-4a52-8f0c-8bce0e66cb72', '51b8cb0d-d02a-41c4-aa4d-4b4e7bde2eab', '65b49860-12c1-466e-8e82-988f2afa7251', '43e3a296-50dc-45b3-b997-b59687f04683'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:41:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-8a30e28b-b6b8-45ca-b2c1-46723dc38894 tempest-GroupSnapshotsTest-2057469718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-8a30e28b-b6b8-45ca-b2c1-46723dc38894 tempest-GroupSnapshotsTest-2057469718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:23 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-8a30e28b-b6b8-45ca-b2c1-46723dc38894 tempest-GroupSnapshotsTest-2057469718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:23 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-8a30e28b-b6b8-45ca-b2c1-46723dc38894 tempest-GroupSnapshotsTest-2057469718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-8a30e28b-b6b8-45ca-b2c1-46723dc38894 tempest-GroupSnapshotsTest-2057469718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8a30e28b-b6b8-45ca-b2c1-46723dc38894 tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:23 devstack sudo[100822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:41:23 devstack sudo[100822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:23 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-52a163d4-9345-452a-8e53-b12d64fa8cd3 tempest-VolumesTransfersV355Test-706811824 None] Transfer volume completed successfully. Nov 03 07:41:23 devstack sudo[100822]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8a30e28b-b6b8-45ca-b2c1-46723dc38894 tempest-GroupSnapshotsTest-2057469718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.317s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:23 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-8a30e28b-b6b8-45ca-b2c1-46723dc38894 tempest-GroupSnapshotsTest-2057469718 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:41:23 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-8a30e28b-b6b8-45ca-b2c1-46723dc38894 tempest-GroupSnapshotsTest-2057469718 None] Delete group completed successfully. Nov 03 07:41:24 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-f96b36c7-92a5-42cd-9096-1b5ac11ae527 tempest-VolumesTransfersV355Test-749376277 None] Acquiring lock "cinder-eb005148-da00-4bdd-9035-41751cb3e5a5-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:24 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-f96b36c7-92a5-42cd-9096-1b5ac11ae527 tempest-VolumesTransfersV355Test-749376277 None] Lock "cinder-eb005148-da00-4bdd-9035-41751cb3e5a5-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:24 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-f96b36c7-92a5-42cd-9096-1b5ac11ae527 tempest-VolumesTransfersV355Test-749376277 None] Acquiring lock "cinder-quobyte-eb005148-da00-4bdd-9035-41751cb3e5a5" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:24 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-f96b36c7-92a5-42cd-9096-1b5ac11ae527 tempest-VolumesTransfersV355Test-749376277 None] Lock "cinder-quobyte-eb005148-da00-4bdd-9035-41751cb3e5a5" acquired by "delete_volume" :: waited 0.024s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:24 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f4708c-67dd-433f-8b69-0dddb2e14b36]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f96b36c7-92a5-42cd-9096-1b5ac11ae527 tempest-VolumesTransfersV355Test-749376277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-eb005148-da00-4bdd-9035-41751cb3e5a5 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:24 devstack sudo[100825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-eb005148-da00-4bdd-9035-41751cb3e5a5 Nov 03 07:41:24 devstack sudo[100825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:24 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-c22e65ee-3870-4a0a-87f2-70ed0c7a45c9 tempest-GroupSnapshotsTest-2057469718 None] Group tempest-GroupSnapshotsTest-Group-1796155931: creating Nov 03 07:41:25 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-c22e65ee-3870-4a0a-87f2-70ed0c7a45c9 tempest-GroupSnapshotsTest-2057469718 None] Group tempest-GroupSnapshotsTest-Group-1796155931: created successfully Nov 03 07:41:25 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-c22e65ee-3870-4a0a-87f2-70ed0c7a45c9 tempest-GroupSnapshotsTest-2057469718 None] Create group completed successfully. Nov 03 07:41:25 devstack sudo[100825]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f96b36c7-92a5-42cd-9096-1b5ac11ae527 tempest-VolumesTransfersV355Test-749376277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-eb005148-da00-4bdd-9035-41751cb3e5a5" returned: 0 in 0.515s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f96b36c7-92a5-42cd-9096-1b5ac11ae527 tempest-VolumesTransfersV355Test-749376277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-eb005148-da00-4bdd-9035-41751cb3e5a5 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:25 devstack sudo[100831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-eb005148-da00-4bdd-9035-41751cb3e5a5 Nov 03 07:41:25 devstack sudo[100831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:25 devstack sudo[100831]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f96b36c7-92a5-42cd-9096-1b5ac11ae527 tempest-VolumesTransfersV355Test-749376277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-eb005148-da00-4bdd-9035-41751cb3e5a5" returned: 0 in 0.327s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:25 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-f96b36c7-92a5-42cd-9096-1b5ac11ae527 tempest-VolumesTransfersV355Test-749376277 None] Lock "cinder-quobyte-eb005148-da00-4bdd-9035-41751cb3e5a5" released by "delete_volume" :: held 0.930s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:25 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-f96b36c7-92a5-42cd-9096-1b5ac11ae527 tempest-VolumesTransfersV355Test-749376277 None] Created reservations ['7b58f05b-4730-41ae-acf3-555643c3f9ab', '56375750-2834-4e3e-8ba5-023c171a91be', 'c617bfc3-626f-42e5-a7e0-db05747018ec', '88c22623-278f-4758-9a81-a2fb1c9e0c75'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:41:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-f96b36c7-92a5-42cd-9096-1b5ac11ae527 tempest-VolumesTransfersV355Test-749376277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-f96b36c7-92a5-42cd-9096-1b5ac11ae527 tempest-VolumesTransfersV355Test-749376277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:25 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-f96b36c7-92a5-42cd-9096-1b5ac11ae527 tempest-VolumesTransfersV355Test-749376277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:25 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-f96b36c7-92a5-42cd-9096-1b5ac11ae527 tempest-VolumesTransfersV355Test-749376277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-f96b36c7-92a5-42cd-9096-1b5ac11ae527 tempest-VolumesTransfersV355Test-749376277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f96b36c7-92a5-42cd-9096-1b5ac11ae527 tempest-VolumesTransfersV355Test-749376277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:25 devstack sudo[100834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:41:25 devstack sudo[100834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:26 devstack sudo[100834]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:26 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f96b36c7-92a5-42cd-9096-1b5ac11ae527 tempest-VolumesTransfersV355Test-749376277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.378s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:26 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-f96b36c7-92a5-42cd-9096-1b5ac11ae527 tempest-VolumesTransfersV355Test-749376277 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:41:26 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-f96b36c7-92a5-42cd-9096-1b5ac11ae527 tempest-VolumesTransfersV355Test-749376277 None] Deleted volume successfully. Nov 03 07:41:26 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-f96b36c7-92a5-42cd-9096-1b5ac11ae527 tempest-VolumesTransfersV355Test-749376277 None] Lock "cinder-eb005148-da00-4bdd-9035-41751cb3e5a5-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:26 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-b223fc9a-218d-49cb-a1d2-51271c678198 tempest-GroupSnapshotsTest-2057469718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:41:26 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b223fc9a-218d-49cb-a1d2-51271c678198 tempest-GroupSnapshotsTest-2057469718 None] Flow 'volume_create_manager' (9b7112df-9b4d-45cb-9ddd-d482b634e8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:26 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b223fc9a-218d-49cb-a1d2-51271c678198 tempest-GroupSnapshotsTest-2057469718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cffa6a30-0a0a-4524-bf95-da6a87778710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:27 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b223fc9a-218d-49cb-a1d2-51271c678198 tempest-GroupSnapshotsTest-2057469718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cffa6a30-0a0a-4524-bf95-da6a87778710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1968569989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c4b0f739-ef35-450d-933b-146dc3054f7f,host='devstack@QuobyteHD#QuobyteHD',id=5a5a6b0a-e1a4-4677-8cdb-6233731f93ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dd42ab5a85040a9adc8ffeaf25d6eb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:27Z,use_quota=True,user_id='e3a8a7d1442949fcb5edf34738d8686a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e561a19-5b4a-4898-a29c-57813525f071),volume_type_id=3e561a19-5b4a-4898-a29c-57813525f071)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:27 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b223fc9a-218d-49cb-a1d2-51271c678198 tempest-GroupSnapshotsTest-2057469718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (119441a3-5bc3-4ffe-b136-1cf28592d26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:27 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b223fc9a-218d-49cb-a1d2-51271c678198 tempest-GroupSnapshotsTest-2057469718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (119441a3-5bc3-4ffe-b136-1cf28592d26b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:27 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b223fc9a-218d-49cb-a1d2-51271c678198 tempest-GroupSnapshotsTest-2057469718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4d2e8ef-f020-4cd5-ae20-55684472f6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:27 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b223fc9a-218d-49cb-a1d2-51271c678198 tempest-GroupSnapshotsTest-2057469718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4d2e8ef-f020-4cd5-ae20-55684472f6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a5a6b0a-e1a4-4677-8cdb-6233731f93ac', 'volume_name': 'volume-5a5a6b0a-e1a4-4677-8cdb-6233731f93ac', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:27 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b223fc9a-218d-49cb-a1d2-51271c678198 tempest-GroupSnapshotsTest-2057469718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0904a052-d20f-4eeb-be6b-ce88c91b0598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:27 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b223fc9a-218d-49cb-a1d2-51271c678198 tempest-GroupSnapshotsTest-2057469718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0904a052-d20f-4eeb-be6b-ce88c91b0598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:27 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b223fc9a-218d-49cb-a1d2-51271c678198 tempest-GroupSnapshotsTest-2057469718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (807547ba-db54-4ac9-b3e1-a1894fa7d4c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:27 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-b223fc9a-218d-49cb-a1d2-51271c678198 tempest-GroupSnapshotsTest-2057469718 None] Volume 5a5a6b0a-e1a4-4677-8cdb-6233731f93ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a5a6b0a-e1a4-4677-8cdb-6233731f93ac', 'volume_size': 1} Nov 03 07:41:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b223fc9a-218d-49cb-a1d2-51271c678198 tempest-GroupSnapshotsTest-2057469718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b223fc9a-218d-49cb-a1d2-51271c678198 tempest-GroupSnapshotsTest-2057469718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:27 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b223fc9a-218d-49cb-a1d2-51271c678198 tempest-GroupSnapshotsTest-2057469718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c4b0f739-ef35-450d-933b-146dc3054f7f,created_at=2026-11-03T06:41:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1968569989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c4b0f739-ef35-450d-933b-146dc3054f7f,host='devstack@QuobyteHD#QuobyteHD',id=5a5a6b0a-e1a4-4677-8cdb-6233731f93ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dd42ab5a85040a9adc8ffeaf25d6eb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:27Z,use_quota=True,user_id='e3a8a7d1442949fcb5edf34738d8686a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e561a19-5b4a-4898-a29c-57813525f071),volume_type_id=3e561a19-5b4a-4898-a29c-57813525f071)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:41:27 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-b223fc9a-218d-49cb-a1d2-51271c678198 tempest-GroupSnapshotsTest-2057469718 None] Creating volume 5a5a6b0a-e1a4-4677-8cdb-6233731f93ac {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:41:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b223fc9a-218d-49cb-a1d2-51271c678198 tempest-GroupSnapshotsTest-2057469718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b223fc9a-218d-49cb-a1d2-51271c678198 tempest-GroupSnapshotsTest-2057469718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:27 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b223fc9a-218d-49cb-a1d2-51271c678198 tempest-GroupSnapshotsTest-2057469718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:27 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b223fc9a-218d-49cb-a1d2-51271c678198 tempest-GroupSnapshotsTest-2057469718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b223fc9a-218d-49cb-a1d2-51271c678198 tempest-GroupSnapshotsTest-2057469718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:27 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b223fc9a-218d-49cb-a1d2-51271c678198 tempest-GroupSnapshotsTest-2057469718 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:41:27 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-b223fc9a-218d-49cb-a1d2-51271c678198 tempest-GroupSnapshotsTest-2057469718 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:41:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b223fc9a-218d-49cb-a1d2-51271c678198 tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5a5a6b0a-e1a4-4677-8cdb-6233731f93ac 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:27 devstack sudo[100837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5a5a6b0a-e1a4-4677-8cdb-6233731f93ac 1073741824 Nov 03 07:41:27 devstack sudo[100837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:27 devstack sudo[100837]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b223fc9a-218d-49cb-a1d2-51271c678198 tempest-GroupSnapshotsTest-2057469718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5a5a6b0a-e1a4-4677-8cdb-6233731f93ac 1073741824" returned: 0 in 0.641s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b223fc9a-218d-49cb-a1d2-51271c678198 tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5a5a6b0a-e1a4-4677-8cdb-6233731f93ac {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:27 devstack sudo[100844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5a5a6b0a-e1a4-4677-8cdb-6233731f93ac Nov 03 07:41:27 devstack sudo[100844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:27 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-96517b1b-29c1-46b5-8b73-ed3d96c6c0b6 tempest-VolumesTransfersV355Test-1860743629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:41:28 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-96517b1b-29c1-46b5-8b73-ed3d96c6c0b6 tempest-VolumesTransfersV355Test-1860743629 None] Flow 'volume_create_manager' (debe6c75-73e2-4126-97ff-05ec2827a791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:28 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-96517b1b-29c1-46b5-8b73-ed3d96c6c0b6 tempest-VolumesTransfersV355Test-1860743629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9c56d39-a4c0-4d39-bf73-1da6e6cda856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:28 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-96517b1b-29c1-46b5-8b73-ed3d96c6c0b6 tempest-VolumesTransfersV355Test-1860743629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9c56d39-a4c0-4d39-bf73-1da6e6cda856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-657266623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06da56f6-f855-42b7-b8df-ebfc95c4eceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4b7fd9773f54cc88a1ad8c0787e956f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:28Z,use_quota=True,user_id='66f0feb4f4014c6ca4dcb12ec395bf0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:28 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-96517b1b-29c1-46b5-8b73-ed3d96c6c0b6 tempest-VolumesTransfersV355Test-1860743629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94a150c2-a77d-4a96-9135-d8514461ffba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:28 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-96517b1b-29c1-46b5-8b73-ed3d96c6c0b6 tempest-VolumesTransfersV355Test-1860743629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94a150c2-a77d-4a96-9135-d8514461ffba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:28 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-96517b1b-29c1-46b5-8b73-ed3d96c6c0b6 tempest-VolumesTransfersV355Test-1860743629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8cec2dd-1fdc-4515-bb15-39ee908319a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:28 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-96517b1b-29c1-46b5-8b73-ed3d96c6c0b6 tempest-VolumesTransfersV355Test-1860743629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8cec2dd-1fdc-4515-bb15-39ee908319a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06da56f6-f855-42b7-b8df-ebfc95c4eceb', 'volume_name': 'volume-06da56f6-f855-42b7-b8df-ebfc95c4eceb', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:28 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-96517b1b-29c1-46b5-8b73-ed3d96c6c0b6 tempest-VolumesTransfersV355Test-1860743629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f9837fa-d31d-4ac0-ab07-74edfa3665aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:28 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-96517b1b-29c1-46b5-8b73-ed3d96c6c0b6 tempest-VolumesTransfersV355Test-1860743629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f9837fa-d31d-4ac0-ab07-74edfa3665aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:28 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-96517b1b-29c1-46b5-8b73-ed3d96c6c0b6 tempest-VolumesTransfersV355Test-1860743629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20f32ab0-386e-4283-916e-b50a2b4a0901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:28 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-96517b1b-29c1-46b5-8b73-ed3d96c6c0b6 tempest-VolumesTransfersV355Test-1860743629 None] Volume 06da56f6-f855-42b7-b8df-ebfc95c4eceb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06da56f6-f855-42b7-b8df-ebfc95c4eceb', 'volume_size': 1} Nov 03 07:41:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-96517b1b-29c1-46b5-8b73-ed3d96c6c0b6 tempest-VolumesTransfersV355Test-1860743629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:28 devstack sudo[100844]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b223fc9a-218d-49cb-a1d2-51271c678198 tempest-GroupSnapshotsTest-2057469718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5a5a6b0a-e1a4-4677-8cdb-6233731f93ac" returned: 0 in 0.425s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:28 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b223fc9a-218d-49cb-a1d2-51271c678198 tempest-GroupSnapshotsTest-2057469718 None] <== create_volume: return (1198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:41:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b223fc9a-218d-49cb-a1d2-51271c678198 tempest-GroupSnapshotsTest-2057469718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.202s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-96517b1b-29c1-46b5-8b73-ed3d96c6c0b6 tempest-VolumesTransfersV355Test-1860743629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.162s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:28 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-96517b1b-29c1-46b5-8b73-ed3d96c6c0b6 tempest-VolumesTransfersV355Test-1860743629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-657266623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06da56f6-f855-42b7-b8df-ebfc95c4eceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4b7fd9773f54cc88a1ad8c0787e956f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:28Z,use_quota=True,user_id='66f0feb4f4014c6ca4dcb12ec395bf0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:41:28 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-96517b1b-29c1-46b5-8b73-ed3d96c6c0b6 tempest-VolumesTransfersV355Test-1860743629 None] Creating volume 06da56f6-f855-42b7-b8df-ebfc95c4eceb {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:41:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-96517b1b-29c1-46b5-8b73-ed3d96c6c0b6 tempest-VolumesTransfersV355Test-1860743629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-96517b1b-29c1-46b5-8b73-ed3d96c6c0b6 tempest-VolumesTransfersV355Test-1860743629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:28 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-96517b1b-29c1-46b5-8b73-ed3d96c6c0b6 tempest-VolumesTransfersV355Test-1860743629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:28 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-96517b1b-29c1-46b5-8b73-ed3d96c6c0b6 tempest-VolumesTransfersV355Test-1860743629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-96517b1b-29c1-46b5-8b73-ed3d96c6c0b6 tempest-VolumesTransfersV355Test-1860743629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:28 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-96517b1b-29c1-46b5-8b73-ed3d96c6c0b6 tempest-VolumesTransfersV355Test-1860743629 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:41:28 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-96517b1b-29c1-46b5-8b73-ed3d96c6c0b6 tempest-VolumesTransfersV355Test-1860743629 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:41:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-96517b1b-29c1-46b5-8b73-ed3d96c6c0b6 tempest-VolumesTransfersV355Test-1860743629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-06da56f6-f855-42b7-b8df-ebfc95c4eceb 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:28 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b223fc9a-218d-49cb-a1d2-51271c678198 tempest-GroupSnapshotsTest-2057469718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (807547ba-db54-4ac9-b3e1-a1894fa7d4c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a5a6b0a-e1a4-4677-8cdb-6233731f93ac', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:28 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b223fc9a-218d-49cb-a1d2-51271c678198 tempest-GroupSnapshotsTest-2057469718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f162af28-b58d-4a56-996f-3ddbf99c4b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:28 devstack sudo[100847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-06da56f6-f855-42b7-b8df-ebfc95c4eceb 1073741824 Nov 03 07:41:28 devstack sudo[100847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:28 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-b223fc9a-218d-49cb-a1d2-51271c678198 tempest-GroupSnapshotsTest-2057469718 None] Volume volume-5a5a6b0a-e1a4-4677-8cdb-6233731f93ac (5a5a6b0a-e1a4-4677-8cdb-6233731f93ac): created successfully Nov 03 07:41:28 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b223fc9a-218d-49cb-a1d2-51271c678198 tempest-GroupSnapshotsTest-2057469718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f162af28-b58d-4a56-996f-3ddbf99c4b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:28 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b223fc9a-218d-49cb-a1d2-51271c678198 tempest-GroupSnapshotsTest-2057469718 None] Flow 'volume_create_manager' (9b7112df-9b4d-45cb-9ddd-d482b634e8b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:28 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-b223fc9a-218d-49cb-a1d2-51271c678198 tempest-GroupSnapshotsTest-2057469718 None] Created volume successfully. Nov 03 07:41:28 devstack sudo[100847]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-96517b1b-29c1-46b5-8b73-ed3d96c6c0b6 tempest-VolumesTransfersV355Test-1860743629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-06da56f6-f855-42b7-b8df-ebfc95c4eceb 1073741824" returned: 0 in 0.632s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-96517b1b-29c1-46b5-8b73-ed3d96c6c0b6 tempest-VolumesTransfersV355Test-1860743629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-06da56f6-f855-42b7-b8df-ebfc95c4eceb {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:28 devstack sudo[100853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-06da56f6-f855-42b7-b8df-ebfc95c4eceb Nov 03 07:41:28 devstack sudo[100853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:29 devstack sudo[100853]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:29 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-96517b1b-29c1-46b5-8b73-ed3d96c6c0b6 tempest-VolumesTransfersV355Test-1860743629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-06da56f6-f855-42b7-b8df-ebfc95c4eceb" returned: 0 in 0.319s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:29 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-96517b1b-29c1-46b5-8b73-ed3d96c6c0b6 tempest-VolumesTransfersV355Test-1860743629 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:41:29 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-96517b1b-29c1-46b5-8b73-ed3d96c6c0b6 tempest-VolumesTransfersV355Test-1860743629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:29 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-96517b1b-29c1-46b5-8b73-ed3d96c6c0b6 tempest-VolumesTransfersV355Test-1860743629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20f32ab0-386e-4283-916e-b50a2b4a0901) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06da56f6-f855-42b7-b8df-ebfc95c4eceb', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:29 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-96517b1b-29c1-46b5-8b73-ed3d96c6c0b6 tempest-VolumesTransfersV355Test-1860743629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3389720-c480-4973-8af8-03bc786d6d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:29 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-96517b1b-29c1-46b5-8b73-ed3d96c6c0b6 tempest-VolumesTransfersV355Test-1860743629 None] Volume volume-06da56f6-f855-42b7-b8df-ebfc95c4eceb (06da56f6-f855-42b7-b8df-ebfc95c4eceb): created successfully Nov 03 07:41:29 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-96517b1b-29c1-46b5-8b73-ed3d96c6c0b6 tempest-VolumesTransfersV355Test-1860743629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3389720-c480-4973-8af8-03bc786d6d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:29 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-96517b1b-29c1-46b5-8b73-ed3d96c6c0b6 tempest-VolumesTransfersV355Test-1860743629 None] Flow 'volume_create_manager' (debe6c75-73e2-4126-97ff-05ec2827a791) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:29 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-96517b1b-29c1-46b5-8b73-ed3d96c6c0b6 tempest-VolumesTransfersV355Test-1860743629 None] Created volume successfully. Nov 03 07:41:29 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-3ba18528-1564-4420-a827-cf681acfa606 tempest-GroupSnapshotsTest-2057469718 None] GroupSnapshot efbbbf56-bb4c-4b93-8ed2-2668e0a831db: creating. Nov 03 07:41:29 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3ba18528-1564-4420-a827-cf681acfa606 tempest-GroupSnapshotsTest-2057469718 None] Group snapshot efbbbf56-bb4c-4b93-8ed2-2668e0a831db: creating. {{(pid=86875) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 03 07:41:29 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3ba18528-1564-4420-a827-cf681acfa606 tempest-GroupSnapshotsTest-2057469718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:29 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3ba18528-1564-4420-a827-cf681acfa606 tempest-GroupSnapshotsTest-2057469718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:29 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-3ba18528-1564-4420-a827-cf681acfa606 tempest-GroupSnapshotsTest-2057469718 None] Creating offline snapshot 35c40696-3363-4049-a460-f4fb1fddc43f of volume 5a5a6b0a-e1a4-4677-8cdb-6233731f93ac {{(pid=86875) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:41:29 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aca29e0-0939-4efd-8d0a-05ca941c7b5b]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:29 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3ba18528-1564-4420-a827-cf681acfa606 tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5a5a6b0a-e1a4-4677-8cdb-6233731f93ac {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:30 devstack sudo[100856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5a5a6b0a-e1a4-4677-8cdb-6233731f93ac Nov 03 07:41:30 devstack sudo[100856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:30 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-2ef0d81d-494f-4bb2-a06a-0a65b673a09e tempest-VolumesTransfersV355Test-749376277 None] Acquiring lock "cinder-06da56f6-f855-42b7-b8df-ebfc95c4eceb-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:30 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-2ef0d81d-494f-4bb2-a06a-0a65b673a09e tempest-VolumesTransfersV355Test-749376277 None] Lock "cinder-06da56f6-f855-42b7-b8df-ebfc95c4eceb-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:30 devstack sudo[100856]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3ba18528-1564-4420-a827-cf681acfa606 tempest-GroupSnapshotsTest-2057469718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5a5a6b0a-e1a4-4677-8cdb-6233731f93ac" returned: 0 in 0.605s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3ba18528-1564-4420-a827-cf681acfa606 tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5a5a6b0a-e1a4-4677-8cdb-6233731f93ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5a5a6b0a-e1a4-4677-8cdb-6233731f93ac.35c40696-3363-4049-a460-f4fb1fddc43f 1G {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:30 devstack sudo[100861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5a5a6b0a-e1a4-4677-8cdb-6233731f93ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5a5a6b0a-e1a4-4677-8cdb-6233731f93ac.35c40696-3363-4049-a460-f4fb1fddc43f 1G Nov 03 07:41:30 devstack sudo[100861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:30 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-2ef0d81d-494f-4bb2-a06a-0a65b673a09e tempest-VolumesTransfersV355Test-749376277 None] Acquiring lock "cinder-quobyte-06da56f6-f855-42b7-b8df-ebfc95c4eceb" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:30 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-2ef0d81d-494f-4bb2-a06a-0a65b673a09e tempest-VolumesTransfersV355Test-749376277 None] Lock "cinder-quobyte-06da56f6-f855-42b7-b8df-ebfc95c4eceb" acquired by "delete_volume" :: waited 0.028s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:30 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-f10ca9c3-1a3a-4aa9-a3ec-c9e066ac1895 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:41:30 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f10ca9c3-1a3a-4aa9-a3ec-c9e066ac1895 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Flow 'volume_create_manager' (52de95ae-25ff-4748-94b2-8a7deb5f4853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:30 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f10ca9c3-1a3a-4aa9-a3ec-c9e066ac1895 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c462dd8c-864d-4903-8841-eab7feefd6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:30 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2dc9c5-d52a-47ed-8b05-b1077b0fe2ec]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2ef0d81d-494f-4bb2-a06a-0a65b673a09e tempest-VolumesTransfersV355Test-749376277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-06da56f6-f855-42b7-b8df-ebfc95c4eceb {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:30 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f10ca9c3-1a3a-4aa9-a3ec-c9e066ac1895 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c462dd8c-864d-4903-8841-eab7feefd6f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-398179092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=431f662e-e326-4e39-a61a-3a3f22b5eb09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67d8b9647595456f8e94d6959fffaf55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:31Z,use_quota=True,user_id='0eef9883534642a38d586f6bc715ff98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:30 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f10ca9c3-1a3a-4aa9-a3ec-c9e066ac1895 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f70c5f49-6037-46b5-ae25-1fa843918b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:30 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f10ca9c3-1a3a-4aa9-a3ec-c9e066ac1895 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f70c5f49-6037-46b5-ae25-1fa843918b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:30 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f10ca9c3-1a3a-4aa9-a3ec-c9e066ac1895 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce84cb9c-0169-4843-a1d3-35f64f71d757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:30 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f10ca9c3-1a3a-4aa9-a3ec-c9e066ac1895 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce84cb9c-0169-4843-a1d3-35f64f71d757) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '431f662e-e326-4e39-a61a-3a3f22b5eb09', 'volume_name': 'volume-431f662e-e326-4e39-a61a-3a3f22b5eb09', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:30 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f10ca9c3-1a3a-4aa9-a3ec-c9e066ac1895 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1939abc-5ed2-4128-97ed-7f0ebfdc510e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:30 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f10ca9c3-1a3a-4aa9-a3ec-c9e066ac1895 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1939abc-5ed2-4128-97ed-7f0ebfdc510e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:30 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f10ca9c3-1a3a-4aa9-a3ec-c9e066ac1895 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e678da2-274d-4af1-b682-c2d104f50f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:30 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-f10ca9c3-1a3a-4aa9-a3ec-c9e066ac1895 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Volume 431f662e-e326-4e39-a61a-3a3f22b5eb09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-431f662e-e326-4e39-a61a-3a3f22b5eb09', 'volume_size': 1} Nov 03 07:41:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-f10ca9c3-1a3a-4aa9-a3ec-c9e066ac1895 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:30 devstack sudo[100863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-06da56f6-f855-42b7-b8df-ebfc95c4eceb Nov 03 07:41:30 devstack sudo[100863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:31 devstack sudo[100861]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3ba18528-1564-4420-a827-cf681acfa606 tempest-GroupSnapshotsTest-2057469718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5a5a6b0a-e1a4-4677-8cdb-6233731f93ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5a5a6b0a-e1a4-4677-8cdb-6233731f93ac.35c40696-3363-4049-a460-f4fb1fddc43f 1G" returned: 0 in 0.601s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3ba18528-1564-4420-a827-cf681acfa606 tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a5a6b0a-e1a4-4677-8cdb-6233731f93ac -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5a5a6b0a-e1a4-4677-8cdb-6233731f93ac.35c40696-3363-4049-a460-f4fb1fddc43f {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:31 devstack sudo[100869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a5a6b0a-e1a4-4677-8cdb-6233731f93ac -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5a5a6b0a-e1a4-4677-8cdb-6233731f93ac.35c40696-3363-4049-a460-f4fb1fddc43f Nov 03 07:41:31 devstack sudo[100869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:31 devstack sudo[100863]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2ef0d81d-494f-4bb2-a06a-0a65b673a09e tempest-VolumesTransfersV355Test-749376277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-06da56f6-f855-42b7-b8df-ebfc95c4eceb" returned: 0 in 0.548s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2ef0d81d-494f-4bb2-a06a-0a65b673a09e tempest-VolumesTransfersV355Test-749376277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-06da56f6-f855-42b7-b8df-ebfc95c4eceb {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:31 devstack sudo[100875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-06da56f6-f855-42b7-b8df-ebfc95c4eceb Nov 03 07:41:31 devstack sudo[100875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:31 devstack sudo[100869]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3ba18528-1564-4420-a827-cf681acfa606 tempest-GroupSnapshotsTest-2057469718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a5a6b0a-e1a4-4677-8cdb-6233731f93ac -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5a5a6b0a-e1a4-4677-8cdb-6233731f93ac.35c40696-3363-4049-a460-f4fb1fddc43f" returned: 0 in 0.339s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:31 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-3ba18528-1564-4420-a827-cf681acfa606 tempest-GroupSnapshotsTest-2057469718 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5a5a6b0a-e1a4-4677-8cdb-6233731f93ac.35c40696-3363-4049-a460-f4fb1fddc43f is being set with open permissions: ugo+rw: NotImplementedError Nov 03 07:41:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3ba18528-1564-4420-a827-cf681acfa606 tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5a5a6b0a-e1a4-4677-8cdb-6233731f93ac.35c40696-3363-4049-a460-f4fb1fddc43f {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:31 devstack sudo[100882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5a5a6b0a-e1a4-4677-8cdb-6233731f93ac.35c40696-3363-4049-a460-f4fb1fddc43f Nov 03 07:41:31 devstack sudo[100882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:31 devstack sudo[100875]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2ef0d81d-494f-4bb2-a06a-0a65b673a09e tempest-VolumesTransfersV355Test-749376277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-06da56f6-f855-42b7-b8df-ebfc95c4eceb" returned: 0 in 0.301s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:31 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-2ef0d81d-494f-4bb2-a06a-0a65b673a09e tempest-VolumesTransfersV355Test-749376277 None] Lock "cinder-quobyte-06da56f6-f855-42b7-b8df-ebfc95c4eceb" released by "delete_volume" :: held 0.944s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:31 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-2ef0d81d-494f-4bb2-a06a-0a65b673a09e tempest-VolumesTransfersV355Test-749376277 None] Created reservations ['aad4b514-d6bb-48aa-89ec-0844d111d1b2', 'e9c842db-ff37-4c52-b476-d62ff1299d62', '06a1d19e-b7be-4a04-aec3-4a70cfede01c', '48938d77-b901-4617-9be6-1492a562ce82'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:41:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-2ef0d81d-494f-4bb2-a06a-0a65b673a09e tempest-VolumesTransfersV355Test-749376277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-2ef0d81d-494f-4bb2-a06a-0a65b673a09e tempest-VolumesTransfersV355Test-749376277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:31 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-2ef0d81d-494f-4bb2-a06a-0a65b673a09e tempest-VolumesTransfersV355Test-749376277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:31 devstack sudo[100882]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:31 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-2ef0d81d-494f-4bb2-a06a-0a65b673a09e tempest-VolumesTransfersV355Test-749376277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-2ef0d81d-494f-4bb2-a06a-0a65b673a09e tempest-VolumesTransfersV355Test-749376277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2ef0d81d-494f-4bb2-a06a-0a65b673a09e tempest-VolumesTransfersV355Test-749376277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3ba18528-1564-4420-a827-cf681acfa606 tempest-GroupSnapshotsTest-2057469718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5a5a6b0a-e1a4-4677-8cdb-6233731f93ac.35c40696-3363-4049-a460-f4fb1fddc43f" returned: 0 in 0.362s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:31 devstack sudo[100886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:41:31 devstack sudo[100886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3ba18528-1564-4420-a827-cf681acfa606 tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5a5a6b0a-e1a4-4677-8cdb-6233731f93ac.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:31 devstack sudo[100888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5a5a6b0a-e1a4-4677-8cdb-6233731f93ac.info Nov 03 07:41:31 devstack sudo[100888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:32 devstack sudo[100886]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:32 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2ef0d81d-494f-4bb2-a06a-0a65b673a09e tempest-VolumesTransfersV355Test-749376277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.302s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:32 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-2ef0d81d-494f-4bb2-a06a-0a65b673a09e tempest-VolumesTransfersV355Test-749376277 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:41:32 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-2ef0d81d-494f-4bb2-a06a-0a65b673a09e tempest-VolumesTransfersV355Test-749376277 None] Deleted volume successfully. Nov 03 07:41:32 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-2ef0d81d-494f-4bb2-a06a-0a65b673a09e tempest-VolumesTransfersV355Test-749376277 None] Lock "cinder-06da56f6-f855-42b7-b8df-ebfc95c4eceb-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:32 devstack sudo[100888]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:32 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3ba18528-1564-4420-a827-cf681acfa606 tempest-GroupSnapshotsTest-2057469718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5a5a6b0a-e1a4-4677-8cdb-6233731f93ac.info" returned: 0 in 0.353s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:32 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-3ba18528-1564-4420-a827-cf681acfa606 tempest-GroupSnapshotsTest-2057469718 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5a5a6b0a-e1a4-4677-8cdb-6233731f93ac.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 07:41:32 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3ba18528-1564-4420-a827-cf681acfa606 tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5a5a6b0a-e1a4-4677-8cdb-6233731f93ac.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:32 devstack sudo[100892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5a5a6b0a-e1a4-4677-8cdb-6233731f93ac.info Nov 03 07:41:32 devstack sudo[100892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:32 devstack sudo[100892]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:32 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3ba18528-1564-4420-a827-cf681acfa606 tempest-GroupSnapshotsTest-2057469718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5a5a6b0a-e1a4-4677-8cdb-6233731f93ac.info" returned: 0 in 0.278s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:32 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3ba18528-1564-4420-a827-cf681acfa606 tempest-GroupSnapshotsTest-2057469718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.699s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:32 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-f10ca9c3-1a3a-4aa9-a3ec-c9e066ac1895 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.674s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:32 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-f10ca9c3-1a3a-4aa9-a3ec-c9e066ac1895 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-398179092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=431f662e-e326-4e39-a61a-3a3f22b5eb09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67d8b9647595456f8e94d6959fffaf55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:31Z,use_quota=True,user_id='0eef9883534642a38d586f6bc715ff98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:41:32 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-f10ca9c3-1a3a-4aa9-a3ec-c9e066ac1895 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Creating volume 431f662e-e326-4e39-a61a-3a3f22b5eb09 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:41:32 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-f10ca9c3-1a3a-4aa9-a3ec-c9e066ac1895 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:32 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-f10ca9c3-1a3a-4aa9-a3ec-c9e066ac1895 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:32 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-f10ca9c3-1a3a-4aa9-a3ec-c9e066ac1895 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:32 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-f10ca9c3-1a3a-4aa9-a3ec-c9e066ac1895 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:32 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-f10ca9c3-1a3a-4aa9-a3ec-c9e066ac1895 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:32 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-f10ca9c3-1a3a-4aa9-a3ec-c9e066ac1895 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:41:32 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-f10ca9c3-1a3a-4aa9-a3ec-c9e066ac1895 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:41:32 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f10ca9c3-1a3a-4aa9-a3ec-c9e066ac1895 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-431f662e-e326-4e39-a61a-3a3f22b5eb09 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:32 devstack sudo[100895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-431f662e-e326-4e39-a61a-3a3f22b5eb09 1073741824 Nov 03 07:41:32 devstack sudo[100895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:32 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-3ba18528-1564-4420-a827-cf681acfa606 tempest-GroupSnapshotsTest-2057469718 None] group_snapshot efbbbf56-bb4c-4b93-8ed2-2668e0a831db: created successfully Nov 03 07:41:33 devstack sudo[100895]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f10ca9c3-1a3a-4aa9-a3ec-c9e066ac1895 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-431f662e-e326-4e39-a61a-3a3f22b5eb09 1073741824" returned: 0 in 0.654s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f10ca9c3-1a3a-4aa9-a3ec-c9e066ac1895 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-431f662e-e326-4e39-a61a-3a3f22b5eb09 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:33 devstack sudo[100901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-431f662e-e326-4e39-a61a-3a3f22b5eb09 Nov 03 07:41:33 devstack sudo[100901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:33 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-d8dfc409-c7a3-4c4e-ba5b-4ae4054af41d tempest-GroupSnapshotsTest-2057469718 None] group_snapshot efbbbf56-bb4c-4b93-8ed2-2668e0a831db: deleting Nov 03 07:41:33 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d8dfc409-c7a3-4c4e-ba5b-4ae4054af41d tempest-GroupSnapshotsTest-2057469718 None] group_snapshot efbbbf56-bb4c-4b93-8ed2-2668e0a831db: deleting {{(pid=86875) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 03 07:41:33 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d8dfc409-c7a3-4c4e-ba5b-4ae4054af41d tempest-GroupSnapshotsTest-2057469718 None] Acquiring lock "cinder-quobyte-5a5a6b0a-e1a4-4677-8cdb-6233731f93ac" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:33 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d8dfc409-c7a3-4c4e-ba5b-4ae4054af41d tempest-GroupSnapshotsTest-2057469718 None] Lock "cinder-quobyte-5a5a6b0a-e1a4-4677-8cdb-6233731f93ac" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:33 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d8dfc409-c7a3-4c4e-ba5b-4ae4054af41d tempest-GroupSnapshotsTest-2057469718 None] Acquiring lock "cinder-quobyte-35c40696-3363-4049-a460-f4fb1fddc43f" by "_delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:33 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d8dfc409-c7a3-4c4e-ba5b-4ae4054af41d tempest-GroupSnapshotsTest-2057469718 None] Lock "cinder-quobyte-35c40696-3363-4049-a460-f4fb1fddc43f" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:33 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-d8dfc409-c7a3-4c4e-ba5b-4ae4054af41d tempest-GroupSnapshotsTest-2057469718 None] Deleting offline snapshot 35c40696-3363-4049-a460-f4fb1fddc43f of volume 5a5a6b0a-e1a4-4677-8cdb-6233731f93ac {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:41:33 devstack sudo[100901]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:33 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-d8dfc409-c7a3-4c4e-ba5b-4ae4054af41d tempest-GroupSnapshotsTest-2057469718 None] snapshot_file for this snap is: volume-5a5a6b0a-e1a4-4677-8cdb-6233731f93ac.35c40696-3363-4049-a460-f4fb1fddc43f {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:41:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f10ca9c3-1a3a-4aa9-a3ec-c9e066ac1895 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-431f662e-e326-4e39-a61a-3a3f22b5eb09" returned: 0 in 0.392s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:33 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-f10ca9c3-1a3a-4aa9-a3ec-c9e066ac1895 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:41:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-f10ca9c3-1a3a-4aa9-a3ec-c9e066ac1895 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:33 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[08328b70-1cce-4df7-a656-0a7c5d13f0a4]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d8dfc409-c7a3-4c4e-ba5b-4ae4054af41d tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5a5a6b0a-e1a4-4677-8cdb-6233731f93ac.35c40696-3363-4049-a460-f4fb1fddc43f {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:33 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f10ca9c3-1a3a-4aa9-a3ec-c9e066ac1895 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e678da2-274d-4af1-b682-c2d104f50f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-431f662e-e326-4e39-a61a-3a3f22b5eb09', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:33 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f10ca9c3-1a3a-4aa9-a3ec-c9e066ac1895 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eb8a833-0617-4710-9646-28fbbcce2e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:33 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-f10ca9c3-1a3a-4aa9-a3ec-c9e066ac1895 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Volume volume-431f662e-e326-4e39-a61a-3a3f22b5eb09 (431f662e-e326-4e39-a61a-3a3f22b5eb09): created successfully Nov 03 07:41:33 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f10ca9c3-1a3a-4aa9-a3ec-c9e066ac1895 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eb8a833-0617-4710-9646-28fbbcce2e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:33 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f10ca9c3-1a3a-4aa9-a3ec-c9e066ac1895 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Flow 'volume_create_manager' (52de95ae-25ff-4748-94b2-8a7deb5f4853) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:33 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-f10ca9c3-1a3a-4aa9-a3ec-c9e066ac1895 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Created volume successfully. Nov 03 07:41:33 devstack sudo[100904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5a5a6b0a-e1a4-4677-8cdb-6233731f93ac.35c40696-3363-4049-a460-f4fb1fddc43f Nov 03 07:41:33 devstack sudo[100904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:34 devstack sudo[100904]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d8dfc409-c7a3-4c4e-ba5b-4ae4054af41d tempest-GroupSnapshotsTest-2057469718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5a5a6b0a-e1a4-4677-8cdb-6233731f93ac.35c40696-3363-4049-a460-f4fb1fddc43f" returned: 0 in 0.617s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:34 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-d8dfc409-c7a3-4c4e-ba5b-4ae4054af41d tempest-GroupSnapshotsTest-2057469718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a5a6b0a-e1a4-4677-8cdb-6233731f93ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:41:34 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[071fd31b-d4a7-40f1-9aad-e2a93337ac91]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d8dfc409-c7a3-4c4e-ba5b-4ae4054af41d tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5a5a6b0a-e1a4-4677-8cdb-6233731f93ac {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:34 devstack sudo[100909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5a5a6b0a-e1a4-4677-8cdb-6233731f93ac Nov 03 07:41:34 devstack sudo[100909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:34 devstack sudo[100909]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d8dfc409-c7a3-4c4e-ba5b-4ae4054af41d tempest-GroupSnapshotsTest-2057469718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5a5a6b0a-e1a4-4677-8cdb-6233731f93ac" returned: 0 in 0.535s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d8dfc409-c7a3-4c4e-ba5b-4ae4054af41d tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5a5a6b0a-e1a4-4677-8cdb-6233731f93ac.35c40696-3363-4049-a460-f4fb1fddc43f {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:34 devstack sudo[100915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5a5a6b0a-e1a4-4677-8cdb-6233731f93ac.35c40696-3363-4049-a460-f4fb1fddc43f Nov 03 07:41:34 devstack sudo[100915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:35 devstack sudo[100915]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d8dfc409-c7a3-4c4e-ba5b-4ae4054af41d tempest-GroupSnapshotsTest-2057469718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5a5a6b0a-e1a4-4677-8cdb-6233731f93ac.35c40696-3363-4049-a460-f4fb1fddc43f" returned: 0 in 0.492s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d8dfc409-c7a3-4c4e-ba5b-4ae4054af41d tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5a5a6b0a-e1a4-4677-8cdb-6233731f93ac.35c40696-3363-4049-a460-f4fb1fddc43f {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:35 devstack sudo[100920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5a5a6b0a-e1a4-4677-8cdb-6233731f93ac.35c40696-3363-4049-a460-f4fb1fddc43f Nov 03 07:41:35 devstack sudo[100920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:35 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c4a4d60-f390-43b9-a912-4d46c58964ab tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:41:35 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-8c4a4d60-f390-43b9-a912-4d46c58964ab tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Flow 'volume_create_manager' (975205a5-f827-4d83-b201-827d67ff8717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:35 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-8c4a4d60-f390-43b9-a912-4d46c58964ab tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45ced5cf-f152-49b2-80f6-f497346c1438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:35 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-8c4a4d60-f390-43b9-a912-4d46c58964ab tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45ced5cf-f152-49b2-80f6-f497346c1438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2102431195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e405321-08c7-4e29-af85-05b077a06f08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67d8b9647595456f8e94d6959fffaf55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:36Z,use_quota=True,user_id='0eef9883534642a38d586f6bc715ff98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:35 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-8c4a4d60-f390-43b9-a912-4d46c58964ab tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ebb9a4c-aaaf-404a-adcb-ce220fddcd42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:35 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-8c4a4d60-f390-43b9-a912-4d46c58964ab tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ebb9a4c-aaaf-404a-adcb-ce220fddcd42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:35 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-8c4a4d60-f390-43b9-a912-4d46c58964ab tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3e9f90e-63e9-4717-8e53-bbcb13be4ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:35 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-8c4a4d60-f390-43b9-a912-4d46c58964ab tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3e9f90e-63e9-4717-8e53-bbcb13be4ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e405321-08c7-4e29-af85-05b077a06f08', 'volume_name': 'volume-5e405321-08c7-4e29-af85-05b077a06f08', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:35 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-8c4a4d60-f390-43b9-a912-4d46c58964ab tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dff40bd-b6a5-45fb-a237-32f452b0b912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:35 devstack sudo[100920]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:35 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-8c4a4d60-f390-43b9-a912-4d46c58964ab tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dff40bd-b6a5-45fb-a237-32f452b0b912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:35 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-8c4a4d60-f390-43b9-a912-4d46c58964ab tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c95c7ea-95c4-4b21-98c7-4c09a51d5791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:35 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-8c4a4d60-f390-43b9-a912-4d46c58964ab tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Volume 5e405321-08c7-4e29-af85-05b077a06f08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e405321-08c7-4e29-af85-05b077a06f08', 'volume_size': 1} Nov 03 07:41:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-8c4a4d60-f390-43b9-a912-4d46c58964ab tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-8c4a4d60-f390-43b9-a912-4d46c58964ab tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:35 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-8c4a4d60-f390-43b9-a912-4d46c58964ab tempest-CreateVolumesFromSourceVolumeTest-827262967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2102431195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e405321-08c7-4e29-af85-05b077a06f08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67d8b9647595456f8e94d6959fffaf55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:36Z,use_quota=True,user_id='0eef9883534642a38d586f6bc715ff98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:41:35 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-8c4a4d60-f390-43b9-a912-4d46c58964ab tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Creating volume 5e405321-08c7-4e29-af85-05b077a06f08 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:41:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-8c4a4d60-f390-43b9-a912-4d46c58964ab tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-8c4a4d60-f390-43b9-a912-4d46c58964ab tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:35 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-8c4a4d60-f390-43b9-a912-4d46c58964ab tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:35 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-8c4a4d60-f390-43b9-a912-4d46c58964ab tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-8c4a4d60-f390-43b9-a912-4d46c58964ab tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:35 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-8c4a4d60-f390-43b9-a912-4d46c58964ab tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:41:35 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-8c4a4d60-f390-43b9-a912-4d46c58964ab tempest-CreateVolumesFromSourceVolumeTest-827262967 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:41:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8c4a4d60-f390-43b9-a912-4d46c58964ab tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5e405321-08c7-4e29-af85-05b077a06f08 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d8dfc409-c7a3-4c4e-ba5b-4ae4054af41d tempest-GroupSnapshotsTest-2057469718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5a5a6b0a-e1a4-4677-8cdb-6233731f93ac.35c40696-3363-4049-a460-f4fb1fddc43f" returned: 0 in 0.620s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:35 devstack sudo[100925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5e405321-08c7-4e29-af85-05b077a06f08 1073741824 Nov 03 07:41:35 devstack sudo[100925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:35 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d8dfc409-c7a3-4c4e-ba5b-4ae4054af41d tempest-GroupSnapshotsTest-2057469718 None] Lock "cinder-quobyte-35c40696-3363-4049-a460-f4fb1fddc43f" released by "_delete_snapshot" :: held 2.463s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:35 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d8dfc409-c7a3-4c4e-ba5b-4ae4054af41d tempest-GroupSnapshotsTest-2057469718 None] Lock "cinder-quobyte-5a5a6b0a-e1a4-4677-8cdb-6233731f93ac" released by "delete_snapshot" :: held 2.513s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:36 devstack cinder-volume[86875]: WARNING cinder.quota [None req-d8dfc409-c7a3-4c4e-ba5b-4ae4054af41d tempest-GroupSnapshotsTest-2057469718 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-141640431 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-141640431, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:41:36 devstack cinder-volume[86875]: WARNING cinder.quota [None req-d8dfc409-c7a3-4c4e-ba5b-4ae4054af41d tempest-GroupSnapshotsTest-2057469718 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-141640431 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-141640431, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:41:36 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-d8dfc409-c7a3-4c4e-ba5b-4ae4054af41d tempest-GroupSnapshotsTest-2057469718 None] Created reservations ['b11ecef9-f30b-4d8f-8a5f-40161941c1a8', '77abd934-401e-476a-b5bf-0995aed68dbf', '8c8a3cf1-96f4-4580-86ab-7e25bca17791', 'c912c356-a504-46d3-8378-b16d107be32a'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:41:36 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-d8dfc409-c7a3-4c4e-ba5b-4ae4054af41d tempest-GroupSnapshotsTest-2057469718 None] group_snapshot efbbbf56-bb4c-4b93-8ed2-2668e0a831db: deleted successfully Nov 03 07:41:36 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1ada485-af7c-497d-9ef5-d17554580259 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:41:36 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b1ada485-af7c-497d-9ef5-d17554580259 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Flow 'volume_create_manager' (9f4ffda7-54d4-4973-9784-5a0c30be9aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:36 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b1ada485-af7c-497d-9ef5-d17554580259 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef155f66-07ba-4595-bbd4-a7125190e241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:36 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b1ada485-af7c-497d-9ef5-d17554580259 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef155f66-07ba-4595-bbd4-a7125190e241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1833084961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94857b92-f032-4ee6-9703-f7d6fbac9fc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67d8b9647595456f8e94d6959fffaf55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:37Z,use_quota=True,user_id='0eef9883534642a38d586f6bc715ff98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:36 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b1ada485-af7c-497d-9ef5-d17554580259 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84780474-bfc2-4833-9a20-8343822435a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:36 devstack sudo[100925]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:36 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b1ada485-af7c-497d-9ef5-d17554580259 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84780474-bfc2-4833-9a20-8343822435a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:36 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b1ada485-af7c-497d-9ef5-d17554580259 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf2f7593-5c02-4fb1-bd96-b917434bf355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:36 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b1ada485-af7c-497d-9ef5-d17554580259 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf2f7593-5c02-4fb1-bd96-b917434bf355) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94857b92-f032-4ee6-9703-f7d6fbac9fc3', 'volume_name': 'volume-94857b92-f032-4ee6-9703-f7d6fbac9fc3', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:36 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b1ada485-af7c-497d-9ef5-d17554580259 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f30a124-7cf9-4027-a9b3-42ef2e64baeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:36 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b1ada485-af7c-497d-9ef5-d17554580259 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f30a124-7cf9-4027-a9b3-42ef2e64baeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:36 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b1ada485-af7c-497d-9ef5-d17554580259 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7e0025b-b164-40df-8c05-c635efc9a0e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:36 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-b1ada485-af7c-497d-9ef5-d17554580259 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Volume 94857b92-f032-4ee6-9703-f7d6fbac9fc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94857b92-f032-4ee6-9703-f7d6fbac9fc3', 'volume_size': 1} Nov 03 07:41:36 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b1ada485-af7c-497d-9ef5-d17554580259 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:36 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8c4a4d60-f390-43b9-a912-4d46c58964ab tempest-CreateVolumesFromSourceVolumeTest-827262967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5e405321-08c7-4e29-af85-05b077a06f08 1073741824" returned: 0 in 0.933s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:36 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8c4a4d60-f390-43b9-a912-4d46c58964ab tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5e405321-08c7-4e29-af85-05b077a06f08 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:36 devstack sudo[100931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5e405321-08c7-4e29-af85-05b077a06f08 Nov 03 07:41:36 devstack sudo[100931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:37 devstack sudo[100931]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8c4a4d60-f390-43b9-a912-4d46c58964ab tempest-CreateVolumesFromSourceVolumeTest-827262967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5e405321-08c7-4e29-af85-05b077a06f08" returned: 0 in 0.468s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:37 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-8c4a4d60-f390-43b9-a912-4d46c58964ab tempest-CreateVolumesFromSourceVolumeTest-827262967 None] <== create_volume: return (1492ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:41:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-8c4a4d60-f390-43b9-a912-4d46c58964ab tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.501s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b1ada485-af7c-497d-9ef5-d17554580259 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.561s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:37 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b1ada485-af7c-497d-9ef5-d17554580259 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1833084961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94857b92-f032-4ee6-9703-f7d6fbac9fc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67d8b9647595456f8e94d6959fffaf55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:37Z,use_quota=True,user_id='0eef9883534642a38d586f6bc715ff98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:41:37 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-b1ada485-af7c-497d-9ef5-d17554580259 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Creating volume 94857b92-f032-4ee6-9703-f7d6fbac9fc3 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:41:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b1ada485-af7c-497d-9ef5-d17554580259 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b1ada485-af7c-497d-9ef5-d17554580259 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:37 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b1ada485-af7c-497d-9ef5-d17554580259 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:37 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b1ada485-af7c-497d-9ef5-d17554580259 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b1ada485-af7c-497d-9ef5-d17554580259 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:37 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b1ada485-af7c-497d-9ef5-d17554580259 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:41:37 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-b1ada485-af7c-497d-9ef5-d17554580259 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:41:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b1ada485-af7c-497d-9ef5-d17554580259 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-94857b92-f032-4ee6-9703-f7d6fbac9fc3 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:37 devstack sudo[100936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-94857b92-f032-4ee6-9703-f7d6fbac9fc3 1073741824 Nov 03 07:41:37 devstack sudo[100936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:37 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-8c4a4d60-f390-43b9-a912-4d46c58964ab tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c95c7ea-95c4-4b21-98c7-4c09a51d5791) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e405321-08c7-4e29-af85-05b077a06f08', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:37 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-8c4a4d60-f390-43b9-a912-4d46c58964ab tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aebfa26a-7ba1-4394-a26c-18787d184256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:37 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8d3cd44-e4da-4c5a-ae37-66bd3d92adb8 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:41:37 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e8d3cd44-e4da-4c5a-ae37-66bd3d92adb8 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Flow 'volume_create_manager' (16c5ba45-832e-40cf-8fab-cbdfdf14e7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:37 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e8d3cd44-e4da-4c5a-ae37-66bd3d92adb8 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb44759e-6f41-4196-a685-2183feef0778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:37 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-8c4a4d60-f390-43b9-a912-4d46c58964ab tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Volume volume-5e405321-08c7-4e29-af85-05b077a06f08 (5e405321-08c7-4e29-af85-05b077a06f08): created successfully Nov 03 07:41:37 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-8c4a4d60-f390-43b9-a912-4d46c58964ab tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aebfa26a-7ba1-4394-a26c-18787d184256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:37 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-8c4a4d60-f390-43b9-a912-4d46c58964ab tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Flow 'volume_create_manager' (975205a5-f827-4d83-b201-827d67ff8717) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:37 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e8d3cd44-e4da-4c5a-ae37-66bd3d92adb8 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb44759e-6f41-4196-a685-2183feef0778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-190662811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04557e27-2b5c-48b0-b738-7a2489025da6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67d8b9647595456f8e94d6959fffaf55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:37Z,use_quota=True,user_id='0eef9883534642a38d586f6bc715ff98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:37 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e8d3cd44-e4da-4c5a-ae37-66bd3d92adb8 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (955e5c1f-2ed7-46ce-b1a0-608e6b61ac06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:37 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e8d3cd44-e4da-4c5a-ae37-66bd3d92adb8 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (955e5c1f-2ed7-46ce-b1a0-608e6b61ac06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:37 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e8d3cd44-e4da-4c5a-ae37-66bd3d92adb8 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b96e6464-2cba-4695-80d9-3e327d61c5b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:37 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e8d3cd44-e4da-4c5a-ae37-66bd3d92adb8 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b96e6464-2cba-4695-80d9-3e327d61c5b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04557e27-2b5c-48b0-b738-7a2489025da6', 'volume_name': 'volume-04557e27-2b5c-48b0-b738-7a2489025da6', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:37 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e8d3cd44-e4da-4c5a-ae37-66bd3d92adb8 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31130b20-9fb7-49d5-bfdc-38bd3b266bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:37 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e8d3cd44-e4da-4c5a-ae37-66bd3d92adb8 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31130b20-9fb7-49d5-bfdc-38bd3b266bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:37 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e8d3cd44-e4da-4c5a-ae37-66bd3d92adb8 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feab1a02-531a-4f32-a75f-4276f7614420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:37 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-e8d3cd44-e4da-4c5a-ae37-66bd3d92adb8 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Volume 04557e27-2b5c-48b0-b738-7a2489025da6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04557e27-2b5c-48b0-b738-7a2489025da6', 'volume_size': 1} Nov 03 07:41:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e8d3cd44-e4da-4c5a-ae37-66bd3d92adb8 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:37 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-8c4a4d60-f390-43b9-a912-4d46c58964ab tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Created volume successfully. Nov 03 07:41:37 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-41e2ad45-dd97-43c2-989e-a3a4dc02618d tempest-GroupSnapshotsTest-2057469718 None] Acquiring lock "cinder-quobyte-5a5a6b0a-e1a4-4677-8cdb-6233731f93ac" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:37 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-41e2ad45-dd97-43c2-989e-a3a4dc02618d tempest-GroupSnapshotsTest-2057469718 None] Lock "cinder-quobyte-5a5a6b0a-e1a4-4677-8cdb-6233731f93ac" acquired by "delete_volume" :: waited 0.052s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:37 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6acb43d-1e8c-4f13-a429-a9b237e5dec1]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-41e2ad45-dd97-43c2-989e-a3a4dc02618d tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5a5a6b0a-e1a4-4677-8cdb-6233731f93ac {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:38 devstack sudo[100942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5a5a6b0a-e1a4-4677-8cdb-6233731f93ac Nov 03 07:41:38 devstack sudo[100942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:38 devstack sudo[100936]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b1ada485-af7c-497d-9ef5-d17554580259 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-94857b92-f032-4ee6-9703-f7d6fbac9fc3 1073741824" returned: 0 in 0.762s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:38 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bcca058-2113-4be5-8484-a9da1476a82a tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:41:38 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4bcca058-2113-4be5-8484-a9da1476a82a tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Flow 'volume_create_manager' (e27da460-8aca-47fe-a61d-74b9aebc53c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:38 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4bcca058-2113-4be5-8484-a9da1476a82a tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (777b74f5-c8b5-4e77-b741-bac0b24d0cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:38 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4bcca058-2113-4be5-8484-a9da1476a82a tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (777b74f5-c8b5-4e77-b741-bac0b24d0cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1332134568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b76696fc-800f-45b7-95bd-021fb642ac76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67d8b9647595456f8e94d6959fffaf55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:38Z,use_quota=True,user_id='0eef9883534642a38d586f6bc715ff98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:38 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4bcca058-2113-4be5-8484-a9da1476a82a tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea8f7965-708b-4390-8179-45cef5c01a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:38 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4bcca058-2113-4be5-8484-a9da1476a82a tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea8f7965-708b-4390-8179-45cef5c01a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:38 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4bcca058-2113-4be5-8484-a9da1476a82a tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a86bf40-cc7f-458d-b8e8-e927f690d880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:38 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4bcca058-2113-4be5-8484-a9da1476a82a tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a86bf40-cc7f-458d-b8e8-e927f690d880) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b76696fc-800f-45b7-95bd-021fb642ac76', 'volume_name': 'volume-b76696fc-800f-45b7-95bd-021fb642ac76', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:38 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4bcca058-2113-4be5-8484-a9da1476a82a tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2270dc04-d883-4e51-8faa-6a7f228e551c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:38 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4bcca058-2113-4be5-8484-a9da1476a82a tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2270dc04-d883-4e51-8faa-6a7f228e551c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:38 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4bcca058-2113-4be5-8484-a9da1476a82a tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e352eab3-4486-4fda-8a6d-9c6fdd7141e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:38 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-4bcca058-2113-4be5-8484-a9da1476a82a tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Volume b76696fc-800f-45b7-95bd-021fb642ac76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b76696fc-800f-45b7-95bd-021fb642ac76', 'volume_size': 1} Nov 03 07:41:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-4bcca058-2113-4be5-8484-a9da1476a82a tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b1ada485-af7c-497d-9ef5-d17554580259 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-94857b92-f032-4ee6-9703-f7d6fbac9fc3 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:38 devstack sudo[100947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-94857b92-f032-4ee6-9703-f7d6fbac9fc3 Nov 03 07:41:38 devstack sudo[100947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:38 devstack sudo[100942]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-41e2ad45-dd97-43c2-989e-a3a4dc02618d tempest-GroupSnapshotsTest-2057469718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5a5a6b0a-e1a4-4677-8cdb-6233731f93ac" returned: 0 in 0.628s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-41e2ad45-dd97-43c2-989e-a3a4dc02618d tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5a5a6b0a-e1a4-4677-8cdb-6233731f93ac {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:38 devstack sudo[100950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5a5a6b0a-e1a4-4677-8cdb-6233731f93ac Nov 03 07:41:38 devstack sudo[100950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:38 devstack sudo[100947]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b1ada485-af7c-497d-9ef5-d17554580259 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-94857b92-f032-4ee6-9703-f7d6fbac9fc3" returned: 0 in 0.501s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:38 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b1ada485-af7c-497d-9ef5-d17554580259 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] <== create_volume: return (1456ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:41:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b1ada485-af7c-497d-9ef5-d17554580259 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.461s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e8d3cd44-e4da-4c5a-ae37-66bd3d92adb8 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.262s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:38 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-e8d3cd44-e4da-4c5a-ae37-66bd3d92adb8 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-190662811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04557e27-2b5c-48b0-b738-7a2489025da6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67d8b9647595456f8e94d6959fffaf55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:37Z,use_quota=True,user_id='0eef9883534642a38d586f6bc715ff98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:41:38 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-e8d3cd44-e4da-4c5a-ae37-66bd3d92adb8 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Creating volume 04557e27-2b5c-48b0-b738-7a2489025da6 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:41:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e8d3cd44-e4da-4c5a-ae37-66bd3d92adb8 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e8d3cd44-e4da-4c5a-ae37-66bd3d92adb8 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:38 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-e8d3cd44-e4da-4c5a-ae37-66bd3d92adb8 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:38 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-e8d3cd44-e4da-4c5a-ae37-66bd3d92adb8 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e8d3cd44-e4da-4c5a-ae37-66bd3d92adb8 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:38 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-e8d3cd44-e4da-4c5a-ae37-66bd3d92adb8 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:41:38 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-e8d3cd44-e4da-4c5a-ae37-66bd3d92adb8 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:41:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e8d3cd44-e4da-4c5a-ae37-66bd3d92adb8 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-04557e27-2b5c-48b0-b738-7a2489025da6 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:38 devstack sudo[100953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-04557e27-2b5c-48b0-b738-7a2489025da6 1073741824 Nov 03 07:41:38 devstack sudo[100953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:38 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b1ada485-af7c-497d-9ef5-d17554580259 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7e0025b-b164-40df-8c05-c635efc9a0e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94857b92-f032-4ee6-9703-f7d6fbac9fc3', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:38 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b1ada485-af7c-497d-9ef5-d17554580259 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43838b69-1b13-44a4-804e-6ca13f724df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:39 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-09e1b62a-2f96-4598-8bd1-8170dec215bc tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:41:39 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-09e1b62a-2f96-4598-8bd1-8170dec215bc tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Flow 'volume_create_manager' (1225fd73-2037-4946-a8d7-29a59e88cd77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:39 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-09e1b62a-2f96-4598-8bd1-8170dec215bc tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0a1934d-516f-4ec2-af82-9a564ca0bd1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:39 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-b1ada485-af7c-497d-9ef5-d17554580259 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Volume volume-94857b92-f032-4ee6-9703-f7d6fbac9fc3 (94857b92-f032-4ee6-9703-f7d6fbac9fc3): created successfully Nov 03 07:41:39 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b1ada485-af7c-497d-9ef5-d17554580259 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43838b69-1b13-44a4-804e-6ca13f724df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:39 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b1ada485-af7c-497d-9ef5-d17554580259 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Flow 'volume_create_manager' (9f4ffda7-54d4-4973-9784-5a0c30be9aa6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:39 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-09e1b62a-2f96-4598-8bd1-8170dec215bc tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0a1934d-516f-4ec2-af82-9a564ca0bd1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1029957658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76ae90c9-bee0-40be-b625-17876906e874,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67d8b9647595456f8e94d6959fffaf55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:39Z,use_quota=True,user_id='0eef9883534642a38d586f6bc715ff98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:39 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-09e1b62a-2f96-4598-8bd1-8170dec215bc tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bf8959c-b3e0-4fa3-9e6a-9043f510ce6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:39 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-09e1b62a-2f96-4598-8bd1-8170dec215bc tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bf8959c-b3e0-4fa3-9e6a-9043f510ce6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:39 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-09e1b62a-2f96-4598-8bd1-8170dec215bc tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bac0c3a7-18e0-40f5-a399-94c012401301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:39 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-09e1b62a-2f96-4598-8bd1-8170dec215bc tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bac0c3a7-18e0-40f5-a399-94c012401301) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76ae90c9-bee0-40be-b625-17876906e874', 'volume_name': 'volume-76ae90c9-bee0-40be-b625-17876906e874', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:39 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-09e1b62a-2f96-4598-8bd1-8170dec215bc tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b88d37cd-3231-405e-a411-073e4e9f2c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:39 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-09e1b62a-2f96-4598-8bd1-8170dec215bc tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b88d37cd-3231-405e-a411-073e4e9f2c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:39 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-09e1b62a-2f96-4598-8bd1-8170dec215bc tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4401f633-c6dd-4694-a505-91def4718ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:39 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-09e1b62a-2f96-4598-8bd1-8170dec215bc tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Volume 76ae90c9-bee0-40be-b625-17876906e874: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76ae90c9-bee0-40be-b625-17876906e874', 'volume_size': 1} Nov 03 07:41:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-09e1b62a-2f96-4598-8bd1-8170dec215bc tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:39 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-b1ada485-af7c-497d-9ef5-d17554580259 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Created volume successfully. Nov 03 07:41:39 devstack sudo[100950]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-41e2ad45-dd97-43c2-989e-a3a4dc02618d tempest-GroupSnapshotsTest-2057469718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5a5a6b0a-e1a4-4677-8cdb-6233731f93ac" returned: 0 in 0.687s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:39 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-41e2ad45-dd97-43c2-989e-a3a4dc02618d tempest-GroupSnapshotsTest-2057469718 None] Lock "cinder-quobyte-5a5a6b0a-e1a4-4677-8cdb-6233731f93ac" released by "delete_volume" :: held 1.460s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:39 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-41e2ad45-dd97-43c2-989e-a3a4dc02618d tempest-GroupSnapshotsTest-2057469718 None] Created reservations ['e2971048-d1bd-48e2-b4a6-db1ba3277c46'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:41:39 devstack cinder-volume[86875]: WARNING cinder.quota [None req-41e2ad45-dd97-43c2-989e-a3a4dc02618d tempest-GroupSnapshotsTest-2057469718 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-141640431 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-141640431, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:41:39 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-41e2ad45-dd97-43c2-989e-a3a4dc02618d tempest-GroupSnapshotsTest-2057469718 None] Created reservations ['2c67326f-b8c2-4dae-b837-54a2db960700', '7e97284c-b8ba-4d58-9927-fcfc078dca59', 'f5a274ff-160e-4439-8202-6c4e65167fde', 'bdf46187-f0cc-4cb6-8649-291f182d4dc2'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:41:39 devstack sudo[100953]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e8d3cd44-e4da-4c5a-ae37-66bd3d92adb8 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-04557e27-2b5c-48b0-b738-7a2489025da6 1073741824" returned: 0 in 0.687s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-41e2ad45-dd97-43c2-989e-a3a4dc02618d tempest-GroupSnapshotsTest-2057469718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-41e2ad45-dd97-43c2-989e-a3a4dc02618d tempest-GroupSnapshotsTest-2057469718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:39 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-41e2ad45-dd97-43c2-989e-a3a4dc02618d tempest-GroupSnapshotsTest-2057469718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:39 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-41e2ad45-dd97-43c2-989e-a3a4dc02618d tempest-GroupSnapshotsTest-2057469718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-41e2ad45-dd97-43c2-989e-a3a4dc02618d tempest-GroupSnapshotsTest-2057469718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-41e2ad45-dd97-43c2-989e-a3a4dc02618d tempest-GroupSnapshotsTest-2057469718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:39 devstack sudo[100960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:41:39 devstack sudo[100960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e8d3cd44-e4da-4c5a-ae37-66bd3d92adb8 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-04557e27-2b5c-48b0-b738-7a2489025da6 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:39 devstack sudo[100962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-04557e27-2b5c-48b0-b738-7a2489025da6 Nov 03 07:41:39 devstack sudo[100962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:40 devstack sudo[100962]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e8d3cd44-e4da-4c5a-ae37-66bd3d92adb8 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-04557e27-2b5c-48b0-b738-7a2489025da6" returned: 0 in 0.415s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:40 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-e8d3cd44-e4da-4c5a-ae37-66bd3d92adb8 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] <== create_volume: return (1200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:41:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e8d3cd44-e4da-4c5a-ae37-66bd3d92adb8 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.208s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-4bcca058-2113-4be5-8484-a9da1476a82a tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.751s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:40 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-4bcca058-2113-4be5-8484-a9da1476a82a tempest-CreateVolumesFromSourceVolumeTest-827262967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1332134568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b76696fc-800f-45b7-95bd-021fb642ac76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67d8b9647595456f8e94d6959fffaf55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:38Z,use_quota=True,user_id='0eef9883534642a38d586f6bc715ff98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:41:40 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-4bcca058-2113-4be5-8484-a9da1476a82a tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Creating volume b76696fc-800f-45b7-95bd-021fb642ac76 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:41:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-4bcca058-2113-4be5-8484-a9da1476a82a tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-4bcca058-2113-4be5-8484-a9da1476a82a tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:40 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-4bcca058-2113-4be5-8484-a9da1476a82a tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:40 devstack sudo[100960]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:40 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-4bcca058-2113-4be5-8484-a9da1476a82a tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-4bcca058-2113-4be5-8484-a9da1476a82a tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:40 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-4bcca058-2113-4be5-8484-a9da1476a82a tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:41:40 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-4bcca058-2113-4be5-8484-a9da1476a82a tempest-CreateVolumesFromSourceVolumeTest-827262967 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:41:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4bcca058-2113-4be5-8484-a9da1476a82a tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b76696fc-800f-45b7-95bd-021fb642ac76 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-41e2ad45-dd97-43c2-989e-a3a4dc02618d tempest-GroupSnapshotsTest-2057469718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.492s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:40 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-41e2ad45-dd97-43c2-989e-a3a4dc02618d tempest-GroupSnapshotsTest-2057469718 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:41:40 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-41e2ad45-dd97-43c2-989e-a3a4dc02618d tempest-GroupSnapshotsTest-2057469718 None] Delete group completed successfully. Nov 03 07:41:40 devstack sudo[100966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b76696fc-800f-45b7-95bd-021fb642ac76 1073741824 Nov 03 07:41:40 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e8d3cd44-e4da-4c5a-ae37-66bd3d92adb8 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feab1a02-531a-4f32-a75f-4276f7614420) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04557e27-2b5c-48b0-b738-7a2489025da6', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:40 devstack sudo[100966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:40 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e8d3cd44-e4da-4c5a-ae37-66bd3d92adb8 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1d8043b-56e4-4773-aa03-e05868e11919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:40 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-e8d3cd44-e4da-4c5a-ae37-66bd3d92adb8 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Volume volume-04557e27-2b5c-48b0-b738-7a2489025da6 (04557e27-2b5c-48b0-b738-7a2489025da6): created successfully Nov 03 07:41:40 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e8d3cd44-e4da-4c5a-ae37-66bd3d92adb8 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1d8043b-56e4-4773-aa03-e05868e11919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:40 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e8d3cd44-e4da-4c5a-ae37-66bd3d92adb8 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Flow 'volume_create_manager' (16c5ba45-832e-40cf-8fab-cbdfdf14e7b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:40 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-e8d3cd44-e4da-4c5a-ae37-66bd3d92adb8 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Created volume successfully. Nov 03 07:41:40 devstack sudo[100966]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4bcca058-2113-4be5-8484-a9da1476a82a tempest-CreateVolumesFromSourceVolumeTest-827262967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b76696fc-800f-45b7-95bd-021fb642ac76 1073741824" returned: 0 in 0.573s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4bcca058-2113-4be5-8484-a9da1476a82a tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b76696fc-800f-45b7-95bd-021fb642ac76 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:40 devstack sudo[100972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b76696fc-800f-45b7-95bd-021fb642ac76 Nov 03 07:41:40 devstack sudo[100972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:41 devstack sudo[100972]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4bcca058-2113-4be5-8484-a9da1476a82a tempest-CreateVolumesFromSourceVolumeTest-827262967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b76696fc-800f-45b7-95bd-021fb642ac76" returned: 0 in 0.410s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:41 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-4bcca058-2113-4be5-8484-a9da1476a82a tempest-CreateVolumesFromSourceVolumeTest-827262967 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:41:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-4bcca058-2113-4be5-8484-a9da1476a82a tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-09e1b62a-2f96-4598-8bd1-8170dec215bc tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.969s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:41 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-09e1b62a-2f96-4598-8bd1-8170dec215bc tempest-CreateVolumesFromSourceVolumeTest-827262967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1029957658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76ae90c9-bee0-40be-b625-17876906e874,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67d8b9647595456f8e94d6959fffaf55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:39Z,use_quota=True,user_id='0eef9883534642a38d586f6bc715ff98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:41:41 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-09e1b62a-2f96-4598-8bd1-8170dec215bc tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Creating volume 76ae90c9-bee0-40be-b625-17876906e874 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:41:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-09e1b62a-2f96-4598-8bd1-8170dec215bc tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-09e1b62a-2f96-4598-8bd1-8170dec215bc tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:41 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-09e1b62a-2f96-4598-8bd1-8170dec215bc tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:41 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-09e1b62a-2f96-4598-8bd1-8170dec215bc tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-09e1b62a-2f96-4598-8bd1-8170dec215bc tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:41 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-09e1b62a-2f96-4598-8bd1-8170dec215bc tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:41:41 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-09e1b62a-2f96-4598-8bd1-8170dec215bc tempest-CreateVolumesFromSourceVolumeTest-827262967 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:41:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-09e1b62a-2f96-4598-8bd1-8170dec215bc tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-76ae90c9-bee0-40be-b625-17876906e874 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:41 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4bcca058-2113-4be5-8484-a9da1476a82a tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e352eab3-4486-4fda-8a6d-9c6fdd7141e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b76696fc-800f-45b7-95bd-021fb642ac76', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:41 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4bcca058-2113-4be5-8484-a9da1476a82a tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (033740c2-fd23-4d06-a254-0af9c5a2c4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:41 devstack sudo[100975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-76ae90c9-bee0-40be-b625-17876906e874 1073741824 Nov 03 07:41:41 devstack sudo[100975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:41 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-4bcca058-2113-4be5-8484-a9da1476a82a tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Volume volume-b76696fc-800f-45b7-95bd-021fb642ac76 (b76696fc-800f-45b7-95bd-021fb642ac76): created successfully Nov 03 07:41:41 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4bcca058-2113-4be5-8484-a9da1476a82a tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (033740c2-fd23-4d06-a254-0af9c5a2c4df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:41 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4bcca058-2113-4be5-8484-a9da1476a82a tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Flow 'volume_create_manager' (e27da460-8aca-47fe-a61d-74b9aebc53c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:41 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-4bcca058-2113-4be5-8484-a9da1476a82a tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Created volume successfully. Nov 03 07:41:41 devstack sudo[100975]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-09e1b62a-2f96-4598-8bd1-8170dec215bc tempest-CreateVolumesFromSourceVolumeTest-827262967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-76ae90c9-bee0-40be-b625-17876906e874 1073741824" returned: 0 in 0.641s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-09e1b62a-2f96-4598-8bd1-8170dec215bc tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-76ae90c9-bee0-40be-b625-17876906e874 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:41 devstack sudo[100981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-76ae90c9-bee0-40be-b625-17876906e874 Nov 03 07:41:41 devstack sudo[100981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:42 devstack sudo[100981]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-09e1b62a-2f96-4598-8bd1-8170dec215bc tempest-CreateVolumesFromSourceVolumeTest-827262967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-76ae90c9-bee0-40be-b625-17876906e874" returned: 0 in 0.372s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:42 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-09e1b62a-2f96-4598-8bd1-8170dec215bc tempest-CreateVolumesFromSourceVolumeTest-827262967 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:41:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-09e1b62a-2f96-4598-8bd1-8170dec215bc tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:42 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-09e1b62a-2f96-4598-8bd1-8170dec215bc tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4401f633-c6dd-4694-a505-91def4718ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76ae90c9-bee0-40be-b625-17876906e874', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:42 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-09e1b62a-2f96-4598-8bd1-8170dec215bc tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ed92b04-3334-4f90-9e99-e0724eb33f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:42 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-09e1b62a-2f96-4598-8bd1-8170dec215bc tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Volume volume-76ae90c9-bee0-40be-b625-17876906e874 (76ae90c9-bee0-40be-b625-17876906e874): created successfully Nov 03 07:41:42 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-09e1b62a-2f96-4598-8bd1-8170dec215bc tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ed92b04-3334-4f90-9e99-e0724eb33f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:42 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-09e1b62a-2f96-4598-8bd1-8170dec215bc tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Flow 'volume_create_manager' (1225fd73-2037-4946-a8d7-29a59e88cd77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:42 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-09e1b62a-2f96-4598-8bd1-8170dec215bc tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Created volume successfully. Nov 03 07:41:42 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-4a33a3b5-cf9b-4567-9930-88f7b2adac4e tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Acquiring lock "cinder-76ae90c9-bee0-40be-b625-17876906e874-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:42 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-4a33a3b5-cf9b-4567-9930-88f7b2adac4e tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Lock "cinder-76ae90c9-bee0-40be-b625-17876906e874-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:42 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-4a33a3b5-cf9b-4567-9930-88f7b2adac4e tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Acquiring lock "cinder-quobyte-76ae90c9-bee0-40be-b625-17876906e874" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:42 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-4a33a3b5-cf9b-4567-9930-88f7b2adac4e tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Lock "cinder-quobyte-76ae90c9-bee0-40be-b625-17876906e874" acquired by "delete_volume" :: waited 0.031s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:42 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab2cd46-0b10-4003-9325-29ca3c347646]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4a33a3b5-cf9b-4567-9930-88f7b2adac4e tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-76ae90c9-bee0-40be-b625-17876906e874 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:42 devstack sudo[100984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-76ae90c9-bee0-40be-b625-17876906e874 Nov 03 07:41:42 devstack sudo[100984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:43 devstack sudo[100984]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:43 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4a33a3b5-cf9b-4567-9930-88f7b2adac4e tempest-CreateVolumesFromSourceVolumeTest-827262967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-76ae90c9-bee0-40be-b625-17876906e874" returned: 0 in 0.479s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:43 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4a33a3b5-cf9b-4567-9930-88f7b2adac4e tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-76ae90c9-bee0-40be-b625-17876906e874 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:43 devstack sudo[100989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-76ae90c9-bee0-40be-b625-17876906e874 Nov 03 07:41:43 devstack sudo[100989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:43 devstack sudo[100989]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:43 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4a33a3b5-cf9b-4567-9930-88f7b2adac4e tempest-CreateVolumesFromSourceVolumeTest-827262967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-76ae90c9-bee0-40be-b625-17876906e874" returned: 0 in 0.353s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:43 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-4a33a3b5-cf9b-4567-9930-88f7b2adac4e tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Lock "cinder-quobyte-76ae90c9-bee0-40be-b625-17876906e874" released by "delete_volume" :: held 0.920s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:43 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-4a33a3b5-cf9b-4567-9930-88f7b2adac4e tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Created reservations ['8d17a70d-0c31-4772-bbf6-4a91a7506d90', '6061a867-7218-43ad-b963-41af5b09b2a4', '87783100-5cc2-4b5b-b8a5-2f6429b3de63', '0fa9e336-1fc5-4db3-8ef2-adfc22bccd4c'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:41:43 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-4a33a3b5-cf9b-4567-9930-88f7b2adac4e tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:43 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-4a33a3b5-cf9b-4567-9930-88f7b2adac4e tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:43 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-4a33a3b5-cf9b-4567-9930-88f7b2adac4e tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:43 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-4a33a3b5-cf9b-4567-9930-88f7b2adac4e tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:43 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-4a33a3b5-cf9b-4567-9930-88f7b2adac4e tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:43 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4a33a3b5-cf9b-4567-9930-88f7b2adac4e tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:43 devstack sudo[100992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:41:43 devstack sudo[100992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:44 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cb88bee-44b2-4b56-92f1-96657e592976 tempest-VolumesSnapshotListTestJSON-915826739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:41:44 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7cb88bee-44b2-4b56-92f1-96657e592976 tempest-VolumesSnapshotListTestJSON-915826739 None] Flow 'volume_create_manager' (c9f64bfd-6e8f-4428-8d0b-5f8d76648904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:44 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7cb88bee-44b2-4b56-92f1-96657e592976 tempest-VolumesSnapshotListTestJSON-915826739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdb8d8ec-e4bb-4ea7-b443-951f9170175d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:44 devstack sudo[100992]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:44 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7cb88bee-44b2-4b56-92f1-96657e592976 tempest-VolumesSnapshotListTestJSON-915826739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdb8d8ec-e4bb-4ea7-b443-951f9170175d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-601526921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42ac3525-dd20-4c52-b0c9-e994ec1c849d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e226baea4323457e95c60a6ceda4f9bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:44Z,use_quota=True,user_id='b6bfc3f1716a47f58f68c49fcf7f0a80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:44 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7cb88bee-44b2-4b56-92f1-96657e592976 tempest-VolumesSnapshotListTestJSON-915826739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (961938d3-ffb0-4f21-aa3c-2cbc422c295e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:44 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7cb88bee-44b2-4b56-92f1-96657e592976 tempest-VolumesSnapshotListTestJSON-915826739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (961938d3-ffb0-4f21-aa3c-2cbc422c295e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:44 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7cb88bee-44b2-4b56-92f1-96657e592976 tempest-VolumesSnapshotListTestJSON-915826739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67ec72d4-5b96-43b2-acbf-78f13d9f4cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:44 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7cb88bee-44b2-4b56-92f1-96657e592976 tempest-VolumesSnapshotListTestJSON-915826739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67ec72d4-5b96-43b2-acbf-78f13d9f4cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42ac3525-dd20-4c52-b0c9-e994ec1c849d', 'volume_name': 'volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:44 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7cb88bee-44b2-4b56-92f1-96657e592976 tempest-VolumesSnapshotListTestJSON-915826739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (485268fa-7911-4784-b2ef-efb876e180b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:44 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7cb88bee-44b2-4b56-92f1-96657e592976 tempest-VolumesSnapshotListTestJSON-915826739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (485268fa-7911-4784-b2ef-efb876e180b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:44 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7cb88bee-44b2-4b56-92f1-96657e592976 tempest-VolumesSnapshotListTestJSON-915826739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e5cbebc-ddb0-4526-aa31-061b869de019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:44 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-7cb88bee-44b2-4b56-92f1-96657e592976 tempest-VolumesSnapshotListTestJSON-915826739 None] Volume 42ac3525-dd20-4c52-b0c9-e994ec1c849d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d', 'volume_size': 1} Nov 03 07:41:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7cb88bee-44b2-4b56-92f1-96657e592976 tempest-VolumesSnapshotListTestJSON-915826739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7cb88bee-44b2-4b56-92f1-96657e592976 tempest-VolumesSnapshotListTestJSON-915826739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:44 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-7cb88bee-44b2-4b56-92f1-96657e592976 tempest-VolumesSnapshotListTestJSON-915826739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-601526921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42ac3525-dd20-4c52-b0c9-e994ec1c849d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e226baea4323457e95c60a6ceda4f9bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:44Z,use_quota=True,user_id='b6bfc3f1716a47f58f68c49fcf7f0a80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:41:44 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-7cb88bee-44b2-4b56-92f1-96657e592976 tempest-VolumesSnapshotListTestJSON-915826739 None] Creating volume 42ac3525-dd20-4c52-b0c9-e994ec1c849d {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:41:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7cb88bee-44b2-4b56-92f1-96657e592976 tempest-VolumesSnapshotListTestJSON-915826739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7cb88bee-44b2-4b56-92f1-96657e592976 tempest-VolumesSnapshotListTestJSON-915826739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:44 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-7cb88bee-44b2-4b56-92f1-96657e592976 tempest-VolumesSnapshotListTestJSON-915826739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:44 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-7cb88bee-44b2-4b56-92f1-96657e592976 tempest-VolumesSnapshotListTestJSON-915826739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7cb88bee-44b2-4b56-92f1-96657e592976 tempest-VolumesSnapshotListTestJSON-915826739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:44 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-7cb88bee-44b2-4b56-92f1-96657e592976 tempest-VolumesSnapshotListTestJSON-915826739 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:41:44 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-7cb88bee-44b2-4b56-92f1-96657e592976 tempest-VolumesSnapshotListTestJSON-915826739 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:41:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7cb88bee-44b2-4b56-92f1-96657e592976 tempest-VolumesSnapshotListTestJSON-915826739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4a33a3b5-cf9b-4567-9930-88f7b2adac4e tempest-CreateVolumesFromSourceVolumeTest-827262967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.495s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:44 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-4a33a3b5-cf9b-4567-9930-88f7b2adac4e tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:41:44 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-4a33a3b5-cf9b-4567-9930-88f7b2adac4e tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Deleted volume successfully. Nov 03 07:41:44 devstack sudo[100995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d 1073741824 Nov 03 07:41:44 devstack sudo[100995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:44 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-4a33a3b5-cf9b-4567-9930-88f7b2adac4e tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Lock "cinder-76ae90c9-bee0-40be-b625-17876906e874-delete_volume" released by "delete_volume" :: held 1.805s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:44 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-59090d75-2daf-4aa5-b120-eb5f3fafe283 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Acquiring lock "cinder-b76696fc-800f-45b7-95bd-021fb642ac76-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:44 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-59090d75-2daf-4aa5-b120-eb5f3fafe283 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Lock "cinder-b76696fc-800f-45b7-95bd-021fb642ac76-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:45 devstack sudo[100995]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7cb88bee-44b2-4b56-92f1-96657e592976 tempest-VolumesSnapshotListTestJSON-915826739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d 1073741824" returned: 0 in 0.691s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:45 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-59090d75-2daf-4aa5-b120-eb5f3fafe283 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Acquiring lock "cinder-quobyte-b76696fc-800f-45b7-95bd-021fb642ac76" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:45 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-59090d75-2daf-4aa5-b120-eb5f3fafe283 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Lock "cinder-quobyte-b76696fc-800f-45b7-95bd-021fb642ac76" acquired by "delete_volume" :: waited 0.032s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7cb88bee-44b2-4b56-92f1-96657e592976 tempest-VolumesSnapshotListTestJSON-915826739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:45 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba6477d2-4161-4f54-9f02-628d17ce9d2c]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-59090d75-2daf-4aa5-b120-eb5f3fafe283 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b76696fc-800f-45b7-95bd-021fb642ac76 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:45 devstack sudo[101001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d Nov 03 07:41:45 devstack sudo[101001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:45 devstack sudo[101002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b76696fc-800f-45b7-95bd-021fb642ac76 Nov 03 07:41:45 devstack sudo[101002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:45 devstack sudo[101001]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7cb88bee-44b2-4b56-92f1-96657e592976 tempest-VolumesSnapshotListTestJSON-915826739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d" returned: 0 in 0.419s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:45 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-7cb88bee-44b2-4b56-92f1-96657e592976 tempest-VolumesSnapshotListTestJSON-915826739 None] <== create_volume: return (1233ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:41:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7cb88bee-44b2-4b56-92f1-96657e592976 tempest-VolumesSnapshotListTestJSON-915826739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.240s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:45 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7cb88bee-44b2-4b56-92f1-96657e592976 tempest-VolumesSnapshotListTestJSON-915826739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e5cbebc-ddb0-4526-aa31-061b869de019) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:45 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7cb88bee-44b2-4b56-92f1-96657e592976 tempest-VolumesSnapshotListTestJSON-915826739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a855010-c893-4e65-8488-fbe24c999548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:45 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-7cb88bee-44b2-4b56-92f1-96657e592976 tempest-VolumesSnapshotListTestJSON-915826739 None] Volume volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d (42ac3525-dd20-4c52-b0c9-e994ec1c849d): created successfully Nov 03 07:41:45 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7cb88bee-44b2-4b56-92f1-96657e592976 tempest-VolumesSnapshotListTestJSON-915826739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a855010-c893-4e65-8488-fbe24c999548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:45 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7cb88bee-44b2-4b56-92f1-96657e592976 tempest-VolumesSnapshotListTestJSON-915826739 None] Flow 'volume_create_manager' (c9f64bfd-6e8f-4428-8d0b-5f8d76648904) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:45 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-7cb88bee-44b2-4b56-92f1-96657e592976 tempest-VolumesSnapshotListTestJSON-915826739 None] Created volume successfully. Nov 03 07:41:45 devstack sudo[101002]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-59090d75-2daf-4aa5-b120-eb5f3fafe283 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b76696fc-800f-45b7-95bd-021fb642ac76" returned: 0 in 0.716s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-59090d75-2daf-4aa5-b120-eb5f3fafe283 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b76696fc-800f-45b7-95bd-021fb642ac76 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:45 devstack sudo[101009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b76696fc-800f-45b7-95bd-021fb642ac76 Nov 03 07:41:45 devstack sudo[101009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:46 devstack sudo[101009]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-59090d75-2daf-4aa5-b120-eb5f3fafe283 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b76696fc-800f-45b7-95bd-021fb642ac76" returned: 0 in 0.461s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:46 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-59090d75-2daf-4aa5-b120-eb5f3fafe283 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Lock "cinder-quobyte-b76696fc-800f-45b7-95bd-021fb642ac76" released by "delete_volume" :: held 1.258s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:46 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-59090d75-2daf-4aa5-b120-eb5f3fafe283 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Created reservations ['d6a40d56-ca6a-4eb2-b570-2bd60ca26e7b', '38d9343c-b29f-473f-ab0b-40b305786761', '2279b603-868c-43f5-9d91-0553b809c227', 'df25f4b5-1a45-4945-97e6-2fa39e118232'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:41:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-59090d75-2daf-4aa5-b120-eb5f3fafe283 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-59090d75-2daf-4aa5-b120-eb5f3fafe283 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:46 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-59090d75-2daf-4aa5-b120-eb5f3fafe283 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:46 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-59090d75-2daf-4aa5-b120-eb5f3fafe283 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-59090d75-2daf-4aa5-b120-eb5f3fafe283 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-59090d75-2daf-4aa5-b120-eb5f3fafe283 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:46 devstack sudo[101012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:41:46 devstack sudo[101012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-853687c4-a5cf-40b5-ad04-f2346a62008c tempest-VolumesSnapshotListTestJSON-915826739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-853687c4-a5cf-40b5-ad04-f2346a62008c tempest-VolumesSnapshotListTestJSON-915826739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:46 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-853687c4-a5cf-40b5-ad04-f2346a62008c tempest-VolumesSnapshotListTestJSON-915826739 None] Creating offline snapshot 7262ad20-0195-4091-ae1e-de02589326e4 of volume 42ac3525-dd20-4c52-b0c9-e994ec1c849d {{(pid=86875) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:41:46 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[873f1bc6-a78b-4566-8e6f-c0760acdb12d]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-853687c4-a5cf-40b5-ad04-f2346a62008c tempest-VolumesSnapshotListTestJSON-915826739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:46 devstack sudo[101014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d Nov 03 07:41:46 devstack sudo[101014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:47 devstack sudo[101012]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:47 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-59090d75-2daf-4aa5-b120-eb5f3fafe283 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.441s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:47 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-59090d75-2daf-4aa5-b120-eb5f3fafe283 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:41:47 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-59090d75-2daf-4aa5-b120-eb5f3fafe283 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Deleted volume successfully. Nov 03 07:41:47 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-59090d75-2daf-4aa5-b120-eb5f3fafe283 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Lock "cinder-b76696fc-800f-45b7-95bd-021fb642ac76-delete_volume" released by "delete_volume" :: held 2.120s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:47 devstack sudo[101014]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:47 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-853687c4-a5cf-40b5-ad04-f2346a62008c tempest-VolumesSnapshotListTestJSON-915826739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d" returned: 0 in 0.571s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:47 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-853687c4-a5cf-40b5-ad04-f2346a62008c tempest-VolumesSnapshotListTestJSON-915826739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.7262ad20-0195-4091-ae1e-de02589326e4 1G {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:47 devstack sudo[101020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.7262ad20-0195-4091-ae1e-de02589326e4 1G Nov 03 07:41:47 devstack sudo[101020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:47 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-c1b7bc3a-d065-496c-af26-e91dc39f156d tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Acquiring lock "cinder-04557e27-2b5c-48b0-b738-7a2489025da6-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:47 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-c1b7bc3a-d065-496c-af26-e91dc39f156d tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Lock "cinder-04557e27-2b5c-48b0-b738-7a2489025da6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:47 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-c1b7bc3a-d065-496c-af26-e91dc39f156d tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Acquiring lock "cinder-quobyte-04557e27-2b5c-48b0-b738-7a2489025da6" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:47 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-c1b7bc3a-d065-496c-af26-e91dc39f156d tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Lock "cinder-quobyte-04557e27-2b5c-48b0-b738-7a2489025da6" acquired by "delete_volume" :: waited 0.024s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:47 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3cad8ae-a545-4ca2-9b36-8f37b7e74e09]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:47 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c1b7bc3a-d065-496c-af26-e91dc39f156d tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-04557e27-2b5c-48b0-b738-7a2489025da6 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:47 devstack sudo[101022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-04557e27-2b5c-48b0-b738-7a2489025da6 Nov 03 07:41:47 devstack sudo[101022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:48 devstack sudo[101020]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-853687c4-a5cf-40b5-ad04-f2346a62008c tempest-VolumesSnapshotListTestJSON-915826739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.7262ad20-0195-4091-ae1e-de02589326e4 1G" returned: 0 in 0.703s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-853687c4-a5cf-40b5-ad04-f2346a62008c tempest-VolumesSnapshotListTestJSON-915826739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.7262ad20-0195-4091-ae1e-de02589326e4 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:48 devstack sudo[101028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.7262ad20-0195-4091-ae1e-de02589326e4 Nov 03 07:41:48 devstack sudo[101028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:48 devstack sudo[101022]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c1b7bc3a-d065-496c-af26-e91dc39f156d tempest-CreateVolumesFromSourceVolumeTest-827262967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-04557e27-2b5c-48b0-b738-7a2489025da6" returned: 0 in 0.662s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c1b7bc3a-d065-496c-af26-e91dc39f156d tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-04557e27-2b5c-48b0-b738-7a2489025da6 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:48 devstack sudo[101034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-04557e27-2b5c-48b0-b738-7a2489025da6 Nov 03 07:41:48 devstack sudo[101034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:48 devstack sudo[101028]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-853687c4-a5cf-40b5-ad04-f2346a62008c tempest-VolumesSnapshotListTestJSON-915826739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.7262ad20-0195-4091-ae1e-de02589326e4" returned: 0 in 0.556s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:48 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-853687c4-a5cf-40b5-ad04-f2346a62008c tempest-VolumesSnapshotListTestJSON-915826739 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.7262ad20-0195-4091-ae1e-de02589326e4 is being set with open permissions: ugo+rw Nov 03 07:41:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-853687c4-a5cf-40b5-ad04-f2346a62008c tempest-VolumesSnapshotListTestJSON-915826739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.7262ad20-0195-4091-ae1e-de02589326e4 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:48 devstack sudo[101034]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c1b7bc3a-d065-496c-af26-e91dc39f156d tempest-CreateVolumesFromSourceVolumeTest-827262967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-04557e27-2b5c-48b0-b738-7a2489025da6" returned: 0 in 0.343s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:48 devstack sudo[101040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.7262ad20-0195-4091-ae1e-de02589326e4 Nov 03 07:41:48 devstack sudo[101040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:48 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-c1b7bc3a-d065-496c-af26-e91dc39f156d tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Lock "cinder-quobyte-04557e27-2b5c-48b0-b738-7a2489025da6" released by "delete_volume" :: held 1.098s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:48 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-c1b7bc3a-d065-496c-af26-e91dc39f156d tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Created reservations ['26c7827e-e52d-40fd-9695-e621ac708530', 'e21cd4b3-3954-434b-80ac-24e1081b2e24', '7563a416-b846-42f6-a734-7428e5de93ff', 'ba55b1a1-265c-4e7f-a740-b78d954061bb'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:41:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-c1b7bc3a-d065-496c-af26-e91dc39f156d tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-c1b7bc3a-d065-496c-af26-e91dc39f156d tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:48 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-c1b7bc3a-d065-496c-af26-e91dc39f156d tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:48 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-c1b7bc3a-d065-496c-af26-e91dc39f156d tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-c1b7bc3a-d065-496c-af26-e91dc39f156d tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c1b7bc3a-d065-496c-af26-e91dc39f156d tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:48 devstack sudo[101043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:41:48 devstack sudo[101043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:48 devstack sudo[101040]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-853687c4-a5cf-40b5-ad04-f2346a62008c tempest-VolumesSnapshotListTestJSON-915826739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.7262ad20-0195-4091-ae1e-de02589326e4" returned: 0 in 0.412s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-853687c4-a5cf-40b5-ad04-f2346a62008c tempest-VolumesSnapshotListTestJSON-915826739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:49 devstack sudo[101045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.info Nov 03 07:41:49 devstack sudo[101045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:49 devstack sudo[101043]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c1b7bc3a-d065-496c-af26-e91dc39f156d tempest-CreateVolumesFromSourceVolumeTest-827262967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.381s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:49 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-c1b7bc3a-d065-496c-af26-e91dc39f156d tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:41:49 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-c1b7bc3a-d065-496c-af26-e91dc39f156d tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Deleted volume successfully. Nov 03 07:41:49 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-c1b7bc3a-d065-496c-af26-e91dc39f156d tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Lock "cinder-04557e27-2b5c-48b0-b738-7a2489025da6-delete_volume" released by "delete_volume" :: held 1.911s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:49 devstack sudo[101045]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-853687c4-a5cf-40b5-ad04-f2346a62008c tempest-VolumesSnapshotListTestJSON-915826739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.info" returned: 0 in 0.346s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:49 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-853687c4-a5cf-40b5-ad04-f2346a62008c tempest-VolumesSnapshotListTestJSON-915826739 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.info is being set with open permissions: ugo+rw Nov 03 07:41:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-853687c4-a5cf-40b5-ad04-f2346a62008c tempest-VolumesSnapshotListTestJSON-915826739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:49 devstack sudo[101049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.info Nov 03 07:41:49 devstack sudo[101049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:49 devstack sudo[101049]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-853687c4-a5cf-40b5-ad04-f2346a62008c tempest-VolumesSnapshotListTestJSON-915826739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.info" returned: 0 in 0.306s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-853687c4-a5cf-40b5-ad04-f2346a62008c tempest-VolumesSnapshotListTestJSON-915826739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.066s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:49 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-853687c4-a5cf-40b5-ad04-f2346a62008c tempest-VolumesSnapshotListTestJSON-915826739 None] Create snapshot completed successfully Nov 03 07:41:49 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a0d9a76d-1916-4b3e-8eff-33abe42cb3a6 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Acquiring lock "cinder-94857b92-f032-4ee6-9703-f7d6fbac9fc3-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:49 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a0d9a76d-1916-4b3e-8eff-33abe42cb3a6 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Lock "cinder-94857b92-f032-4ee6-9703-f7d6fbac9fc3-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:49 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a0d9a76d-1916-4b3e-8eff-33abe42cb3a6 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Acquiring lock "cinder-quobyte-94857b92-f032-4ee6-9703-f7d6fbac9fc3" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:49 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a0d9a76d-1916-4b3e-8eff-33abe42cb3a6 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Lock "cinder-quobyte-94857b92-f032-4ee6-9703-f7d6fbac9fc3" acquired by "delete_volume" :: waited 0.033s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:50 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[7067d0d8-fafe-4a50-9f20-28281bfad92e]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a0d9a76d-1916-4b3e-8eff-33abe42cb3a6 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-94857b92-f032-4ee6-9703-f7d6fbac9fc3 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:50 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-36fc0191-93eb-4b70-8a38-c1fc9811d6eb tempest-GroupSnapshotsV319Test-1260412742 None] Group tempest-GroupSnapshotsV319Test-Group-640511317: creating Nov 03 07:41:50 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-36fc0191-93eb-4b70-8a38-c1fc9811d6eb tempest-GroupSnapshotsV319Test-1260412742 None] Group tempest-GroupSnapshotsV319Test-Group-640511317: created successfully Nov 03 07:41:50 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-36fc0191-93eb-4b70-8a38-c1fc9811d6eb tempest-GroupSnapshotsV319Test-1260412742 None] Create group completed successfully. Nov 03 07:41:50 devstack sudo[101052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-94857b92-f032-4ee6-9703-f7d6fbac9fc3 Nov 03 07:41:50 devstack sudo[101052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:50 devstack sudo[101052]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a0d9a76d-1916-4b3e-8eff-33abe42cb3a6 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-94857b92-f032-4ee6-9703-f7d6fbac9fc3" returned: 0 in 0.392s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a0d9a76d-1916-4b3e-8eff-33abe42cb3a6 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-94857b92-f032-4ee6-9703-f7d6fbac9fc3 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:50 devstack sudo[101058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-94857b92-f032-4ee6-9703-f7d6fbac9fc3 Nov 03 07:41:50 devstack sudo[101058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:50 devstack sudo[101058]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a0d9a76d-1916-4b3e-8eff-33abe42cb3a6 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-94857b92-f032-4ee6-9703-f7d6fbac9fc3" returned: 0 in 0.260s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:50 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a0d9a76d-1916-4b3e-8eff-33abe42cb3a6 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Lock "cinder-quobyte-94857b92-f032-4ee6-9703-f7d6fbac9fc3" released by "delete_volume" :: held 0.717s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:50 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-a0d9a76d-1916-4b3e-8eff-33abe42cb3a6 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Created reservations ['d9898c90-b86f-4403-bff1-de3935ae6d55', '4af53568-8d47-4f97-8401-857591ea2aa4', '571d6e09-1e42-4da3-818e-0757fa49d5cf', '6e2be847-0ec3-41b2-b9b5-68351d592a3a'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:41:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a0d9a76d-1916-4b3e-8eff-33abe42cb3a6 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a0d9a76d-1916-4b3e-8eff-33abe42cb3a6 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:50 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a0d9a76d-1916-4b3e-8eff-33abe42cb3a6 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:50 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a0d9a76d-1916-4b3e-8eff-33abe42cb3a6 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a0d9a76d-1916-4b3e-8eff-33abe42cb3a6 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a0d9a76d-1916-4b3e-8eff-33abe42cb3a6 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:50 devstack sudo[101061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:41:50 devstack sudo[101061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:51 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-30351f4f-8ddb-40a2-ba39-53bed027b923 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Acquiring lock "cinder-5e405321-08c7-4e29-af85-05b077a06f08-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:51 devstack sudo[101061]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a0d9a76d-1916-4b3e-8eff-33abe42cb3a6 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.337s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:51 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-a0d9a76d-1916-4b3e-8eff-33abe42cb3a6 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:41:51 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-a0d9a76d-1916-4b3e-8eff-33abe42cb3a6 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Deleted volume successfully. Nov 03 07:41:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-171f62ae-cb45-40da-8218-7a78e8a878a2 tempest-VolumesSnapshotListTestJSON-915826739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-171f62ae-cb45-40da-8218-7a78e8a878a2 tempest-VolumesSnapshotListTestJSON-915826739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:51 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-30351f4f-8ddb-40a2-ba39-53bed027b923 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Lock "cinder-5e405321-08c7-4e29-af85-05b077a06f08-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:51 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-171f62ae-cb45-40da-8218-7a78e8a878a2 tempest-VolumesSnapshotListTestJSON-915826739 None] Creating offline snapshot a7da88ec-eed9-476b-b5fd-3995dcc6865c of volume 42ac3525-dd20-4c52-b0c9-e994ec1c849d {{(pid=86875) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:41:51 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a0d9a76d-1916-4b3e-8eff-33abe42cb3a6 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Lock "cinder-94857b92-f032-4ee6-9703-f7d6fbac9fc3-delete_volume" released by "delete_volume" :: held 1.454s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:51 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[0676eff9-866b-4d1c-bd7e-eb7fc8b6d18b]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-171f62ae-cb45-40da-8218-7a78e8a878a2 tempest-VolumesSnapshotListTestJSON-915826739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.7262ad20-0195-4091-ae1e-de02589326e4 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:51 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-30351f4f-8ddb-40a2-ba39-53bed027b923 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Acquiring lock "cinder-quobyte-5e405321-08c7-4e29-af85-05b077a06f08" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:51 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-30351f4f-8ddb-40a2-ba39-53bed027b923 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Lock "cinder-quobyte-5e405321-08c7-4e29-af85-05b077a06f08" acquired by "delete_volume" :: waited 0.022s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:51 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb10383f-110f-4e35-bdd7-630e2e6d8e7f]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-30351f4f-8ddb-40a2-ba39-53bed027b923 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5e405321-08c7-4e29-af85-05b077a06f08 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:51 devstack sudo[101064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.7262ad20-0195-4091-ae1e-de02589326e4 Nov 03 07:41:51 devstack sudo[101064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:51 devstack sudo[101065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5e405321-08c7-4e29-af85-05b077a06f08 Nov 03 07:41:51 devstack sudo[101065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:51 devstack sudo[101064]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-171f62ae-cb45-40da-8218-7a78e8a878a2 tempest-VolumesSnapshotListTestJSON-915826739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.7262ad20-0195-4091-ae1e-de02589326e4" returned: 0 in 0.605s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:51 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-171f62ae-cb45-40da-8218-7a78e8a878a2 tempest-VolumesSnapshotListTestJSON-915826739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:41:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-171f62ae-cb45-40da-8218-7a78e8a878a2 tempest-VolumesSnapshotListTestJSON-915826739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.7262ad20-0195-4091-ae1e-de02589326e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.a7da88ec-eed9-476b-b5fd-3995dcc6865c 1G {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:52 devstack sudo[101074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.7262ad20-0195-4091-ae1e-de02589326e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.a7da88ec-eed9-476b-b5fd-3995dcc6865c 1G Nov 03 07:41:52 devstack sudo[101074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:52 devstack sudo[101065]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-30351f4f-8ddb-40a2-ba39-53bed027b923 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5e405321-08c7-4e29-af85-05b077a06f08" returned: 0 in 0.554s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-30351f4f-8ddb-40a2-ba39-53bed027b923 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5e405321-08c7-4e29-af85-05b077a06f08 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:52 devstack sudo[101076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5e405321-08c7-4e29-af85-05b077a06f08 Nov 03 07:41:52 devstack sudo[101076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:52 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdcc7c4e-0ccf-4c40-bdde-fc2451d08ed2 tempest-GroupSnapshotsV319Test-1260412742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:41:52 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fdcc7c4e-0ccf-4c40-bdde-fc2451d08ed2 tempest-GroupSnapshotsV319Test-1260412742 None] Flow 'volume_create_manager' (c959350f-96ab-4238-a442-6f48ca863ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:52 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fdcc7c4e-0ccf-4c40-bdde-fc2451d08ed2 tempest-GroupSnapshotsV319Test-1260412742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e47d88d-61e5-4db0-a2d9-ce1a6049e0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:52 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fdcc7c4e-0ccf-4c40-bdde-fc2451d08ed2 tempest-GroupSnapshotsV319Test-1260412742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e47d88d-61e5-4db0-a2d9-ce1a6049e0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2105690095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0b6b9590-c790-4929-9567-b1119e06067a,host='devstack@QuobyteHD#QuobyteHD',id=f9ef9b35-1a8f-470e-99f0-3e4286ea5d18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75cb528fe8da48bb9989aec858139caa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:52Z,use_quota=True,user_id='b446fcf7d3694d978fc0d48735d4eb16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b61efc2-1ed1-4789-bec2-ea55ffbda28f),volume_type_id=8b61efc2-1ed1-4789-bec2-ea55ffbda28f)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:52 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fdcc7c4e-0ccf-4c40-bdde-fc2451d08ed2 tempest-GroupSnapshotsV319Test-1260412742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcca92fd-c848-4e41-8159-ba1fa1fe63b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:52 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fdcc7c4e-0ccf-4c40-bdde-fc2451d08ed2 tempest-GroupSnapshotsV319Test-1260412742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcca92fd-c848-4e41-8159-ba1fa1fe63b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:52 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fdcc7c4e-0ccf-4c40-bdde-fc2451d08ed2 tempest-GroupSnapshotsV319Test-1260412742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6de9a89a-eb05-4b1c-9f5c-5e703dd6255d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:52 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fdcc7c4e-0ccf-4c40-bdde-fc2451d08ed2 tempest-GroupSnapshotsV319Test-1260412742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6de9a89a-eb05-4b1c-9f5c-5e703dd6255d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9ef9b35-1a8f-470e-99f0-3e4286ea5d18', 'volume_name': 'volume-f9ef9b35-1a8f-470e-99f0-3e4286ea5d18', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:52 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fdcc7c4e-0ccf-4c40-bdde-fc2451d08ed2 tempest-GroupSnapshotsV319Test-1260412742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fd8aea4-48db-4d4a-8ce3-73d51496aeee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:52 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fdcc7c4e-0ccf-4c40-bdde-fc2451d08ed2 tempest-GroupSnapshotsV319Test-1260412742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fd8aea4-48db-4d4a-8ce3-73d51496aeee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:52 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fdcc7c4e-0ccf-4c40-bdde-fc2451d08ed2 tempest-GroupSnapshotsV319Test-1260412742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (841afa42-f48a-45c9-bfed-f6e48e254f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:52 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-fdcc7c4e-0ccf-4c40-bdde-fc2451d08ed2 tempest-GroupSnapshotsV319Test-1260412742 None] Volume f9ef9b35-1a8f-470e-99f0-3e4286ea5d18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9ef9b35-1a8f-470e-99f0-3e4286ea5d18', 'volume_size': 1} Nov 03 07:41:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-fdcc7c4e-0ccf-4c40-bdde-fc2451d08ed2 tempest-GroupSnapshotsV319Test-1260412742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:52 devstack sudo[101076]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-30351f4f-8ddb-40a2-ba39-53bed027b923 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5e405321-08c7-4e29-af85-05b077a06f08" returned: 0 in 0.355s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:52 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-30351f4f-8ddb-40a2-ba39-53bed027b923 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Lock "cinder-quobyte-5e405321-08c7-4e29-af85-05b077a06f08" released by "delete_volume" :: held 0.989s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:52 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-30351f4f-8ddb-40a2-ba39-53bed027b923 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Created reservations ['559f97a6-b4e2-4008-859c-1a016dc524a3', '90261b0c-d9ea-48ae-8040-14ef086359e5', '01914bf4-c285-4379-865c-85df76ba618a', '8003276e-d2e2-41a1-befa-16e2fa147231'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:41:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-30351f4f-8ddb-40a2-ba39-53bed027b923 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-30351f4f-8ddb-40a2-ba39-53bed027b923 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:52 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-30351f4f-8ddb-40a2-ba39-53bed027b923 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:52 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-30351f4f-8ddb-40a2-ba39-53bed027b923 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-30351f4f-8ddb-40a2-ba39-53bed027b923 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-30351f4f-8ddb-40a2-ba39-53bed027b923 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:52 devstack sudo[101083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:41:52 devstack sudo[101083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:52 devstack sudo[101074]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-171f62ae-cb45-40da-8218-7a78e8a878a2 tempest-VolumesSnapshotListTestJSON-915826739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.7262ad20-0195-4091-ae1e-de02589326e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.a7da88ec-eed9-476b-b5fd-3995dcc6865c 1G" returned: 0 in 0.716s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-171f62ae-cb45-40da-8218-7a78e8a878a2 tempest-VolumesSnapshotListTestJSON-915826739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.7262ad20-0195-4091-ae1e-de02589326e4 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.a7da88ec-eed9-476b-b5fd-3995dcc6865c {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:52 devstack sudo[101085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.7262ad20-0195-4091-ae1e-de02589326e4 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.a7da88ec-eed9-476b-b5fd-3995dcc6865c Nov 03 07:41:52 devstack sudo[101085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:52 devstack sudo[101083]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-30351f4f-8ddb-40a2-ba39-53bed027b923 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.328s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:52 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-30351f4f-8ddb-40a2-ba39-53bed027b923 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:41:52 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-30351f4f-8ddb-40a2-ba39-53bed027b923 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Deleted volume successfully. Nov 03 07:41:52 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-30351f4f-8ddb-40a2-ba39-53bed027b923 tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Lock "cinder-5e405321-08c7-4e29-af85-05b077a06f08-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:53 devstack sudo[101085]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-171f62ae-cb45-40da-8218-7a78e8a878a2 tempest-VolumesSnapshotListTestJSON-915826739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.7262ad20-0195-4091-ae1e-de02589326e4 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.a7da88ec-eed9-476b-b5fd-3995dcc6865c" returned: 0 in 0.365s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:53 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-171f62ae-cb45-40da-8218-7a78e8a878a2 tempest-VolumesSnapshotListTestJSON-915826739 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.a7da88ec-eed9-476b-b5fd-3995dcc6865c is being set with open permissions: ugo+rw Nov 03 07:41:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-171f62ae-cb45-40da-8218-7a78e8a878a2 tempest-VolumesSnapshotListTestJSON-915826739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.a7da88ec-eed9-476b-b5fd-3995dcc6865c {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:53 devstack sudo[101092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.a7da88ec-eed9-476b-b5fd-3995dcc6865c Nov 03 07:41:53 devstack sudo[101092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:53 devstack sudo[101092]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-171f62ae-cb45-40da-8218-7a78e8a878a2 tempest-VolumesSnapshotListTestJSON-915826739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.a7da88ec-eed9-476b-b5fd-3995dcc6865c" returned: 0 in 0.278s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-171f62ae-cb45-40da-8218-7a78e8a878a2 tempest-VolumesSnapshotListTestJSON-915826739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.167s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-fdcc7c4e-0ccf-4c40-bdde-fc2451d08ed2 tempest-GroupSnapshotsV319Test-1260412742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.138s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:53 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-fdcc7c4e-0ccf-4c40-bdde-fc2451d08ed2 tempest-GroupSnapshotsV319Test-1260412742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0b6b9590-c790-4929-9567-b1119e06067a,created_at=2026-11-03T06:41:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2105690095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0b6b9590-c790-4929-9567-b1119e06067a,host='devstack@QuobyteHD#QuobyteHD',id=f9ef9b35-1a8f-470e-99f0-3e4286ea5d18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75cb528fe8da48bb9989aec858139caa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:52Z,use_quota=True,user_id='b446fcf7d3694d978fc0d48735d4eb16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b61efc2-1ed1-4789-bec2-ea55ffbda28f),volume_type_id=8b61efc2-1ed1-4789-bec2-ea55ffbda28f)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:41:53 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-fdcc7c4e-0ccf-4c40-bdde-fc2451d08ed2 tempest-GroupSnapshotsV319Test-1260412742 None] Creating volume f9ef9b35-1a8f-470e-99f0-3e4286ea5d18 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:41:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-fdcc7c4e-0ccf-4c40-bdde-fc2451d08ed2 tempest-GroupSnapshotsV319Test-1260412742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-fdcc7c4e-0ccf-4c40-bdde-fc2451d08ed2 tempest-GroupSnapshotsV319Test-1260412742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:53 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-fdcc7c4e-0ccf-4c40-bdde-fc2451d08ed2 tempest-GroupSnapshotsV319Test-1260412742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:53 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-fdcc7c4e-0ccf-4c40-bdde-fc2451d08ed2 tempest-GroupSnapshotsV319Test-1260412742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-fdcc7c4e-0ccf-4c40-bdde-fc2451d08ed2 tempest-GroupSnapshotsV319Test-1260412742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:53 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-fdcc7c4e-0ccf-4c40-bdde-fc2451d08ed2 tempest-GroupSnapshotsV319Test-1260412742 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:41:53 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-fdcc7c4e-0ccf-4c40-bdde-fc2451d08ed2 tempest-GroupSnapshotsV319Test-1260412742 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:41:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fdcc7c4e-0ccf-4c40-bdde-fc2451d08ed2 tempest-GroupSnapshotsV319Test-1260412742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9ef9b35-1a8f-470e-99f0-3e4286ea5d18 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:53 devstack sudo[101095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9ef9b35-1a8f-470e-99f0-3e4286ea5d18 1073741824 Nov 03 07:41:53 devstack sudo[101095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:53 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-171f62ae-cb45-40da-8218-7a78e8a878a2 tempest-VolumesSnapshotListTestJSON-915826739 None] Create snapshot completed successfully Nov 03 07:41:53 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-757f79ac-8b45-405d-83ed-f4820253257a tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Acquiring lock "cinder-431f662e-e326-4e39-a61a-3a3f22b5eb09-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:53 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-757f79ac-8b45-405d-83ed-f4820253257a tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Lock "cinder-431f662e-e326-4e39-a61a-3a3f22b5eb09-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:53 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-757f79ac-8b45-405d-83ed-f4820253257a tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Acquiring lock "cinder-quobyte-431f662e-e326-4e39-a61a-3a3f22b5eb09" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:53 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-757f79ac-8b45-405d-83ed-f4820253257a tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Lock "cinder-quobyte-431f662e-e326-4e39-a61a-3a3f22b5eb09" acquired by "delete_volume" :: waited 0.019s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:53 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[088193ed-8f63-4eaa-82d0-a0f27610fdb6]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-757f79ac-8b45-405d-83ed-f4820253257a tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-431f662e-e326-4e39-a61a-3a3f22b5eb09 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:53 devstack sudo[101097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-431f662e-e326-4e39-a61a-3a3f22b5eb09 Nov 03 07:41:53 devstack sudo[101097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:54 devstack sudo[101095]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fdcc7c4e-0ccf-4c40-bdde-fc2451d08ed2 tempest-GroupSnapshotsV319Test-1260412742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9ef9b35-1a8f-470e-99f0-3e4286ea5d18 1073741824" returned: 0 in 0.730s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:54 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:SELECT=152,cinder:UPDATE=194,cinder:DELETE=9,cinder:INSERT=43 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:41:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fdcc7c4e-0ccf-4c40-bdde-fc2451d08ed2 tempest-GroupSnapshotsV319Test-1260412742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9ef9b35-1a8f-470e-99f0-3e4286ea5d18 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:54 devstack sudo[101106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9ef9b35-1a8f-470e-99f0-3e4286ea5d18 Nov 03 07:41:54 devstack sudo[101106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:54 devstack sudo[101097]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-757f79ac-8b45-405d-83ed-f4820253257a tempest-CreateVolumesFromSourceVolumeTest-827262967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-431f662e-e326-4e39-a61a-3a3f22b5eb09" returned: 0 in 0.530s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-757f79ac-8b45-405d-83ed-f4820253257a tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-431f662e-e326-4e39-a61a-3a3f22b5eb09 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:54 devstack sudo[101108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-431f662e-e326-4e39-a61a-3a3f22b5eb09 Nov 03 07:41:54 devstack sudo[101108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-89b2b38b-d009-4850-9298-fb2eaa04c2f2 tempest-VolumesSnapshotListTestJSON-915826739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:54 devstack sudo[101106]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fdcc7c4e-0ccf-4c40-bdde-fc2451d08ed2 tempest-GroupSnapshotsV319Test-1260412742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9ef9b35-1a8f-470e-99f0-3e4286ea5d18" returned: 0 in 0.477s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:54 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-fdcc7c4e-0ccf-4c40-bdde-fc2451d08ed2 tempest-GroupSnapshotsV319Test-1260412742 None] <== create_volume: return (1270ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:41:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-fdcc7c4e-0ccf-4c40-bdde-fc2451d08ed2 tempest-GroupSnapshotsV319Test-1260412742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.275s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-89b2b38b-d009-4850-9298-fb2eaa04c2f2 tempest-VolumesSnapshotListTestJSON-915826739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.023s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:54 devstack sudo[101108]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:54 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-89b2b38b-d009-4850-9298-fb2eaa04c2f2 tempest-VolumesSnapshotListTestJSON-915826739 None] Creating offline snapshot 506e21d4-5973-4434-9828-607514aa1725 of volume 42ac3525-dd20-4c52-b0c9-e994ec1c849d {{(pid=86875) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:41:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-757f79ac-8b45-405d-83ed-f4820253257a tempest-CreateVolumesFromSourceVolumeTest-827262967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-431f662e-e326-4e39-a61a-3a3f22b5eb09" returned: 0 in 0.505s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:54 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fdcc7c4e-0ccf-4c40-bdde-fc2451d08ed2 tempest-GroupSnapshotsV319Test-1260412742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (841afa42-f48a-45c9-bfed-f6e48e254f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9ef9b35-1a8f-470e-99f0-3e4286ea5d18', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:54 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fdcc7c4e-0ccf-4c40-bdde-fc2451d08ed2 tempest-GroupSnapshotsV319Test-1260412742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dad8ecbd-9a7b-4ac3-ac62-80ac25ce6016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:54 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd8bb2b-a387-4068-8420-0d8a7417439b]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-89b2b38b-d009-4850-9298-fb2eaa04c2f2 tempest-VolumesSnapshotListTestJSON-915826739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.a7da88ec-eed9-476b-b5fd-3995dcc6865c {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:54 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-757f79ac-8b45-405d-83ed-f4820253257a tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Lock "cinder-quobyte-431f662e-e326-4e39-a61a-3a3f22b5eb09" released by "delete_volume" :: held 1.137s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:54 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-fdcc7c4e-0ccf-4c40-bdde-fc2451d08ed2 tempest-GroupSnapshotsV319Test-1260412742 None] Volume volume-f9ef9b35-1a8f-470e-99f0-3e4286ea5d18 (f9ef9b35-1a8f-470e-99f0-3e4286ea5d18): created successfully Nov 03 07:41:54 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fdcc7c4e-0ccf-4c40-bdde-fc2451d08ed2 tempest-GroupSnapshotsV319Test-1260412742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dad8ecbd-9a7b-4ac3-ac62-80ac25ce6016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:54 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fdcc7c4e-0ccf-4c40-bdde-fc2451d08ed2 tempest-GroupSnapshotsV319Test-1260412742 None] Flow 'volume_create_manager' (c959350f-96ab-4238-a442-6f48ca863ea2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:54 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-fdcc7c4e-0ccf-4c40-bdde-fc2451d08ed2 tempest-GroupSnapshotsV319Test-1260412742 None] Created volume successfully. Nov 03 07:41:54 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-757f79ac-8b45-405d-83ed-f4820253257a tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Created reservations ['7978fc19-a41c-4a5e-ae7e-4f75d0d54e21', '0e0ec26e-fdf6-40f0-9fa1-ab462e827931', 'b6dbec52-171f-4ced-9669-cf9695c3ce67', '0d260002-1362-4d71-b92b-fed73c1357eb'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:41:54 devstack sudo[101112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.a7da88ec-eed9-476b-b5fd-3995dcc6865c Nov 03 07:41:54 devstack sudo[101112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-757f79ac-8b45-405d-83ed-f4820253257a tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-757f79ac-8b45-405d-83ed-f4820253257a tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:54 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-757f79ac-8b45-405d-83ed-f4820253257a tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:54 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-757f79ac-8b45-405d-83ed-f4820253257a tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-757f79ac-8b45-405d-83ed-f4820253257a tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-757f79ac-8b45-405d-83ed-f4820253257a tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:55 devstack sudo[101114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:41:55 devstack sudo[101114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:55 devstack sudo[101112]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-89b2b38b-d009-4850-9298-fb2eaa04c2f2 tempest-VolumesSnapshotListTestJSON-915826739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.a7da88ec-eed9-476b-b5fd-3995dcc6865c" returned: 0 in 0.450s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:55 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-89b2b38b-d009-4850-9298-fb2eaa04c2f2 tempest-VolumesSnapshotListTestJSON-915826739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:41:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-89b2b38b-d009-4850-9298-fb2eaa04c2f2 tempest-VolumesSnapshotListTestJSON-915826739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.a7da88ec-eed9-476b-b5fd-3995dcc6865c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.506e21d4-5973-4434-9828-607514aa1725 1G {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:55 devstack sudo[101120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.a7da88ec-eed9-476b-b5fd-3995dcc6865c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.506e21d4-5973-4434-9828-607514aa1725 1G Nov 03 07:41:55 devstack sudo[101120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:55 devstack sudo[101114]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-757f79ac-8b45-405d-83ed-f4820253257a tempest-CreateVolumesFromSourceVolumeTest-827262967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.307s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:55 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-757f79ac-8b45-405d-83ed-f4820253257a tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:41:55 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-757f79ac-8b45-405d-83ed-f4820253257a tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Deleted volume successfully. Nov 03 07:41:55 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-757f79ac-8b45-405d-83ed-f4820253257a tempest-CreateVolumesFromSourceVolumeTest-827262967 None] Lock "cinder-431f662e-e326-4e39-a61a-3a3f22b5eb09-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:41:55 devstack sudo[101120]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-89b2b38b-d009-4850-9298-fb2eaa04c2f2 tempest-VolumesSnapshotListTestJSON-915826739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.a7da88ec-eed9-476b-b5fd-3995dcc6865c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.506e21d4-5973-4434-9828-607514aa1725 1G" returned: 0 in 0.622s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-89b2b38b-d009-4850-9298-fb2eaa04c2f2 tempest-VolumesSnapshotListTestJSON-915826739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.a7da88ec-eed9-476b-b5fd-3995dcc6865c -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.506e21d4-5973-4434-9828-607514aa1725 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:55 devstack sudo[101126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.a7da88ec-eed9-476b-b5fd-3995dcc6865c -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.506e21d4-5973-4434-9828-607514aa1725 Nov 03 07:41:55 devstack sudo[101126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:55 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-795b5245-e82b-486c-9db2-5290b68db677 tempest-GroupSnapshotsV319Test-1260412742 None] GroupSnapshot cb55df88-81de-4344-adcc-591b7afe2aa2: creating. Nov 03 07:41:56 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-795b5245-e82b-486c-9db2-5290b68db677 tempest-GroupSnapshotsV319Test-1260412742 None] Group snapshot cb55df88-81de-4344-adcc-591b7afe2aa2: creating. {{(pid=86875) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 03 07:41:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-795b5245-e82b-486c-9db2-5290b68db677 tempest-GroupSnapshotsV319Test-1260412742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:56 devstack sudo[101126]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-89b2b38b-d009-4850-9298-fb2eaa04c2f2 tempest-VolumesSnapshotListTestJSON-915826739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.a7da88ec-eed9-476b-b5fd-3995dcc6865c -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.506e21d4-5973-4434-9828-607514aa1725" returned: 0 in 0.371s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:56 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-89b2b38b-d009-4850-9298-fb2eaa04c2f2 tempest-VolumesSnapshotListTestJSON-915826739 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.506e21d4-5973-4434-9828-607514aa1725 is being set with open permissions: ugo+rw Nov 03 07:41:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-89b2b38b-d009-4850-9298-fb2eaa04c2f2 tempest-VolumesSnapshotListTestJSON-915826739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.506e21d4-5973-4434-9828-607514aa1725 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:56 devstack sudo[101131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.506e21d4-5973-4434-9828-607514aa1725 Nov 03 07:41:56 devstack sudo[101131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:56 devstack sudo[101131]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-89b2b38b-d009-4850-9298-fb2eaa04c2f2 tempest-VolumesSnapshotListTestJSON-915826739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.506e21d4-5973-4434-9828-607514aa1725" returned: 0 in 0.300s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-89b2b38b-d009-4850-9298-fb2eaa04c2f2 tempest-VolumesSnapshotListTestJSON-915826739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.930s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-795b5245-e82b-486c-9db2-5290b68db677 tempest-GroupSnapshotsV319Test-1260412742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.571s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:56 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-795b5245-e82b-486c-9db2-5290b68db677 tempest-GroupSnapshotsV319Test-1260412742 None] Creating offline snapshot 89f0a44a-b203-4ad6-82e7-2b56ed686182 of volume f9ef9b35-1a8f-470e-99f0-3e4286ea5d18 {{(pid=86875) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:41:56 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-89b2b38b-d009-4850-9298-fb2eaa04c2f2 tempest-VolumesSnapshotListTestJSON-915826739 None] Create snapshot completed successfully Nov 03 07:41:56 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce53408-0c91-49b0-a882-d745a4fd8709]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-795b5245-e82b-486c-9db2-5290b68db677 tempest-GroupSnapshotsV319Test-1260412742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9ef9b35-1a8f-470e-99f0-3e4286ea5d18 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:56 devstack sudo[101134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9ef9b35-1a8f-470e-99f0-3e4286ea5d18 Nov 03 07:41:56 devstack sudo[101134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:57 devstack sudo[101134]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-795b5245-e82b-486c-9db2-5290b68db677 tempest-GroupSnapshotsV319Test-1260412742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9ef9b35-1a8f-470e-99f0-3e4286ea5d18" returned: 0 in 0.596s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-795b5245-e82b-486c-9db2-5290b68db677 tempest-GroupSnapshotsV319Test-1260412742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9ef9b35-1a8f-470e-99f0-3e4286ea5d18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9ef9b35-1a8f-470e-99f0-3e4286ea5d18.89f0a44a-b203-4ad6-82e7-2b56ed686182 1G {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:57 devstack sudo[101139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9ef9b35-1a8f-470e-99f0-3e4286ea5d18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9ef9b35-1a8f-470e-99f0-3e4286ea5d18.89f0a44a-b203-4ad6-82e7-2b56ed686182 1G Nov 03 07:41:57 devstack sudo[101139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:57 devstack sudo[101139]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-795b5245-e82b-486c-9db2-5290b68db677 tempest-GroupSnapshotsV319Test-1260412742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9ef9b35-1a8f-470e-99f0-3e4286ea5d18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9ef9b35-1a8f-470e-99f0-3e4286ea5d18.89f0a44a-b203-4ad6-82e7-2b56ed686182 1G" returned: 0 in 0.705s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-795b5245-e82b-486c-9db2-5290b68db677 tempest-GroupSnapshotsV319Test-1260412742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9ef9b35-1a8f-470e-99f0-3e4286ea5d18 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9ef9b35-1a8f-470e-99f0-3e4286ea5d18.89f0a44a-b203-4ad6-82e7-2b56ed686182 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:58 devstack sudo[101146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9ef9b35-1a8f-470e-99f0-3e4286ea5d18 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9ef9b35-1a8f-470e-99f0-3e4286ea5d18.89f0a44a-b203-4ad6-82e7-2b56ed686182 Nov 03 07:41:58 devstack sudo[101146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:58 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ed4c632c-5e79-40b3-80a0-1acc6cdbc179 tempest-VolumesSnapshotListTestJSON-915826739 None] Acquiring lock "cinder-506e21d4-5973-4434-9828-607514aa1725-delete_snapshot" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:58 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ed4c632c-5e79-40b3-80a0-1acc6cdbc179 tempest-VolumesSnapshotListTestJSON-915826739 None] Lock "cinder-506e21d4-5973-4434-9828-607514aa1725-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:58 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ed4c632c-5e79-40b3-80a0-1acc6cdbc179 tempest-VolumesSnapshotListTestJSON-915826739 None] Acquiring lock "cinder-quobyte-42ac3525-dd20-4c52-b0c9-e994ec1c849d" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:58 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ed4c632c-5e79-40b3-80a0-1acc6cdbc179 tempest-VolumesSnapshotListTestJSON-915826739 None] Lock "cinder-quobyte-42ac3525-dd20-4c52-b0c9-e994ec1c849d" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:58 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ed4c632c-5e79-40b3-80a0-1acc6cdbc179 tempest-VolumesSnapshotListTestJSON-915826739 None] Acquiring lock "cinder-quobyte-506e21d4-5973-4434-9828-607514aa1725" by "_delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:41:58 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ed4c632c-5e79-40b3-80a0-1acc6cdbc179 tempest-VolumesSnapshotListTestJSON-915826739 None] Lock "cinder-quobyte-506e21d4-5973-4434-9828-607514aa1725" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:41:58 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-ed4c632c-5e79-40b3-80a0-1acc6cdbc179 tempest-VolumesSnapshotListTestJSON-915826739 None] Deleting offline snapshot 506e21d4-5973-4434-9828-607514aa1725 of volume 42ac3525-dd20-4c52-b0c9-e994ec1c849d {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:41:58 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-ed4c632c-5e79-40b3-80a0-1acc6cdbc179 tempest-VolumesSnapshotListTestJSON-915826739 None] snapshot_file for this snap is: volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.506e21d4-5973-4434-9828-607514aa1725 {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:41:58 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[942b6432-8eaa-40e0-b0f1-aa6822105af4]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ed4c632c-5e79-40b3-80a0-1acc6cdbc179 tempest-VolumesSnapshotListTestJSON-915826739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.506e21d4-5973-4434-9828-607514aa1725 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:58 devstack sudo[101146]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-795b5245-e82b-486c-9db2-5290b68db677 tempest-GroupSnapshotsV319Test-1260412742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9ef9b35-1a8f-470e-99f0-3e4286ea5d18 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9ef9b35-1a8f-470e-99f0-3e4286ea5d18.89f0a44a-b203-4ad6-82e7-2b56ed686182" returned: 0 in 0.534s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:58 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-795b5245-e82b-486c-9db2-5290b68db677 tempest-GroupSnapshotsV319Test-1260412742 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9ef9b35-1a8f-470e-99f0-3e4286ea5d18.89f0a44a-b203-4ad6-82e7-2b56ed686182 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 07:41:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-795b5245-e82b-486c-9db2-5290b68db677 tempest-GroupSnapshotsV319Test-1260412742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9ef9b35-1a8f-470e-99f0-3e4286ea5d18.89f0a44a-b203-4ad6-82e7-2b56ed686182 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:58 devstack sudo[101152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9ef9b35-1a8f-470e-99f0-3e4286ea5d18.89f0a44a-b203-4ad6-82e7-2b56ed686182 Nov 03 07:41:58 devstack sudo[101151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.506e21d4-5973-4434-9828-607514aa1725 Nov 03 07:41:58 devstack sudo[101151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:58 devstack sudo[101152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:58 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b9c017b-fadc-4827-adc2-ee6ca4e7dc4a tempest-TestStampPattern-389950066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:41:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-1b9c017b-fadc-4827-adc2-ee6ca4e7dc4a tempest-TestStampPattern-389950066 None] Flow 'volume_create_manager' (1f84ecdc-125a-45b4-af30-e202071c9deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:41:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-1b9c017b-fadc-4827-adc2-ee6ca4e7dc4a tempest-TestStampPattern-389950066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b37ae66c-07b6-44ed-b334-41c1d1c5d1a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-1b9c017b-fadc-4827-adc2-ee6ca4e7dc4a tempest-TestStampPattern-389950066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b37ae66c-07b6-44ed-b334-41c1d1c5d1a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1740002480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9118d4a4-1e9c-4c31-b4e8-9b48cad4a771,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5955babb10394b628242793a9e918848',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:59Z,use_quota=True,user_id='8a04ead9cb7f4d189c52bb02fa81fa14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-1b9c017b-fadc-4827-adc2-ee6ca4e7dc4a tempest-TestStampPattern-389950066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06f6a67a-215a-4cd1-80c5-dfe8e6bf0e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-1b9c017b-fadc-4827-adc2-ee6ca4e7dc4a tempest-TestStampPattern-389950066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06f6a67a-215a-4cd1-80c5-dfe8e6bf0e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-1b9c017b-fadc-4827-adc2-ee6ca4e7dc4a tempest-TestStampPattern-389950066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (071db65c-ea29-4039-9361-ac89b86bb118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-1b9c017b-fadc-4827-adc2-ee6ca4e7dc4a tempest-TestStampPattern-389950066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (071db65c-ea29-4039-9361-ac89b86bb118) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9118d4a4-1e9c-4c31-b4e8-9b48cad4a771', 'volume_name': 'volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-1b9c017b-fadc-4827-adc2-ee6ca4e7dc4a tempest-TestStampPattern-389950066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5edb270-85d2-4fd3-8060-35e85c30debd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-1b9c017b-fadc-4827-adc2-ee6ca4e7dc4a tempest-TestStampPattern-389950066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5edb270-85d2-4fd3-8060-35e85c30debd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:41:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-1b9c017b-fadc-4827-adc2-ee6ca4e7dc4a tempest-TestStampPattern-389950066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c930ab8-7a20-4ae7-aafe-ec0292ff2164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:41:58 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-1b9c017b-fadc-4827-adc2-ee6ca4e7dc4a tempest-TestStampPattern-389950066 None] Volume 9118d4a4-1e9c-4c31-b4e8-9b48cad4a771: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771', 'volume_size': 1} Nov 03 07:41:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-1b9c017b-fadc-4827-adc2-ee6ca4e7dc4a tempest-TestStampPattern-389950066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:58 devstack sudo[101152]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-795b5245-e82b-486c-9db2-5290b68db677 tempest-GroupSnapshotsV319Test-1260412742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9ef9b35-1a8f-470e-99f0-3e4286ea5d18.89f0a44a-b203-4ad6-82e7-2b56ed686182" returned: 0 in 0.390s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:58 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:UPDATE=189,cinder:SELECT=168,cinder:INSERT=48,cinder:DELETE=18 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:41:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-795b5245-e82b-486c-9db2-5290b68db677 tempest-GroupSnapshotsV319Test-1260412742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9ef9b35-1a8f-470e-99f0-3e4286ea5d18.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:58 devstack sudo[101151]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ed4c632c-5e79-40b3-80a0-1acc6cdbc179 tempest-VolumesSnapshotListTestJSON-915826739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.506e21d4-5973-4434-9828-607514aa1725" returned: 0 in 0.532s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:58 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-ed4c632c-5e79-40b3-80a0-1acc6cdbc179 tempest-VolumesSnapshotListTestJSON-915826739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:41:58 devstack sudo[101160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9ef9b35-1a8f-470e-99f0-3e4286ea5d18.info Nov 03 07:41:58 devstack sudo[101160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:58 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d30d9e-9b7e-45bb-a14c-08d144870df7]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:41:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ed4c632c-5e79-40b3-80a0-1acc6cdbc179 tempest-VolumesSnapshotListTestJSON-915826739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.a7da88ec-eed9-476b-b5fd-3995dcc6865c {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:59 devstack sudo[101162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.a7da88ec-eed9-476b-b5fd-3995dcc6865c Nov 03 07:41:59 devstack sudo[101162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:59 devstack sudo[101160]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-795b5245-e82b-486c-9db2-5290b68db677 tempest-GroupSnapshotsV319Test-1260412742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9ef9b35-1a8f-470e-99f0-3e4286ea5d18.info" returned: 0 in 0.341s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:59 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-795b5245-e82b-486c-9db2-5290b68db677 tempest-GroupSnapshotsV319Test-1260412742 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9ef9b35-1a8f-470e-99f0-3e4286ea5d18.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 07:41:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-795b5245-e82b-486c-9db2-5290b68db677 tempest-GroupSnapshotsV319Test-1260412742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9ef9b35-1a8f-470e-99f0-3e4286ea5d18.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:59 devstack sudo[101165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9ef9b35-1a8f-470e-99f0-3e4286ea5d18.info Nov 03 07:41:59 devstack sudo[101165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:59 devstack sudo[101162]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ed4c632c-5e79-40b3-80a0-1acc6cdbc179 tempest-VolumesSnapshotListTestJSON-915826739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.a7da88ec-eed9-476b-b5fd-3995dcc6865c" returned: 0 in 0.499s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:59 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-ed4c632c-5e79-40b3-80a0-1acc6cdbc179 tempest-VolumesSnapshotListTestJSON-915826739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:41:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ed4c632c-5e79-40b3-80a0-1acc6cdbc179 tempest-VolumesSnapshotListTestJSON-915826739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.506e21d4-5973-4434-9828-607514aa1725 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:59 devstack sudo[101171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.506e21d4-5973-4434-9828-607514aa1725 Nov 03 07:41:59 devstack sudo[101171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:59 devstack sudo[101165]: pam_unix(sudo:session): session closed for user root Nov 03 07:41:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-795b5245-e82b-486c-9db2-5290b68db677 tempest-GroupSnapshotsV319Test-1260412742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9ef9b35-1a8f-470e-99f0-3e4286ea5d18.info" returned: 0 in 0.315s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:41:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-795b5245-e82b-486c-9db2-5290b68db677 tempest-GroupSnapshotsV319Test-1260412742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.023s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-1b9c017b-fadc-4827-adc2-ee6ca4e7dc4a tempest-TestStampPattern-389950066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.804s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:59 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-1b9c017b-fadc-4827-adc2-ee6ca4e7dc4a tempest-TestStampPattern-389950066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:41:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1740002480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9118d4a4-1e9c-4c31-b4e8-9b48cad4a771,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5955babb10394b628242793a9e918848',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:41:59Z,use_quota=True,user_id='8a04ead9cb7f4d189c52bb02fa81fa14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:41:59 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-1b9c017b-fadc-4827-adc2-ee6ca4e7dc4a tempest-TestStampPattern-389950066 None] Creating volume 9118d4a4-1e9c-4c31-b4e8-9b48cad4a771 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:41:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-1b9c017b-fadc-4827-adc2-ee6ca4e7dc4a tempest-TestStampPattern-389950066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:41:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-1b9c017b-fadc-4827-adc2-ee6ca4e7dc4a tempest-TestStampPattern-389950066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:41:59 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-1b9c017b-fadc-4827-adc2-ee6ca4e7dc4a tempest-TestStampPattern-389950066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:41:59 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-1b9c017b-fadc-4827-adc2-ee6ca4e7dc4a tempest-TestStampPattern-389950066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:41:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-1b9c017b-fadc-4827-adc2-ee6ca4e7dc4a tempest-TestStampPattern-389950066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:41:59 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-1b9c017b-fadc-4827-adc2-ee6ca4e7dc4a tempest-TestStampPattern-389950066 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:41:59 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-1b9c017b-fadc-4827-adc2-ee6ca4e7dc4a tempest-TestStampPattern-389950066 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:41:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1b9c017b-fadc-4827-adc2-ee6ca4e7dc4a tempest-TestStampPattern-389950066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:41:59 devstack sudo[101177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771 1073741824 Nov 03 07:41:59 devstack sudo[101177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:41:59 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-795b5245-e82b-486c-9db2-5290b68db677 tempest-GroupSnapshotsV319Test-1260412742 None] group_snapshot cb55df88-81de-4344-adcc-591b7afe2aa2: created successfully Nov 03 07:42:00 devstack sudo[101171]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ed4c632c-5e79-40b3-80a0-1acc6cdbc179 tempest-VolumesSnapshotListTestJSON-915826739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.506e21d4-5973-4434-9828-607514aa1725" returned: 0 in 0.672s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ed4c632c-5e79-40b3-80a0-1acc6cdbc179 tempest-VolumesSnapshotListTestJSON-915826739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.506e21d4-5973-4434-9828-607514aa1725 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:00 devstack sudo[101187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.506e21d4-5973-4434-9828-607514aa1725 Nov 03 07:42:00 devstack sudo[101187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:00 devstack sudo[101177]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1b9c017b-fadc-4827-adc2-ee6ca4e7dc4a tempest-TestStampPattern-389950066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771 1073741824" returned: 0 in 0.728s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1b9c017b-fadc-4827-adc2-ee6ca4e7dc4a tempest-TestStampPattern-389950066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:00 devstack sudo[101189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771 Nov 03 07:42:00 devstack sudo[101189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:00 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-b96c6510-a6ef-4f17-a545-d4efab815cdf tempest-VolumeDependencyTests-1310677104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:42:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b96c6510-a6ef-4f17-a545-d4efab815cdf tempest-VolumeDependencyTests-1310677104 None] Flow 'volume_create_manager' (cf9b9e2e-f735-44a4-bbf2-192c8c8a76df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:42:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b96c6510-a6ef-4f17-a545-d4efab815cdf tempest-VolumeDependencyTests-1310677104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25d6184c-c120-411b-9f7b-0bb13d93c4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b96c6510-a6ef-4f17-a545-d4efab815cdf tempest-VolumeDependencyTests-1310677104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25d6184c-c120-411b-9f7b-0bb13d93c4ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:42:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-425822186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4faba15e-d946-4025-aa03-102c04643393,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6790108658d144cba3f37239cb677091',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:42:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:42:00Z,use_quota=True,user_id='feaa3862eb1f40148f449eed9ef74050',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:00 devstack sudo[101187]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b96c6510-a6ef-4f17-a545-d4efab815cdf tempest-VolumeDependencyTests-1310677104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1529babc-895f-4aa0-8745-87b0ce037cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b96c6510-a6ef-4f17-a545-d4efab815cdf tempest-VolumeDependencyTests-1310677104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1529babc-895f-4aa0-8745-87b0ce037cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b96c6510-a6ef-4f17-a545-d4efab815cdf tempest-VolumeDependencyTests-1310677104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed37b4bb-2794-4457-b0c4-f74e87c570b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b96c6510-a6ef-4f17-a545-d4efab815cdf tempest-VolumeDependencyTests-1310677104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed37b4bb-2794-4457-b0c4-f74e87c570b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4faba15e-d946-4025-aa03-102c04643393', 'volume_name': 'volume-4faba15e-d946-4025-aa03-102c04643393', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b96c6510-a6ef-4f17-a545-d4efab815cdf tempest-VolumeDependencyTests-1310677104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bbc929d-3eae-44a0-9d8a-1311803000ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b96c6510-a6ef-4f17-a545-d4efab815cdf tempest-VolumeDependencyTests-1310677104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bbc929d-3eae-44a0-9d8a-1311803000ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b96c6510-a6ef-4f17-a545-d4efab815cdf tempest-VolumeDependencyTests-1310677104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66aec254-aaf4-4687-997d-cab401ee3ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:00 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-b96c6510-a6ef-4f17-a545-d4efab815cdf tempest-VolumeDependencyTests-1310677104 None] Volume 4faba15e-d946-4025-aa03-102c04643393: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4faba15e-d946-4025-aa03-102c04643393', 'volume_size': 1} Nov 03 07:42:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b96c6510-a6ef-4f17-a545-d4efab815cdf tempest-VolumeDependencyTests-1310677104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ed4c632c-5e79-40b3-80a0-1acc6cdbc179 tempest-VolumesSnapshotListTestJSON-915826739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.506e21d4-5973-4434-9828-607514aa1725" returned: 0 in 0.514s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:00 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ed4c632c-5e79-40b3-80a0-1acc6cdbc179 tempest-VolumesSnapshotListTestJSON-915826739 None] Lock "cinder-quobyte-506e21d4-5973-4434-9828-607514aa1725" released by "_delete_snapshot" :: held 2.376s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:00 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ed4c632c-5e79-40b3-80a0-1acc6cdbc179 tempest-VolumesSnapshotListTestJSON-915826739 None] Lock "cinder-quobyte-42ac3525-dd20-4c52-b0c9-e994ec1c849d" released by "delete_snapshot" :: held 2.430s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:00 devstack sudo[101189]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1b9c017b-fadc-4827-adc2-ee6ca4e7dc4a tempest-TestStampPattern-389950066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771" returned: 0 in 0.368s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:00 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-1b9c017b-fadc-4827-adc2-ee6ca4e7dc4a tempest-TestStampPattern-389950066 None] <== create_volume: return (1191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:42:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-1b9c017b-fadc-4827-adc2-ee6ca4e7dc4a tempest-TestStampPattern-389950066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.196s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b96c6510-a6ef-4f17-a545-d4efab815cdf tempest-VolumeDependencyTests-1310677104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.144s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:00 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b96c6510-a6ef-4f17-a545-d4efab815cdf tempest-VolumeDependencyTests-1310677104 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:42:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-425822186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4faba15e-d946-4025-aa03-102c04643393,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6790108658d144cba3f37239cb677091',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:42:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:42:00Z,use_quota=True,user_id='feaa3862eb1f40148f449eed9ef74050',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:42:00 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-b96c6510-a6ef-4f17-a545-d4efab815cdf tempest-VolumeDependencyTests-1310677104 None] Creating volume 4faba15e-d946-4025-aa03-102c04643393 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:42:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b96c6510-a6ef-4f17-a545-d4efab815cdf tempest-VolumeDependencyTests-1310677104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b96c6510-a6ef-4f17-a545-d4efab815cdf tempest-VolumeDependencyTests-1310677104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:00 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b96c6510-a6ef-4f17-a545-d4efab815cdf tempest-VolumeDependencyTests-1310677104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:42:00 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b96c6510-a6ef-4f17-a545-d4efab815cdf tempest-VolumeDependencyTests-1310677104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:42:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b96c6510-a6ef-4f17-a545-d4efab815cdf tempest-VolumeDependencyTests-1310677104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:00 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b96c6510-a6ef-4f17-a545-d4efab815cdf tempest-VolumeDependencyTests-1310677104 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:42:00 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-b96c6510-a6ef-4f17-a545-d4efab815cdf tempest-VolumeDependencyTests-1310677104 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:42:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b96c6510-a6ef-4f17-a545-d4efab815cdf tempest-VolumeDependencyTests-1310677104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4faba15e-d946-4025-aa03-102c04643393 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:00 devstack sudo[101193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4faba15e-d946-4025-aa03-102c04643393 1073741824 Nov 03 07:42:00 devstack sudo[101193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-1b9c017b-fadc-4827-adc2-ee6ca4e7dc4a tempest-TestStampPattern-389950066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c930ab8-7a20-4ae7-aafe-ec0292ff2164) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-1b9c017b-fadc-4827-adc2-ee6ca4e7dc4a tempest-TestStampPattern-389950066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (369df8a6-10f9-4727-b67b-24ad9a7565df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:00 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-1b9c017b-fadc-4827-adc2-ee6ca4e7dc4a tempest-TestStampPattern-389950066 None] Volume volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771 (9118d4a4-1e9c-4c31-b4e8-9b48cad4a771): created successfully Nov 03 07:42:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-1b9c017b-fadc-4827-adc2-ee6ca4e7dc4a tempest-TestStampPattern-389950066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (369df8a6-10f9-4727-b67b-24ad9a7565df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-1b9c017b-fadc-4827-adc2-ee6ca4e7dc4a tempest-TestStampPattern-389950066 None] Flow 'volume_create_manager' (1f84ecdc-125a-45b4-af30-e202071c9deb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:42:00 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-1b9c017b-fadc-4827-adc2-ee6ca4e7dc4a tempest-TestStampPattern-389950066 None] Created volume successfully. Nov 03 07:42:00 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-ed4c632c-5e79-40b3-80a0-1acc6cdbc179 tempest-VolumesSnapshotListTestJSON-915826739 None] Created reservations ['60a2b675-c4f3-4f73-929c-46f7426bf349', '19848066-da87-4f30-888c-215f94bc1f60', 'd3f0fd26-0273-4aae-bda2-f5b10654afe7', '95711d58-e1c2-4021-9268-87397980ee62'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:42:01 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-ed4c632c-5e79-40b3-80a0-1acc6cdbc179 tempest-VolumesSnapshotListTestJSON-915826739 None] Delete snapshot completed successfully. Nov 03 07:42:01 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ed4c632c-5e79-40b3-80a0-1acc6cdbc179 tempest-VolumesSnapshotListTestJSON-915826739 None] Lock "cinder-506e21d4-5973-4434-9828-607514aa1725-delete_snapshot" released by "delete_snapshot" :: held 2.805s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:01 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-43ff518d-af41-4ebc-8fbd-255de34bc1da tempest-GroupSnapshotsV319Test-1260412742 None] group_snapshot cb55df88-81de-4344-adcc-591b7afe2aa2: deleting Nov 03 07:42:01 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-43ff518d-af41-4ebc-8fbd-255de34bc1da tempest-GroupSnapshotsV319Test-1260412742 None] group_snapshot cb55df88-81de-4344-adcc-591b7afe2aa2: deleting {{(pid=86875) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 03 07:42:01 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-43ff518d-af41-4ebc-8fbd-255de34bc1da tempest-GroupSnapshotsV319Test-1260412742 None] Acquiring lock "cinder-quobyte-f9ef9b35-1a8f-470e-99f0-3e4286ea5d18" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:01 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-43ff518d-af41-4ebc-8fbd-255de34bc1da tempest-GroupSnapshotsV319Test-1260412742 None] Lock "cinder-quobyte-f9ef9b35-1a8f-470e-99f0-3e4286ea5d18" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:01 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-43ff518d-af41-4ebc-8fbd-255de34bc1da tempest-GroupSnapshotsV319Test-1260412742 None] Acquiring lock "cinder-quobyte-89f0a44a-b203-4ad6-82e7-2b56ed686182" by "_delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:01 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-43ff518d-af41-4ebc-8fbd-255de34bc1da tempest-GroupSnapshotsV319Test-1260412742 None] Lock "cinder-quobyte-89f0a44a-b203-4ad6-82e7-2b56ed686182" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:01 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-43ff518d-af41-4ebc-8fbd-255de34bc1da tempest-GroupSnapshotsV319Test-1260412742 None] Deleting offline snapshot 89f0a44a-b203-4ad6-82e7-2b56ed686182 of volume f9ef9b35-1a8f-470e-99f0-3e4286ea5d18 {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:42:01 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-43ff518d-af41-4ebc-8fbd-255de34bc1da tempest-GroupSnapshotsV319Test-1260412742 None] snapshot_file for this snap is: volume-f9ef9b35-1a8f-470e-99f0-3e4286ea5d18.89f0a44a-b203-4ad6-82e7-2b56ed686182 {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:42:01 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[71bf6f34-e71e-48cc-9c21-76de8699533b]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:42:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-43ff518d-af41-4ebc-8fbd-255de34bc1da tempest-GroupSnapshotsV319Test-1260412742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9ef9b35-1a8f-470e-99f0-3e4286ea5d18.89f0a44a-b203-4ad6-82e7-2b56ed686182 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:01 devstack sudo[101193]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b96c6510-a6ef-4f17-a545-d4efab815cdf tempest-VolumeDependencyTests-1310677104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4faba15e-d946-4025-aa03-102c04643393 1073741824" returned: 0 in 0.664s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b96c6510-a6ef-4f17-a545-d4efab815cdf tempest-VolumeDependencyTests-1310677104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4faba15e-d946-4025-aa03-102c04643393 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:01 devstack sudo[101200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4faba15e-d946-4025-aa03-102c04643393 Nov 03 07:42:01 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-4736ebcf-2f84-459f-9568-c5ad90a4f117 tempest-VolumesSnapshotListTestJSON-915826739 None] Acquiring lock "cinder-a7da88ec-eed9-476b-b5fd-3995dcc6865c-delete_snapshot" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:01 devstack sudo[101200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:01 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-4736ebcf-2f84-459f-9568-c5ad90a4f117 tempest-VolumesSnapshotListTestJSON-915826739 None] Lock "cinder-a7da88ec-eed9-476b-b5fd-3995dcc6865c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:01 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-4736ebcf-2f84-459f-9568-c5ad90a4f117 tempest-VolumesSnapshotListTestJSON-915826739 None] Acquiring lock "cinder-quobyte-42ac3525-dd20-4c52-b0c9-e994ec1c849d" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:01 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-4736ebcf-2f84-459f-9568-c5ad90a4f117 tempest-VolumesSnapshotListTestJSON-915826739 None] Lock "cinder-quobyte-42ac3525-dd20-4c52-b0c9-e994ec1c849d" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:01 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-4736ebcf-2f84-459f-9568-c5ad90a4f117 tempest-VolumesSnapshotListTestJSON-915826739 None] Acquiring lock "cinder-quobyte-a7da88ec-eed9-476b-b5fd-3995dcc6865c" by "_delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:01 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-4736ebcf-2f84-459f-9568-c5ad90a4f117 tempest-VolumesSnapshotListTestJSON-915826739 None] Lock "cinder-quobyte-a7da88ec-eed9-476b-b5fd-3995dcc6865c" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:01 devstack sudo[101199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9ef9b35-1a8f-470e-99f0-3e4286ea5d18.89f0a44a-b203-4ad6-82e7-2b56ed686182 Nov 03 07:42:01 devstack sudo[101199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:01 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-4736ebcf-2f84-459f-9568-c5ad90a4f117 tempest-VolumesSnapshotListTestJSON-915826739 None] Deleting offline snapshot a7da88ec-eed9-476b-b5fd-3995dcc6865c of volume 42ac3525-dd20-4c52-b0c9-e994ec1c849d {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:42:01 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-4736ebcf-2f84-459f-9568-c5ad90a4f117 tempest-VolumesSnapshotListTestJSON-915826739 None] snapshot_file for this snap is: volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.a7da88ec-eed9-476b-b5fd-3995dcc6865c {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:42:01 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32ee083-71a6-4a7c-855a-819a2b4ed05e]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:42:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4736ebcf-2f84-459f-9568-c5ad90a4f117 tempest-VolumesSnapshotListTestJSON-915826739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.a7da88ec-eed9-476b-b5fd-3995dcc6865c {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:01 devstack sudo[101200]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:01 devstack sudo[101203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.a7da88ec-eed9-476b-b5fd-3995dcc6865c Nov 03 07:42:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b96c6510-a6ef-4f17-a545-d4efab815cdf tempest-VolumeDependencyTests-1310677104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4faba15e-d946-4025-aa03-102c04643393" returned: 0 in 0.420s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:01 devstack sudo[101203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:01 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b96c6510-a6ef-4f17-a545-d4efab815cdf tempest-VolumeDependencyTests-1310677104 None] <== create_volume: return (1164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:42:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b96c6510-a6ef-4f17-a545-d4efab815cdf tempest-VolumeDependencyTests-1310677104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:02 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b96c6510-a6ef-4f17-a545-d4efab815cdf tempest-VolumeDependencyTests-1310677104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66aec254-aaf4-4687-997d-cab401ee3ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4faba15e-d946-4025-aa03-102c04643393', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:02 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b96c6510-a6ef-4f17-a545-d4efab815cdf tempest-VolumeDependencyTests-1310677104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4df4713-3cd9-4b39-95cb-7ccacb325766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:02 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-b96c6510-a6ef-4f17-a545-d4efab815cdf tempest-VolumeDependencyTests-1310677104 None] Volume volume-4faba15e-d946-4025-aa03-102c04643393 (4faba15e-d946-4025-aa03-102c04643393): created successfully Nov 03 07:42:02 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b96c6510-a6ef-4f17-a545-d4efab815cdf tempest-VolumeDependencyTests-1310677104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4df4713-3cd9-4b39-95cb-7ccacb325766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:02 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b96c6510-a6ef-4f17-a545-d4efab815cdf tempest-VolumeDependencyTests-1310677104 None] Flow 'volume_create_manager' (cf9b9e2e-f735-44a4-bbf2-192c8c8a76df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:42:02 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-b96c6510-a6ef-4f17-a545-d4efab815cdf tempest-VolumeDependencyTests-1310677104 None] Created volume successfully. Nov 03 07:42:02 devstack sudo[101199]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-43ff518d-af41-4ebc-8fbd-255de34bc1da tempest-GroupSnapshotsV319Test-1260412742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9ef9b35-1a8f-470e-99f0-3e4286ea5d18.89f0a44a-b203-4ad6-82e7-2b56ed686182" returned: 0 in 0.716s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:02 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-43ff518d-af41-4ebc-8fbd-255de34bc1da tempest-GroupSnapshotsV319Test-1260412742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9ef9b35-1a8f-470e-99f0-3e4286ea5d18(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:42:02 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e18d08-2a7e-4ba3-916c-cf1a91b68bf8]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:42:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-43ff518d-af41-4ebc-8fbd-255de34bc1da tempest-GroupSnapshotsV319Test-1260412742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9ef9b35-1a8f-470e-99f0-3e4286ea5d18 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:02 devstack sudo[101203]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:02 devstack sudo[101210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9ef9b35-1a8f-470e-99f0-3e4286ea5d18 Nov 03 07:42:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4736ebcf-2f84-459f-9568-c5ad90a4f117 tempest-VolumesSnapshotListTestJSON-915826739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.a7da88ec-eed9-476b-b5fd-3995dcc6865c" returned: 0 in 0.587s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:02 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-4736ebcf-2f84-459f-9568-c5ad90a4f117 tempest-VolumesSnapshotListTestJSON-915826739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:42:02 devstack sudo[101210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:02 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[00561f11-f462-4e7c-8e07-05e8f9b3947f]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:42:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4736ebcf-2f84-459f-9568-c5ad90a4f117 tempest-VolumesSnapshotListTestJSON-915826739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.7262ad20-0195-4091-ae1e-de02589326e4 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:02 devstack sudo[101218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.7262ad20-0195-4091-ae1e-de02589326e4 Nov 03 07:42:02 devstack sudo[101218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:02 devstack sudo[101210]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-43ff518d-af41-4ebc-8fbd-255de34bc1da tempest-GroupSnapshotsV319Test-1260412742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9ef9b35-1a8f-470e-99f0-3e4286ea5d18" returned: 0 in 0.612s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-43ff518d-af41-4ebc-8fbd-255de34bc1da tempest-GroupSnapshotsV319Test-1260412742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9ef9b35-1a8f-470e-99f0-3e4286ea5d18.89f0a44a-b203-4ad6-82e7-2b56ed686182 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:02 devstack sudo[101237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9ef9b35-1a8f-470e-99f0-3e4286ea5d18.89f0a44a-b203-4ad6-82e7-2b56ed686182 Nov 03 07:42:02 devstack sudo[101237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:02 devstack sudo[101218]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4736ebcf-2f84-459f-9568-c5ad90a4f117 tempest-VolumesSnapshotListTestJSON-915826739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.7262ad20-0195-4091-ae1e-de02589326e4" returned: 0 in 0.578s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:02 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-4736ebcf-2f84-459f-9568-c5ad90a4f117 tempest-VolumesSnapshotListTestJSON-915826739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:42:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4736ebcf-2f84-459f-9568-c5ad90a4f117 tempest-VolumesSnapshotListTestJSON-915826739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.a7da88ec-eed9-476b-b5fd-3995dcc6865c {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:03 devstack sudo[101241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.a7da88ec-eed9-476b-b5fd-3995dcc6865c Nov 03 07:42:03 devstack sudo[101241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b2860cbd-9aa5-4feb-b61b-e943aa9fb369 tempest-VolumeDependencyTests-1310677104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b2860cbd-9aa5-4feb-b61b-e943aa9fb369 tempest-VolumeDependencyTests-1310677104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-b2860cbd-9aa5-4feb-b61b-e943aa9fb369 tempest-VolumeDependencyTests-1310677104 None] Creating offline snapshot 0a808fd3-c2a7-4295-939f-5a10b387e53f of volume 4faba15e-d946-4025-aa03-102c04643393 {{(pid=86875) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:42:03 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a5079e-0051-4faa-93ce-60d064fe3ce3]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:42:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b2860cbd-9aa5-4feb-b61b-e943aa9fb369 tempest-VolumeDependencyTests-1310677104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4faba15e-d946-4025-aa03-102c04643393 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:03 devstack sudo[101248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4faba15e-d946-4025-aa03-102c04643393 Nov 03 07:42:03 devstack sudo[101248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:03 devstack sudo[101237]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-43ff518d-af41-4ebc-8fbd-255de34bc1da tempest-GroupSnapshotsV319Test-1260412742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9ef9b35-1a8f-470e-99f0-3e4286ea5d18.89f0a44a-b203-4ad6-82e7-2b56ed686182" returned: 0 in 0.499s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-43ff518d-af41-4ebc-8fbd-255de34bc1da tempest-GroupSnapshotsV319Test-1260412742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9ef9b35-1a8f-470e-99f0-3e4286ea5d18.89f0a44a-b203-4ad6-82e7-2b56ed686182 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:03 devstack sudo[101252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9ef9b35-1a8f-470e-99f0-3e4286ea5d18.89f0a44a-b203-4ad6-82e7-2b56ed686182 Nov 03 07:42:03 devstack sudo[101252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:03 devstack cinder-volume[86875]: DEBUG oslo_service.periodic_task [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86875) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:42:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:42:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:42:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:03 devstack sudo[101241]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4736ebcf-2f84-459f-9568-c5ad90a4f117 tempest-VolumesSnapshotListTestJSON-915826739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.a7da88ec-eed9-476b-b5fd-3995dcc6865c" returned: 0 in 0.601s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4736ebcf-2f84-459f-9568-c5ad90a4f117 tempest-VolumesSnapshotListTestJSON-915826739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.a7da88ec-eed9-476b-b5fd-3995dcc6865c {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:03 devstack sudo[101258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:42:03 devstack sudo[101258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:03 devstack sudo[101261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.a7da88ec-eed9-476b-b5fd-3995dcc6865c Nov 03 07:42:03 devstack sudo[101261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:03 devstack sudo[101252]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-43ff518d-af41-4ebc-8fbd-255de34bc1da tempest-GroupSnapshotsV319Test-1260412742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9ef9b35-1a8f-470e-99f0-3e4286ea5d18.89f0a44a-b203-4ad6-82e7-2b56ed686182" returned: 0 in 0.462s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:03 devstack sudo[101248]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b2860cbd-9aa5-4feb-b61b-e943aa9fb369 tempest-VolumeDependencyTests-1310677104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4faba15e-d946-4025-aa03-102c04643393" returned: 0 in 0.676s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b2860cbd-9aa5-4feb-b61b-e943aa9fb369 tempest-VolumeDependencyTests-1310677104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4faba15e-d946-4025-aa03-102c04643393,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4faba15e-d946-4025-aa03-102c04643393.0a808fd3-c2a7-4295-939f-5a10b387e53f 1G {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:03 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-43ff518d-af41-4ebc-8fbd-255de34bc1da tempest-GroupSnapshotsV319Test-1260412742 None] Lock "cinder-quobyte-89f0a44a-b203-4ad6-82e7-2b56ed686182" released by "_delete_snapshot" :: held 2.495s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:03 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-43ff518d-af41-4ebc-8fbd-255de34bc1da tempest-GroupSnapshotsV319Test-1260412742 None] Lock "cinder-quobyte-f9ef9b35-1a8f-470e-99f0-3e4286ea5d18" released by "delete_snapshot" :: held 2.536s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:03 devstack sudo[101266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4faba15e-d946-4025-aa03-102c04643393,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4faba15e-d946-4025-aa03-102c04643393.0a808fd3-c2a7-4295-939f-5a10b387e53f 1G Nov 03 07:42:03 devstack sudo[101266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:04 devstack cinder-volume[86875]: WARNING cinder.quota [None req-43ff518d-af41-4ebc-8fbd-255de34bc1da tempest-GroupSnapshotsV319Test-1260412742 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-700822086 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-700822086, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:42:04 devstack cinder-volume[86875]: WARNING cinder.quota [None req-43ff518d-af41-4ebc-8fbd-255de34bc1da tempest-GroupSnapshotsV319Test-1260412742 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-700822086 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-700822086, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:42:04 devstack sudo[101258]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.508s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:04 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:42:04 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-43ff518d-af41-4ebc-8fbd-255de34bc1da tempest-GroupSnapshotsV319Test-1260412742 None] Created reservations ['7a2786b0-ff91-4c03-b67a-d3bfc16c0a46', '6cce85a2-352f-47be-9ddb-55d288769d4c', '3c43f5ed-655e-4a07-a38c-f84eaad6c94f', '1a80b2f4-38b5-42a2-988b-0dddae5c4a5e'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:42:04 devstack cinder-volume[86875]: DEBUG oslo_service.periodic_task [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running periodic task VolumeManager._thread_info {{(pid=86875) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:42:04 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] thread count: 28 {{(pid=86875) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:42:04 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] thread info: [<_MainThread(MainThread, started 125626325639296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86875) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:42:04 devstack sudo[101261]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4736ebcf-2f84-459f-9568-c5ad90a4f117 tempest-VolumesSnapshotListTestJSON-915826739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.a7da88ec-eed9-476b-b5fd-3995dcc6865c" returned: 0 in 0.592s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:04 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-4736ebcf-2f84-459f-9568-c5ad90a4f117 tempest-VolumesSnapshotListTestJSON-915826739 None] Lock "cinder-quobyte-a7da88ec-eed9-476b-b5fd-3995dcc6865c" released by "_delete_snapshot" :: held 2.557s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:04 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-43ff518d-af41-4ebc-8fbd-255de34bc1da tempest-GroupSnapshotsV319Test-1260412742 None] group_snapshot cb55df88-81de-4344-adcc-591b7afe2aa2: deleted successfully Nov 03 07:42:04 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-4736ebcf-2f84-459f-9568-c5ad90a4f117 tempest-VolumesSnapshotListTestJSON-915826739 None] Lock "cinder-quobyte-42ac3525-dd20-4c52-b0c9-e994ec1c849d" released by "delete_snapshot" :: held 2.602s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:04 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-4736ebcf-2f84-459f-9568-c5ad90a4f117 tempest-VolumesSnapshotListTestJSON-915826739 None] Created reservations ['595099ad-223e-4586-b6f6-4fce18e2c377', 'd5ba1e9d-fc7c-40fb-9529-c013658647b8', '50fa1142-7bac-4ed5-8385-30975c0300f4', '81714f27-9fc3-4a51-a14a-5162b71dbc4f'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:42:04 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-4736ebcf-2f84-459f-9568-c5ad90a4f117 tempest-VolumesSnapshotListTestJSON-915826739 None] Delete snapshot completed successfully. Nov 03 07:42:04 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-4736ebcf-2f84-459f-9568-c5ad90a4f117 tempest-VolumesSnapshotListTestJSON-915826739 None] Lock "cinder-a7da88ec-eed9-476b-b5fd-3995dcc6865c-delete_snapshot" released by "delete_snapshot" :: held 2.801s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:04 devstack sudo[101266]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b2860cbd-9aa5-4feb-b61b-e943aa9fb369 tempest-VolumeDependencyTests-1310677104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4faba15e-d946-4025-aa03-102c04643393,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4faba15e-d946-4025-aa03-102c04643393.0a808fd3-c2a7-4295-939f-5a10b387e53f 1G" returned: 0 in 0.708s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b2860cbd-9aa5-4feb-b61b-e943aa9fb369 tempest-VolumeDependencyTests-1310677104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4faba15e-d946-4025-aa03-102c04643393 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4faba15e-d946-4025-aa03-102c04643393.0a808fd3-c2a7-4295-939f-5a10b387e53f {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:04 devstack sudo[101275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4faba15e-d946-4025-aa03-102c04643393 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4faba15e-d946-4025-aa03-102c04643393.0a808fd3-c2a7-4295-939f-5a10b387e53f Nov 03 07:42:04 devstack sudo[101275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:04 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-1b66db1b-0faf-4342-a008-a2f901c8c6ca tempest-VolumesSnapshotListTestJSON-915826739 None] Acquiring lock "cinder-7262ad20-0195-4091-ae1e-de02589326e4-delete_snapshot" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:04 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-1b66db1b-0faf-4342-a008-a2f901c8c6ca tempest-VolumesSnapshotListTestJSON-915826739 None] Lock "cinder-7262ad20-0195-4091-ae1e-de02589326e4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:04 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-1b66db1b-0faf-4342-a008-a2f901c8c6ca tempest-VolumesSnapshotListTestJSON-915826739 None] Acquiring lock "cinder-quobyte-42ac3525-dd20-4c52-b0c9-e994ec1c849d" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:04 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-1b66db1b-0faf-4342-a008-a2f901c8c6ca tempest-VolumesSnapshotListTestJSON-915826739 None] Lock "cinder-quobyte-42ac3525-dd20-4c52-b0c9-e994ec1c849d" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:04 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-1b66db1b-0faf-4342-a008-a2f901c8c6ca tempest-VolumesSnapshotListTestJSON-915826739 None] Acquiring lock "cinder-quobyte-7262ad20-0195-4091-ae1e-de02589326e4" by "_delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:04 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-1b66db1b-0faf-4342-a008-a2f901c8c6ca tempest-VolumesSnapshotListTestJSON-915826739 None] Lock "cinder-quobyte-7262ad20-0195-4091-ae1e-de02589326e4" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:04 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-1b66db1b-0faf-4342-a008-a2f901c8c6ca tempest-VolumesSnapshotListTestJSON-915826739 None] Deleting offline snapshot 7262ad20-0195-4091-ae1e-de02589326e4 of volume 42ac3525-dd20-4c52-b0c9-e994ec1c849d {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:42:04 devstack sudo[101275]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:05 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-1b66db1b-0faf-4342-a008-a2f901c8c6ca tempest-VolumesSnapshotListTestJSON-915826739 None] snapshot_file for this snap is: volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.7262ad20-0195-4091-ae1e-de02589326e4 {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:42:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b2860cbd-9aa5-4feb-b61b-e943aa9fb369 tempest-VolumeDependencyTests-1310677104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4faba15e-d946-4025-aa03-102c04643393 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4faba15e-d946-4025-aa03-102c04643393.0a808fd3-c2a7-4295-939f-5a10b387e53f" returned: 0 in 0.446s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:05 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-b2860cbd-9aa5-4feb-b61b-e943aa9fb369 tempest-VolumeDependencyTests-1310677104 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4faba15e-d946-4025-aa03-102c04643393.0a808fd3-c2a7-4295-939f-5a10b387e53f is being set with open permissions: ugo+rw Nov 03 07:42:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b2860cbd-9aa5-4feb-b61b-e943aa9fb369 tempest-VolumeDependencyTests-1310677104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4faba15e-d946-4025-aa03-102c04643393.0a808fd3-c2a7-4295-939f-5a10b387e53f {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:05 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[5521e33d-b9ee-4c94-9dc2-9bb297cedb05]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:42:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1b66db1b-0faf-4342-a008-a2f901c8c6ca tempest-VolumesSnapshotListTestJSON-915826739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.7262ad20-0195-4091-ae1e-de02589326e4 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:05 devstack sudo[101280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4faba15e-d946-4025-aa03-102c04643393.0a808fd3-c2a7-4295-939f-5a10b387e53f Nov 03 07:42:05 devstack sudo[101280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:05 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-16772508-0102-4927-8448-a8b1180abb8a tempest-GroupSnapshotsV319Test-1260412742 None] Acquiring lock "cinder-quobyte-f9ef9b35-1a8f-470e-99f0-3e4286ea5d18" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:05 devstack sudo[101281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.7262ad20-0195-4091-ae1e-de02589326e4 Nov 03 07:42:05 devstack sudo[101281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:05 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-16772508-0102-4927-8448-a8b1180abb8a tempest-GroupSnapshotsV319Test-1260412742 None] Lock "cinder-quobyte-f9ef9b35-1a8f-470e-99f0-3e4286ea5d18" acquired by "delete_volume" :: waited 0.034s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:05 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f8ba09-6e42-496b-b1ba-b987abbc59fe]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:42:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-16772508-0102-4927-8448-a8b1180abb8a tempest-GroupSnapshotsV319Test-1260412742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9ef9b35-1a8f-470e-99f0-3e4286ea5d18 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:05 devstack sudo[101280]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b2860cbd-9aa5-4feb-b61b-e943aa9fb369 tempest-VolumeDependencyTests-1310677104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4faba15e-d946-4025-aa03-102c04643393.0a808fd3-c2a7-4295-939f-5a10b387e53f" returned: 0 in 0.365s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b2860cbd-9aa5-4feb-b61b-e943aa9fb369 tempest-VolumeDependencyTests-1310677104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4faba15e-d946-4025-aa03-102c04643393.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:05 devstack sudo[101287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4faba15e-d946-4025-aa03-102c04643393.info Nov 03 07:42:05 devstack sudo[101287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:05 devstack sudo[101286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9ef9b35-1a8f-470e-99f0-3e4286ea5d18 Nov 03 07:42:05 devstack sudo[101286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:05 devstack sudo[101281]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1b66db1b-0faf-4342-a008-a2f901c8c6ca tempest-VolumesSnapshotListTestJSON-915826739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.7262ad20-0195-4091-ae1e-de02589326e4" returned: 0 in 0.558s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:05 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-1b66db1b-0faf-4342-a008-a2f901c8c6ca tempest-VolumesSnapshotListTestJSON-915826739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:42:05 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[59285713-2a1d-4c3d-bf31-0d80b45fd34d]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:42:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1b66db1b-0faf-4342-a008-a2f901c8c6ca tempest-VolumesSnapshotListTestJSON-915826739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:05 devstack sudo[101287]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b2860cbd-9aa5-4feb-b61b-e943aa9fb369 tempest-VolumeDependencyTests-1310677104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4faba15e-d946-4025-aa03-102c04643393.info" returned: 0 in 0.352s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:05 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-b2860cbd-9aa5-4feb-b61b-e943aa9fb369 tempest-VolumeDependencyTests-1310677104 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4faba15e-d946-4025-aa03-102c04643393.info is being set with open permissions: ugo+rw Nov 03 07:42:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b2860cbd-9aa5-4feb-b61b-e943aa9fb369 tempest-VolumeDependencyTests-1310677104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4faba15e-d946-4025-aa03-102c04643393.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:05 devstack sudo[101293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d Nov 03 07:42:05 devstack sudo[101293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:05 devstack sudo[101298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4faba15e-d946-4025-aa03-102c04643393.info Nov 03 07:42:05 devstack sudo[101298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:05 devstack sudo[101286]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-16772508-0102-4927-8448-a8b1180abb8a tempest-GroupSnapshotsV319Test-1260412742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9ef9b35-1a8f-470e-99f0-3e4286ea5d18" returned: 0 in 0.574s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-16772508-0102-4927-8448-a8b1180abb8a tempest-GroupSnapshotsV319Test-1260412742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9ef9b35-1a8f-470e-99f0-3e4286ea5d18 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:05 devstack sudo[101301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9ef9b35-1a8f-470e-99f0-3e4286ea5d18 Nov 03 07:42:05 devstack sudo[101301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:06 devstack sudo[101298]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b2860cbd-9aa5-4feb-b61b-e943aa9fb369 tempest-VolumeDependencyTests-1310677104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4faba15e-d946-4025-aa03-102c04643393.info" returned: 0 in 0.510s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b2860cbd-9aa5-4feb-b61b-e943aa9fb369 tempest-VolumeDependencyTests-1310677104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.233s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:06 devstack sudo[101301]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:06 devstack sudo[101293]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-16772508-0102-4927-8448-a8b1180abb8a tempest-GroupSnapshotsV319Test-1260412742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f9ef9b35-1a8f-470e-99f0-3e4286ea5d18" returned: 0 in 0.475s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1b66db1b-0faf-4342-a008-a2f901c8c6ca tempest-VolumesSnapshotListTestJSON-915826739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d" returned: 0 in 0.726s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1b66db1b-0faf-4342-a008-a2f901c8c6ca tempest-VolumesSnapshotListTestJSON-915826739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.7262ad20-0195-4091-ae1e-de02589326e4 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:06 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-b2860cbd-9aa5-4feb-b61b-e943aa9fb369 tempest-VolumeDependencyTests-1310677104 None] Create snapshot completed successfully Nov 03 07:42:06 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-16772508-0102-4927-8448-a8b1180abb8a tempest-GroupSnapshotsV319Test-1260412742 None] Lock "cinder-quobyte-f9ef9b35-1a8f-470e-99f0-3e4286ea5d18" released by "delete_volume" :: held 1.233s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:06 devstack sudo[101338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.7262ad20-0195-4091-ae1e-de02589326e4 Nov 03 07:42:06 devstack sudo[101338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:06 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-16772508-0102-4927-8448-a8b1180abb8a tempest-GroupSnapshotsV319Test-1260412742 None] Created reservations ['3317b6ee-dc7a-4953-9e0d-1622baec0f5c'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:42:06 devstack cinder-volume[86875]: WARNING cinder.quota [None req-16772508-0102-4927-8448-a8b1180abb8a tempest-GroupSnapshotsV319Test-1260412742 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-700822086 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-700822086, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:42:06 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-16772508-0102-4927-8448-a8b1180abb8a tempest-GroupSnapshotsV319Test-1260412742 None] Created reservations ['8776f16e-7e6b-4594-833b-baa8514979ca', 'd35398e4-0bfa-44c5-9c9e-714c9aba775f', '31f186d8-675a-4007-9786-3dd96109b716', '1f412cda-93ce-4254-a679-2531285a902f'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:42:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-16772508-0102-4927-8448-a8b1180abb8a tempest-GroupSnapshotsV319Test-1260412742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-16772508-0102-4927-8448-a8b1180abb8a tempest-GroupSnapshotsV319Test-1260412742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:07 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-16772508-0102-4927-8448-a8b1180abb8a tempest-GroupSnapshotsV319Test-1260412742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:42:07 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-16772508-0102-4927-8448-a8b1180abb8a tempest-GroupSnapshotsV319Test-1260412742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:42:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-16772508-0102-4927-8448-a8b1180abb8a tempest-GroupSnapshotsV319Test-1260412742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-16772508-0102-4927-8448-a8b1180abb8a tempest-GroupSnapshotsV319Test-1260412742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:07 devstack sudo[101373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:42:07 devstack sudo[101373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:07 devstack sudo[101338]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1b66db1b-0faf-4342-a008-a2f901c8c6ca tempest-VolumesSnapshotListTestJSON-915826739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.7262ad20-0195-4091-ae1e-de02589326e4" returned: 0 in 0.795s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1b66db1b-0faf-4342-a008-a2f901c8c6ca tempest-VolumesSnapshotListTestJSON-915826739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.7262ad20-0195-4091-ae1e-de02589326e4 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:07 devstack sudo[101377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.7262ad20-0195-4091-ae1e-de02589326e4 Nov 03 07:42:07 devstack sudo[101377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:07 devstack sudo[101373]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-16772508-0102-4927-8448-a8b1180abb8a tempest-GroupSnapshotsV319Test-1260412742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.512s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:07 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-16772508-0102-4927-8448-a8b1180abb8a tempest-GroupSnapshotsV319Test-1260412742 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:42:07 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-16772508-0102-4927-8448-a8b1180abb8a tempest-GroupSnapshotsV319Test-1260412742 None] Delete group completed successfully. Nov 03 07:42:07 devstack sudo[101377]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1b66db1b-0faf-4342-a008-a2f901c8c6ca tempest-VolumesSnapshotListTestJSON-915826739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d.7262ad20-0195-4091-ae1e-de02589326e4" returned: 0 in 0.479s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:07 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-1b66db1b-0faf-4342-a008-a2f901c8c6ca tempest-VolumesSnapshotListTestJSON-915826739 None] Lock "cinder-quobyte-7262ad20-0195-4091-ae1e-de02589326e4" released by "_delete_snapshot" :: held 2.777s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:07 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-1b66db1b-0faf-4342-a008-a2f901c8c6ca tempest-VolumesSnapshotListTestJSON-915826739 None] Lock "cinder-quobyte-42ac3525-dd20-4c52-b0c9-e994ec1c849d" released by "delete_snapshot" :: held 2.821s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:07 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-1b66db1b-0faf-4342-a008-a2f901c8c6ca tempest-VolumesSnapshotListTestJSON-915826739 None] Created reservations ['455b15fe-84bd-483e-b043-92ec8b66cf41', 'b91e6b78-acfc-469f-8d93-a4eb1c899772', 'a1fda853-0921-4a59-8444-ace994c38768', '8e44ff90-3024-4feb-b9ca-a188526f9e37'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:42:08 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-1b66db1b-0faf-4342-a008-a2f901c8c6ca tempest-VolumesSnapshotListTestJSON-915826739 None] Delete snapshot completed successfully. Nov 03 07:42:08 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-1b66db1b-0faf-4342-a008-a2f901c8c6ca tempest-VolumesSnapshotListTestJSON-915826739 None] Lock "cinder-7262ad20-0195-4091-ae1e-de02589326e4-delete_snapshot" released by "delete_snapshot" :: held 3.190s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:08 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-3e8ee27a-0686-4b95-aa78-0e10088bad8d tempest-VolumesSnapshotListTestJSON-915826739 None] Acquiring lock "cinder-42ac3525-dd20-4c52-b0c9-e994ec1c849d-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:08 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-3e8ee27a-0686-4b95-aa78-0e10088bad8d tempest-VolumesSnapshotListTestJSON-915826739 None] Lock "cinder-42ac3525-dd20-4c52-b0c9-e994ec1c849d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:08 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-3e8ee27a-0686-4b95-aa78-0e10088bad8d tempest-VolumesSnapshotListTestJSON-915826739 None] Acquiring lock "cinder-quobyte-42ac3525-dd20-4c52-b0c9-e994ec1c849d" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:08 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-3e8ee27a-0686-4b95-aa78-0e10088bad8d tempest-VolumesSnapshotListTestJSON-915826739 None] Lock "cinder-quobyte-42ac3525-dd20-4c52-b0c9-e994ec1c849d" acquired by "delete_volume" :: waited 0.027s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:08 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad3acfd-f1c1-4e53-b73c-6330b5e86e3e]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:42:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3e8ee27a-0686-4b95-aa78-0e10088bad8d tempest-VolumesSnapshotListTestJSON-915826739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:08 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bd3e4a4-38d6-460f-8460-68fc54dc0758 tempest-VolumeDependencyTests-1310677104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:42:08 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-9bd3e4a4-38d6-460f-8460-68fc54dc0758 tempest-VolumeDependencyTests-1310677104 None] Flow 'volume_create_manager' (c991cc10-2620-4123-9d20-e7168845e201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:42:08 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-9bd3e4a4-38d6-460f-8460-68fc54dc0758 tempest-VolumeDependencyTests-1310677104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c2f8cdc-223f-4a78-b7f4-7f51643b5bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:08 devstack sudo[101389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d Nov 03 07:42:08 devstack sudo[101389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:08 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-9bd3e4a4-38d6-460f-8460-68fc54dc0758 tempest-VolumeDependencyTests-1310677104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c2f8cdc-223f-4a78-b7f4-7f51643b5bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:42:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-651653931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=877b47af-775f-4ac8-95fc-4532ffad37d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6790108658d144cba3f37239cb677091',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:42:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0a808fd3-c2a7-4295-939f-5a10b387e53f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:42:09Z,use_quota=True,user_id='feaa3862eb1f40148f449eed9ef74050',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:08 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-9bd3e4a4-38d6-460f-8460-68fc54dc0758 tempest-VolumeDependencyTests-1310677104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d0cd82e-c878-4595-bf74-cb3d37df1b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:08 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-9bd3e4a4-38d6-460f-8460-68fc54dc0758 tempest-VolumeDependencyTests-1310677104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d0cd82e-c878-4595-bf74-cb3d37df1b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:08 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-9bd3e4a4-38d6-460f-8460-68fc54dc0758 tempest-VolumeDependencyTests-1310677104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (028edc5f-3982-42d9-a61c-dedcccde369c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:08 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-9bd3e4a4-38d6-460f-8460-68fc54dc0758 tempest-VolumeDependencyTests-1310677104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (028edc5f-3982-42d9-a61c-dedcccde369c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '877b47af-775f-4ac8-95fc-4532ffad37d1', 'volume_name': 'volume-877b47af-775f-4ac8-95fc-4532ffad37d1', 'volume_size': 1, 'snapshot_id': '0a808fd3-c2a7-4295-939f-5a10b387e53f'}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:08 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-9bd3e4a4-38d6-460f-8460-68fc54dc0758 tempest-VolumeDependencyTests-1310677104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75ac69c2-5582-4a84-a9b9-0a4dd033dc87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:08 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-9bd3e4a4-38d6-460f-8460-68fc54dc0758 tempest-VolumeDependencyTests-1310677104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75ac69c2-5582-4a84-a9b9-0a4dd033dc87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:09 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-9bd3e4a4-38d6-460f-8460-68fc54dc0758 tempest-VolumeDependencyTests-1310677104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d82c3b1-4a56-457e-a7bd-79ef994dce1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:09 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-9bd3e4a4-38d6-460f-8460-68fc54dc0758 tempest-VolumeDependencyTests-1310677104 None] Volume 877b47af-775f-4ac8-95fc-4532ffad37d1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-877b47af-775f-4ac8-95fc-4532ffad37d1', 'volume_size': 1, 'snapshot_id': '0a808fd3-c2a7-4295-939f-5a10b387e53f'} Nov 03 07:42:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-9bd3e4a4-38d6-460f-8460-68fc54dc0758 tempest-VolumeDependencyTests-1310677104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-9bd3e4a4-38d6-460f-8460-68fc54dc0758 tempest-VolumeDependencyTests-1310677104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:09 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-9bd3e4a4-38d6-460f-8460-68fc54dc0758 tempest-VolumeDependencyTests-1310677104 None] Acquiring lock "cinder-quobyte-0a808fd3-c2a7-4295-939f-5a10b387e53f-877b47af-775f-4ac8-95fc-4532ffad37d1" by "_create_volume_from_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:09 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-9bd3e4a4-38d6-460f-8460-68fc54dc0758 tempest-VolumeDependencyTests-1310677104 None] Lock "cinder-quobyte-0a808fd3-c2a7-4295-939f-5a10b387e53f-877b47af-775f-4ac8-95fc-4532ffad37d1" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:09 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-9bd3e4a4-38d6-460f-8460-68fc54dc0758 tempest-VolumeDependencyTests-1310677104 None] Creating volume 877b47af-775f-4ac8-95fc-4532ffad37d1 from snapshot 0a808fd3-c2a7-4295-939f-5a10b387e53f {{(pid=86875) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 07:42:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-9bd3e4a4-38d6-460f-8460-68fc54dc0758 tempest-VolumeDependencyTests-1310677104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-9bd3e4a4-38d6-460f-8460-68fc54dc0758 tempest-VolumeDependencyTests-1310677104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:09 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-9bd3e4a4-38d6-460f-8460-68fc54dc0758 tempest-VolumeDependencyTests-1310677104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:42:09 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-9bd3e4a4-38d6-460f-8460-68fc54dc0758 tempest-VolumeDependencyTests-1310677104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:42:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-9bd3e4a4-38d6-460f-8460-68fc54dc0758 tempest-VolumeDependencyTests-1310677104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:09 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-9bd3e4a4-38d6-460f-8460-68fc54dc0758 tempest-VolumeDependencyTests-1310677104 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:42:09 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-9bd3e4a4-38d6-460f-8460-68fc54dc0758 tempest-VolumeDependencyTests-1310677104 None] Acquiring lock "cinder-quobyte-877b47af-775f-4ac8-95fc-4532ffad37d1" by "_copy_volume_from_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:09 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-9bd3e4a4-38d6-460f-8460-68fc54dc0758 tempest-VolumeDependencyTests-1310677104 None] Lock "cinder-quobyte-877b47af-775f-4ac8-95fc-4532ffad37d1" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:09 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-9bd3e4a4-38d6-460f-8460-68fc54dc0758 tempest-VolumeDependencyTests-1310677104 None] snapshot: 0a808fd3-c2a7-4295-939f-5a10b387e53f, volume: 877b47af-775f-4ac8-95fc-4532ffad37d1, {{(pid=86875) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 07:42:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-9bd3e4a4-38d6-460f-8460-68fc54dc0758 tempest-VolumeDependencyTests-1310677104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-9bd3e4a4-38d6-460f-8460-68fc54dc0758 tempest-VolumeDependencyTests-1310677104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:09 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-9bd3e4a4-38d6-460f-8460-68fc54dc0758 tempest-VolumeDependencyTests-1310677104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:42:09 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-9bd3e4a4-38d6-460f-8460-68fc54dc0758 tempest-VolumeDependencyTests-1310677104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:42:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-9bd3e4a4-38d6-460f-8460-68fc54dc0758 tempest-VolumeDependencyTests-1310677104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:09 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ecaa342-c6be-440e-9139-37657e833515]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:42:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9bd3e4a4-38d6-460f-8460-68fc54dc0758 tempest-VolumeDependencyTests-1310677104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4faba15e-d946-4025-aa03-102c04643393.0a808fd3-c2a7-4295-939f-5a10b387e53f {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:09 devstack sudo[101389]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3e8ee27a-0686-4b95-aa78-0e10088bad8d tempest-VolumesSnapshotListTestJSON-915826739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d" returned: 0 in 0.492s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3e8ee27a-0686-4b95-aa78-0e10088bad8d tempest-VolumesSnapshotListTestJSON-915826739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:09 devstack sudo[101391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4faba15e-d946-4025-aa03-102c04643393.0a808fd3-c2a7-4295-939f-5a10b387e53f Nov 03 07:42:09 devstack sudo[101391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:09 devstack sudo[101395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d Nov 03 07:42:09 devstack sudo[101395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:09 devstack sudo[101391]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9bd3e4a4-38d6-460f-8460-68fc54dc0758 tempest-VolumeDependencyTests-1310677104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4faba15e-d946-4025-aa03-102c04643393.0a808fd3-c2a7-4295-939f-5a10b387e53f" returned: 0 in 0.641s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:09 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-9bd3e4a4-38d6-460f-8460-68fc54dc0758 tempest-VolumeDependencyTests-1310677104 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4faba15e-d946-4025-aa03-102c04643393(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:42:09 devstack sudo[101395]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3e8ee27a-0686-4b95-aa78-0e10088bad8d tempest-VolumesSnapshotListTestJSON-915826739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-42ac3525-dd20-4c52-b0c9-e994ec1c849d" returned: 0 in 0.568s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:09 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de92ed0-55a3-4241-a1ec-32370b157a02]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:42:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9bd3e4a4-38d6-460f-8460-68fc54dc0758 tempest-VolumeDependencyTests-1310677104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4faba15e-d946-4025-aa03-102c04643393 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:09 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-3e8ee27a-0686-4b95-aa78-0e10088bad8d tempest-VolumesSnapshotListTestJSON-915826739 None] Lock "cinder-quobyte-42ac3525-dd20-4c52-b0c9-e994ec1c849d" released by "delete_volume" :: held 1.201s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:10 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-3e8ee27a-0686-4b95-aa78-0e10088bad8d tempest-VolumesSnapshotListTestJSON-915826739 None] Created reservations ['e4bd143b-2cb7-4288-9891-50f4d0754dcb', 'a730e77e-7979-4410-957f-c27eb18d482c', '4a9dc8d2-e81c-4a77-8a32-32a8da5a3931', '39534525-379e-4fab-9484-f9037ff8dfa2'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:42:10 devstack sudo[101402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4faba15e-d946-4025-aa03-102c04643393 Nov 03 07:42:10 devstack sudo[101402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3e8ee27a-0686-4b95-aa78-0e10088bad8d tempest-VolumesSnapshotListTestJSON-915826739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3e8ee27a-0686-4b95-aa78-0e10088bad8d tempest-VolumesSnapshotListTestJSON-915826739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:10 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-3e8ee27a-0686-4b95-aa78-0e10088bad8d tempest-VolumesSnapshotListTestJSON-915826739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:42:10 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-3e8ee27a-0686-4b95-aa78-0e10088bad8d tempest-VolumesSnapshotListTestJSON-915826739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:42:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3e8ee27a-0686-4b95-aa78-0e10088bad8d tempest-VolumesSnapshotListTestJSON-915826739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3e8ee27a-0686-4b95-aa78-0e10088bad8d tempest-VolumesSnapshotListTestJSON-915826739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:10 devstack sudo[101404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:42:10 devstack sudo[101404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:10 devstack sudo[101402]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9bd3e4a4-38d6-460f-8460-68fc54dc0758 tempest-VolumeDependencyTests-1310677104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4faba15e-d946-4025-aa03-102c04643393" returned: 0 in 0.713s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:10 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-9bd3e4a4-38d6-460f-8460-68fc54dc0758 tempest-VolumeDependencyTests-1310677104 None] will copy from snapshot at /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4faba15e-d946-4025-aa03-102c04643393 {{(pid=86875) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 07:42:10 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-9bd3e4a4-38d6-460f-8460-68fc54dc0758 tempest-VolumeDependencyTests-1310677104 None] Creating direct copy from snapshot {{(pid=86875) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 07:42:10 devstack cinder-volume[86875]: DEBUG cinder.utils [None req-9bd3e4a4-38d6-460f-8460-68fc54dc0758 tempest-VolumeDependencyTests-1310677104 None] Path /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-877b47af-775f-4ac8-95fc-4532ffad37d1 not found in is_blk_device check {{(pid=86875) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 07:42:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9bd3e4a4-38d6-460f-8460-68fc54dc0758 tempest-VolumeDependencyTests-1310677104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4faba15e-d946-4025-aa03-102c04643393 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-877b47af-775f-4ac8-95fc-4532ffad37d1 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:10 devstack sudo[101410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4faba15e-d946-4025-aa03-102c04643393 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-877b47af-775f-4ac8-95fc-4532ffad37d1 Nov 03 07:42:10 devstack sudo[101410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:10 devstack sudo[101404]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3e8ee27a-0686-4b95-aa78-0e10088bad8d tempest-VolumesSnapshotListTestJSON-915826739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.504s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:10 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-3e8ee27a-0686-4b95-aa78-0e10088bad8d tempest-VolumesSnapshotListTestJSON-915826739 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:42:10 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-3e8ee27a-0686-4b95-aa78-0e10088bad8d tempest-VolumesSnapshotListTestJSON-915826739 None] Deleted volume successfully. Nov 03 07:42:10 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-3e8ee27a-0686-4b95-aa78-0e10088bad8d tempest-VolumesSnapshotListTestJSON-915826739 None] Lock "cinder-42ac3525-dd20-4c52-b0c9-e994ec1c849d-delete_volume" released by "delete_volume" :: held 2.243s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:20 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:SELECT=63,cinder:UPDATE=65,cinder:INSERT=17,cinder:DELETE=4 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:42:20 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:SELECT=44,cinder:UPDATE=48,cinder:INSERT=13,cinder:DELETE=1 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:42:21 devstack sudo[101410]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9bd3e4a4-38d6-460f-8460-68fc54dc0758 tempest-VolumeDependencyTests-1310677104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4faba15e-d946-4025-aa03-102c04643393 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-877b47af-775f-4ac8-95fc-4532ffad37d1" returned: 0 in 10.515s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:21 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-9bd3e4a4-38d6-460f-8460-68fc54dc0758 tempest-VolumeDependencyTests-1310677104 None] Image conversion details: src /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4faba15e-d946-4025-aa03-102c04643393, size 1024.00 MB, duration 10.52 sec, destination /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-877b47af-775f-4ac8-95fc-4532ffad37d1 {{(pid=86875) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:42:21 devstack cinder-volume[86875]: INFO cinder.image.image_utils [None req-9bd3e4a4-38d6-460f-8460-68fc54dc0758 tempest-VolumeDependencyTests-1310677104 None] Converted 1024.00 MB image at 97.36 MB/s Nov 03 07:42:21 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-9bd3e4a4-38d6-460f-8460-68fc54dc0758 tempest-VolumeDependencyTests-1310677104 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-877b47af-775f-4ac8-95fc-4532ffad37d1 is being set with open permissions: ugo+rw Nov 03 07:42:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9bd3e4a4-38d6-460f-8460-68fc54dc0758 tempest-VolumeDependencyTests-1310677104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-877b47af-775f-4ac8-95fc-4532ffad37d1 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:21 devstack sudo[101432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-877b47af-775f-4ac8-95fc-4532ffad37d1 Nov 03 07:42:21 devstack sudo[101432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:21 devstack sudo[101432]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9bd3e4a4-38d6-460f-8460-68fc54dc0758 tempest-VolumeDependencyTests-1310677104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-877b47af-775f-4ac8-95fc-4532ffad37d1" returned: 0 in 0.389s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:21 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-9bd3e4a4-38d6-460f-8460-68fc54dc0758 tempest-VolumeDependencyTests-1310677104 None] Lock "cinder-quobyte-877b47af-775f-4ac8-95fc-4532ffad37d1" released by "_copy_volume_from_snapshot" :: held 12.441s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:21 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-9bd3e4a4-38d6-460f-8460-68fc54dc0758 tempest-VolumeDependencyTests-1310677104 None] Lock "cinder-quobyte-0a808fd3-c2a7-4295-939f-5a10b387e53f-877b47af-775f-4ac8-95fc-4532ffad37d1" released by "_create_volume_from_snapshot" :: held 12.553s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-9bd3e4a4-38d6-460f-8460-68fc54dc0758 tempest-VolumeDependencyTests-1310677104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.580s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:21 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-9bd3e4a4-38d6-460f-8460-68fc54dc0758 tempest-VolumeDependencyTests-1310677104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d82c3b1-4a56-457e-a7bd-79ef994dce1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-877b47af-775f-4ac8-95fc-4532ffad37d1', 'volume_size': 1, 'snapshot_id': '0a808fd3-c2a7-4295-939f-5a10b387e53f'}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:21 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-9bd3e4a4-38d6-460f-8460-68fc54dc0758 tempest-VolumeDependencyTests-1310677104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17072171-4ec8-45a9-94b7-23cb452e7e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:21 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-9bd3e4a4-38d6-460f-8460-68fc54dc0758 tempest-VolumeDependencyTests-1310677104 None] Volume volume-877b47af-775f-4ac8-95fc-4532ffad37d1 (877b47af-775f-4ac8-95fc-4532ffad37d1): created successfully Nov 03 07:42:21 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-9bd3e4a4-38d6-460f-8460-68fc54dc0758 tempest-VolumeDependencyTests-1310677104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17072171-4ec8-45a9-94b7-23cb452e7e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:21 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-9bd3e4a4-38d6-460f-8460-68fc54dc0758 tempest-VolumeDependencyTests-1310677104 None] Flow 'volume_create_manager' (c991cc10-2620-4123-9d20-e7168845e201) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:42:21 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-9bd3e4a4-38d6-460f-8460-68fc54dc0758 tempest-VolumeDependencyTests-1310677104 None] Created volume successfully. Nov 03 07:42:22 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-ceda8088-d4a4-4fea-b4ab-38b7a3fef5c1 tempest-CreateVolumesFromImageTest-369757415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:42:22 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ceda8088-d4a4-4fea-b4ab-38b7a3fef5c1 tempest-CreateVolumesFromImageTest-369757415 None] Flow 'volume_create_manager' (9a1f3041-7f0b-4f94-926b-0649e6fa5ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:42:22 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ceda8088-d4a4-4fea-b4ab-38b7a3fef5c1 tempest-CreateVolumesFromImageTest-369757415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6b4c02e-defe-41bb-a139-1b1956716bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:22 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ceda8088-d4a4-4fea-b4ab-38b7a3fef5c1 tempest-CreateVolumesFromImageTest-369757415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6b4c02e-defe-41bb-a139-1b1956716bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:42:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1373746039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c301beb2-2743-4442-b583-5233a9d7d507,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='524f677b0385471fbc3f01961c71157f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:42:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:42:22Z,use_quota=True,user_id='378858c0a7104599b42b8e832e48e5e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:22 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ceda8088-d4a4-4fea-b4ab-38b7a3fef5c1 tempest-CreateVolumesFromImageTest-369757415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f202672-299e-4de0-8127-ba2da4c8498c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:22 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ceda8088-d4a4-4fea-b4ab-38b7a3fef5c1 tempest-CreateVolumesFromImageTest-369757415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f202672-299e-4de0-8127-ba2da4c8498c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:22 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ceda8088-d4a4-4fea-b4ab-38b7a3fef5c1 tempest-CreateVolumesFromImageTest-369757415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93091a35-e330-46e7-b4d5-c0a314c6f47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:22 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ceda8088-d4a4-4fea-b4ab-38b7a3fef5c1 tempest-CreateVolumesFromImageTest-369757415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93091a35-e330-46e7-b4d5-c0a314c6f47b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c301beb2-2743-4442-b583-5233a9d7d507', 'volume_name': 'volume-c301beb2-2743-4442-b583-5233a9d7d507', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:22 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ceda8088-d4a4-4fea-b4ab-38b7a3fef5c1 tempest-CreateVolumesFromImageTest-369757415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38440954-bb3e-4018-8dbe-9384e92b986f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:22 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ceda8088-d4a4-4fea-b4ab-38b7a3fef5c1 tempest-CreateVolumesFromImageTest-369757415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38440954-bb3e-4018-8dbe-9384e92b986f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:22 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ceda8088-d4a4-4fea-b4ab-38b7a3fef5c1 tempest-CreateVolumesFromImageTest-369757415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff062d4d-4e9a-4b66-9dca-1e095ba41a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:22 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-ceda8088-d4a4-4fea-b4ab-38b7a3fef5c1 tempest-CreateVolumesFromImageTest-369757415 None] Volume c301beb2-2743-4442-b583-5233a9d7d507: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c301beb2-2743-4442-b583-5233a9d7d507', 'volume_size': 1} Nov 03 07:42:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-ceda8088-d4a4-4fea-b4ab-38b7a3fef5c1 tempest-CreateVolumesFromImageTest-369757415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-ceda8088-d4a4-4fea-b4ab-38b7a3fef5c1 tempest-CreateVolumesFromImageTest-369757415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:22 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-ceda8088-d4a4-4fea-b4ab-38b7a3fef5c1 tempest-CreateVolumesFromImageTest-369757415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:42:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1373746039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c301beb2-2743-4442-b583-5233a9d7d507,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='524f677b0385471fbc3f01961c71157f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:42:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:42:22Z,use_quota=True,user_id='378858c0a7104599b42b8e832e48e5e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:42:22 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-ceda8088-d4a4-4fea-b4ab-38b7a3fef5c1 tempest-CreateVolumesFromImageTest-369757415 None] Creating volume c301beb2-2743-4442-b583-5233a9d7d507 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:42:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-ceda8088-d4a4-4fea-b4ab-38b7a3fef5c1 tempest-CreateVolumesFromImageTest-369757415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-ceda8088-d4a4-4fea-b4ab-38b7a3fef5c1 tempest-CreateVolumesFromImageTest-369757415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:22 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-ceda8088-d4a4-4fea-b4ab-38b7a3fef5c1 tempest-CreateVolumesFromImageTest-369757415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:42:22 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-ceda8088-d4a4-4fea-b4ab-38b7a3fef5c1 tempest-CreateVolumesFromImageTest-369757415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:42:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-ceda8088-d4a4-4fea-b4ab-38b7a3fef5c1 tempest-CreateVolumesFromImageTest-369757415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:22 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-ceda8088-d4a4-4fea-b4ab-38b7a3fef5c1 tempest-CreateVolumesFromImageTest-369757415 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:42:22 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-ceda8088-d4a4-4fea-b4ab-38b7a3fef5c1 tempest-CreateVolumesFromImageTest-369757415 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:42:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ceda8088-d4a4-4fea-b4ab-38b7a3fef5c1 tempest-CreateVolumesFromImageTest-369757415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c301beb2-2743-4442-b583-5233a9d7d507 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:22 devstack sudo[101435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c301beb2-2743-4442-b583-5233a9d7d507 1073741824 Nov 03 07:42:22 devstack sudo[101435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:22 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-32336ef1-0f2d-4877-b112-6d1150d04474 tempest-VolumeDependencyTests-1310677104 None] Acquiring lock "cinder-0a808fd3-c2a7-4295-939f-5a10b387e53f-delete_snapshot" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:22 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-32336ef1-0f2d-4877-b112-6d1150d04474 tempest-VolumeDependencyTests-1310677104 None] Lock "cinder-0a808fd3-c2a7-4295-939f-5a10b387e53f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.083s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:22 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-32336ef1-0f2d-4877-b112-6d1150d04474 tempest-VolumeDependencyTests-1310677104 None] Acquiring lock "cinder-quobyte-4faba15e-d946-4025-aa03-102c04643393" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:22 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-32336ef1-0f2d-4877-b112-6d1150d04474 tempest-VolumeDependencyTests-1310677104 None] Lock "cinder-quobyte-4faba15e-d946-4025-aa03-102c04643393" acquired by "delete_snapshot" :: waited 0.063s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:22 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-32336ef1-0f2d-4877-b112-6d1150d04474 tempest-VolumeDependencyTests-1310677104 None] Acquiring lock "cinder-quobyte-0a808fd3-c2a7-4295-939f-5a10b387e53f" by "_delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:22 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-32336ef1-0f2d-4877-b112-6d1150d04474 tempest-VolumeDependencyTests-1310677104 None] Lock "cinder-quobyte-0a808fd3-c2a7-4295-939f-5a10b387e53f" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:22 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-32336ef1-0f2d-4877-b112-6d1150d04474 tempest-VolumeDependencyTests-1310677104 None] Deleting offline snapshot 0a808fd3-c2a7-4295-939f-5a10b387e53f of volume 4faba15e-d946-4025-aa03-102c04643393 {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:42:22 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-32336ef1-0f2d-4877-b112-6d1150d04474 tempest-VolumeDependencyTests-1310677104 None] snapshot_file for this snap is: volume-4faba15e-d946-4025-aa03-102c04643393.0a808fd3-c2a7-4295-939f-5a10b387e53f {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:42:23 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2d6ae3-ba44-4192-b0ab-59dfcc46ad14]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:42:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-32336ef1-0f2d-4877-b112-6d1150d04474 tempest-VolumeDependencyTests-1310677104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4faba15e-d946-4025-aa03-102c04643393.0a808fd3-c2a7-4295-939f-5a10b387e53f {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:23 devstack sudo[101472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4faba15e-d946-4025-aa03-102c04643393.0a808fd3-c2a7-4295-939f-5a10b387e53f Nov 03 07:42:23 devstack sudo[101472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:23 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-b25c2096-86fd-4a1e-a7aa-a580d26c5989 tempest-CreateVolumesFromImageTest-369757415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:42:23 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b25c2096-86fd-4a1e-a7aa-a580d26c5989 tempest-CreateVolumesFromImageTest-369757415 None] Flow 'volume_create_manager' (f19a0996-34dc-41c7-8fd1-9900b6628518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:42:23 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b25c2096-86fd-4a1e-a7aa-a580d26c5989 tempest-CreateVolumesFromImageTest-369757415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c87d841-9ece-4fc7-a2dc-a4693b59e453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:23 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b25c2096-86fd-4a1e-a7aa-a580d26c5989 tempest-CreateVolumesFromImageTest-369757415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c87d841-9ece-4fc7-a2dc-a4693b59e453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:42:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-787312629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=406ccd36-16c7-460c-a7a1-d1e047dcf4c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='524f677b0385471fbc3f01961c71157f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:42:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:42:23Z,use_quota=True,user_id='378858c0a7104599b42b8e832e48e5e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:23 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b25c2096-86fd-4a1e-a7aa-a580d26c5989 tempest-CreateVolumesFromImageTest-369757415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0305717-a028-48e8-8628-179592f783fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:23 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b25c2096-86fd-4a1e-a7aa-a580d26c5989 tempest-CreateVolumesFromImageTest-369757415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0305717-a028-48e8-8628-179592f783fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:23 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b25c2096-86fd-4a1e-a7aa-a580d26c5989 tempest-CreateVolumesFromImageTest-369757415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b42cebf-ba5b-4566-a4c3-2645e6ab73fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:23 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b25c2096-86fd-4a1e-a7aa-a580d26c5989 tempest-CreateVolumesFromImageTest-369757415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b42cebf-ba5b-4566-a4c3-2645e6ab73fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '406ccd36-16c7-460c-a7a1-d1e047dcf4c9', 'volume_name': 'volume-406ccd36-16c7-460c-a7a1-d1e047dcf4c9', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:23 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b25c2096-86fd-4a1e-a7aa-a580d26c5989 tempest-CreateVolumesFromImageTest-369757415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (142b7a09-1097-4dca-9482-a624fc920326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:23 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b25c2096-86fd-4a1e-a7aa-a580d26c5989 tempest-CreateVolumesFromImageTest-369757415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (142b7a09-1097-4dca-9482-a624fc920326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:23 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b25c2096-86fd-4a1e-a7aa-a580d26c5989 tempest-CreateVolumesFromImageTest-369757415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47af0e8c-3a93-4a74-903f-911869b2521d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:23 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-b25c2096-86fd-4a1e-a7aa-a580d26c5989 tempest-CreateVolumesFromImageTest-369757415 None] Volume 406ccd36-16c7-460c-a7a1-d1e047dcf4c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-406ccd36-16c7-460c-a7a1-d1e047dcf4c9', 'volume_size': 1} Nov 03 07:42:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b25c2096-86fd-4a1e-a7aa-a580d26c5989 tempest-CreateVolumesFromImageTest-369757415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:23 devstack sudo[101435]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ceda8088-d4a4-4fea-b4ab-38b7a3fef5c1 tempest-CreateVolumesFromImageTest-369757415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c301beb2-2743-4442-b583-5233a9d7d507 1073741824" returned: 0 in 1.154s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:23 devstack sudo[101472]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-32336ef1-0f2d-4877-b112-6d1150d04474 tempest-VolumeDependencyTests-1310677104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4faba15e-d946-4025-aa03-102c04643393.0a808fd3-c2a7-4295-939f-5a10b387e53f" returned: 0 in 0.818s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:23 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-32336ef1-0f2d-4877-b112-6d1150d04474 tempest-VolumeDependencyTests-1310677104 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4faba15e-d946-4025-aa03-102c04643393(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:42:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ceda8088-d4a4-4fea-b4ab-38b7a3fef5c1 tempest-CreateVolumesFromImageTest-369757415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c301beb2-2743-4442-b583-5233a9d7d507 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:23 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1b5244-541e-4bf2-a2a3-48b76e0d3acc]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:42:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-32336ef1-0f2d-4877-b112-6d1150d04474 tempest-VolumeDependencyTests-1310677104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4faba15e-d946-4025-aa03-102c04643393 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:23 devstack sudo[101496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c301beb2-2743-4442-b583-5233a9d7d507 Nov 03 07:42:23 devstack sudo[101496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:24 devstack sudo[101497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4faba15e-d946-4025-aa03-102c04643393 Nov 03 07:42:24 devstack sudo[101497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:24 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe038019-7790-4239-9c66-6b051abc866f tempest-CreateVolumesFromImageTest-369757415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:42:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fe038019-7790-4239-9c66-6b051abc866f tempest-CreateVolumesFromImageTest-369757415 None] Flow 'volume_create_manager' (729d6846-2c2a-472d-8132-cd728ce1c8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:42:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fe038019-7790-4239-9c66-6b051abc866f tempest-CreateVolumesFromImageTest-369757415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17c2a075-0d04-4d03-afcd-c0908c94a4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fe038019-7790-4239-9c66-6b051abc866f tempest-CreateVolumesFromImageTest-369757415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17c2a075-0d04-4d03-afcd-c0908c94a4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:42:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-881919293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3782d31-82ba-4de7-ab81-e1a3f49ebd40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='524f677b0385471fbc3f01961c71157f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:42:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:42:24Z,use_quota=True,user_id='378858c0a7104599b42b8e832e48e5e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fe038019-7790-4239-9c66-6b051abc866f tempest-CreateVolumesFromImageTest-369757415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40eaf57b-732f-4427-b516-b9f0d8bade62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fe038019-7790-4239-9c66-6b051abc866f tempest-CreateVolumesFromImageTest-369757415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40eaf57b-732f-4427-b516-b9f0d8bade62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fe038019-7790-4239-9c66-6b051abc866f tempest-CreateVolumesFromImageTest-369757415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (963f1fb6-cd4a-467b-bd07-7b3a0094bb24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fe038019-7790-4239-9c66-6b051abc866f tempest-CreateVolumesFromImageTest-369757415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (963f1fb6-cd4a-467b-bd07-7b3a0094bb24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3782d31-82ba-4de7-ab81-e1a3f49ebd40', 'volume_name': 'volume-a3782d31-82ba-4de7-ab81-e1a3f49ebd40', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fe038019-7790-4239-9c66-6b051abc866f tempest-CreateVolumesFromImageTest-369757415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (275f4fcb-035c-44a0-9f8d-eb52c3578f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fe038019-7790-4239-9c66-6b051abc866f tempest-CreateVolumesFromImageTest-369757415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (275f4fcb-035c-44a0-9f8d-eb52c3578f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fe038019-7790-4239-9c66-6b051abc866f tempest-CreateVolumesFromImageTest-369757415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f2b955b-2c3b-4f08-883d-fd65ac5acd87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:24 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-fe038019-7790-4239-9c66-6b051abc866f tempest-CreateVolumesFromImageTest-369757415 None] Volume a3782d31-82ba-4de7-ab81-e1a3f49ebd40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3782d31-82ba-4de7-ab81-e1a3f49ebd40', 'volume_size': 1} Nov 03 07:42:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-fe038019-7790-4239-9c66-6b051abc866f tempest-CreateVolumesFromImageTest-369757415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:24 devstack sudo[101496]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ceda8088-d4a4-4fea-b4ab-38b7a3fef5c1 tempest-CreateVolumesFromImageTest-369757415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c301beb2-2743-4442-b583-5233a9d7d507" returned: 0 in 0.483s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:24 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-ceda8088-d4a4-4fea-b4ab-38b7a3fef5c1 tempest-CreateVolumesFromImageTest-369757415 None] <== create_volume: return (1811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:42:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-ceda8088-d4a4-4fea-b4ab-38b7a3fef5c1 tempest-CreateVolumesFromImageTest-369757415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.817s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b25c2096-86fd-4a1e-a7aa-a580d26c5989 tempest-CreateVolumesFromImageTest-369757415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.697s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:24 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b25c2096-86fd-4a1e-a7aa-a580d26c5989 tempest-CreateVolumesFromImageTest-369757415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:42:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-787312629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=406ccd36-16c7-460c-a7a1-d1e047dcf4c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='524f677b0385471fbc3f01961c71157f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:42:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:42:23Z,use_quota=True,user_id='378858c0a7104599b42b8e832e48e5e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:42:24 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-b25c2096-86fd-4a1e-a7aa-a580d26c5989 tempest-CreateVolumesFromImageTest-369757415 None] Creating volume 406ccd36-16c7-460c-a7a1-d1e047dcf4c9 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:42:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b25c2096-86fd-4a1e-a7aa-a580d26c5989 tempest-CreateVolumesFromImageTest-369757415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b25c2096-86fd-4a1e-a7aa-a580d26c5989 tempest-CreateVolumesFromImageTest-369757415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:24 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b25c2096-86fd-4a1e-a7aa-a580d26c5989 tempest-CreateVolumesFromImageTest-369757415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:42:24 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b25c2096-86fd-4a1e-a7aa-a580d26c5989 tempest-CreateVolumesFromImageTest-369757415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:42:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b25c2096-86fd-4a1e-a7aa-a580d26c5989 tempest-CreateVolumesFromImageTest-369757415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:24 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b25c2096-86fd-4a1e-a7aa-a580d26c5989 tempest-CreateVolumesFromImageTest-369757415 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:42:24 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-b25c2096-86fd-4a1e-a7aa-a580d26c5989 tempest-CreateVolumesFromImageTest-369757415 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:42:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b25c2096-86fd-4a1e-a7aa-a580d26c5989 tempest-CreateVolumesFromImageTest-369757415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-406ccd36-16c7-460c-a7a1-d1e047dcf4c9 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ceda8088-d4a4-4fea-b4ab-38b7a3fef5c1 tempest-CreateVolumesFromImageTest-369757415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff062d4d-4e9a-4b66-9dca-1e095ba41a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c301beb2-2743-4442-b583-5233a9d7d507', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:24 devstack sudo[101501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-406ccd36-16c7-460c-a7a1-d1e047dcf4c9 1073741824 Nov 03 07:42:24 devstack sudo[101501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ceda8088-d4a4-4fea-b4ab-38b7a3fef5c1 tempest-CreateVolumesFromImageTest-369757415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ecdf11b-24fc-4a41-b515-d17053500c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:24 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-ceda8088-d4a4-4fea-b4ab-38b7a3fef5c1 tempest-CreateVolumesFromImageTest-369757415 None] Volume volume-c301beb2-2743-4442-b583-5233a9d7d507 (c301beb2-2743-4442-b583-5233a9d7d507): created successfully Nov 03 07:42:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ceda8088-d4a4-4fea-b4ab-38b7a3fef5c1 tempest-CreateVolumesFromImageTest-369757415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ecdf11b-24fc-4a41-b515-d17053500c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ceda8088-d4a4-4fea-b4ab-38b7a3fef5c1 tempest-CreateVolumesFromImageTest-369757415 None] Flow 'volume_create_manager' (9a1f3041-7f0b-4f94-926b-0649e6fa5ba1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:42:24 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-ceda8088-d4a4-4fea-b4ab-38b7a3fef5c1 tempest-CreateVolumesFromImageTest-369757415 None] Created volume successfully. Nov 03 07:42:24 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ce811a7-159f-4b77-bcf7-ebc515eccdd2 tempest-CreateVolumesFromImageTest-369757415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:42:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-1ce811a7-159f-4b77-bcf7-ebc515eccdd2 tempest-CreateVolumesFromImageTest-369757415 None] Flow 'volume_create_manager' (bfc66372-6305-4629-b808-ce9d0a700d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:42:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-1ce811a7-159f-4b77-bcf7-ebc515eccdd2 tempest-CreateVolumesFromImageTest-369757415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca22e226-54d3-4580-aa47-c7f40aa693f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-1ce811a7-159f-4b77-bcf7-ebc515eccdd2 tempest-CreateVolumesFromImageTest-369757415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca22e226-54d3-4580-aa47-c7f40aa693f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:42:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1951382952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6af6ec5d-05f9-4b83-b8af-b18b7cb24e19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='524f677b0385471fbc3f01961c71157f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:42:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:42:25Z,use_quota=True,user_id='378858c0a7104599b42b8e832e48e5e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-1ce811a7-159f-4b77-bcf7-ebc515eccdd2 tempest-CreateVolumesFromImageTest-369757415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22443a31-9a05-4f0c-a0f7-24f6cd69dd14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:24 devstack sudo[101497]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-1ce811a7-159f-4b77-bcf7-ebc515eccdd2 tempest-CreateVolumesFromImageTest-369757415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22443a31-9a05-4f0c-a0f7-24f6cd69dd14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-1ce811a7-159f-4b77-bcf7-ebc515eccdd2 tempest-CreateVolumesFromImageTest-369757415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe5b850b-d1aa-4e2d-8ad8-642ae13e0751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-1ce811a7-159f-4b77-bcf7-ebc515eccdd2 tempest-CreateVolumesFromImageTest-369757415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe5b850b-d1aa-4e2d-8ad8-642ae13e0751) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6af6ec5d-05f9-4b83-b8af-b18b7cb24e19', 'volume_name': 'volume-6af6ec5d-05f9-4b83-b8af-b18b7cb24e19', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-1ce811a7-159f-4b77-bcf7-ebc515eccdd2 tempest-CreateVolumesFromImageTest-369757415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16d93ae7-4146-4632-b4bd-2531c43fd679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-1ce811a7-159f-4b77-bcf7-ebc515eccdd2 tempest-CreateVolumesFromImageTest-369757415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16d93ae7-4146-4632-b4bd-2531c43fd679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:25 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-1ce811a7-159f-4b77-bcf7-ebc515eccdd2 tempest-CreateVolumesFromImageTest-369757415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e33ecdab-2e49-432b-a5a4-e83a345c0db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:25 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-1ce811a7-159f-4b77-bcf7-ebc515eccdd2 tempest-CreateVolumesFromImageTest-369757415 None] Volume 6af6ec5d-05f9-4b83-b8af-b18b7cb24e19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6af6ec5d-05f9-4b83-b8af-b18b7cb24e19', 'volume_size': 1} Nov 03 07:42:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-1ce811a7-159f-4b77-bcf7-ebc515eccdd2 tempest-CreateVolumesFromImageTest-369757415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-32336ef1-0f2d-4877-b112-6d1150d04474 tempest-VolumeDependencyTests-1310677104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4faba15e-d946-4025-aa03-102c04643393" returned: 0 in 1.055s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-32336ef1-0f2d-4877-b112-6d1150d04474 tempest-VolumeDependencyTests-1310677104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4faba15e-d946-4025-aa03-102c04643393.0a808fd3-c2a7-4295-939f-5a10b387e53f {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:25 devstack sudo[101510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4faba15e-d946-4025-aa03-102c04643393.0a808fd3-c2a7-4295-939f-5a10b387e53f Nov 03 07:42:25 devstack sudo[101510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:25 devstack sudo[101501]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b25c2096-86fd-4a1e-a7aa-a580d26c5989 tempest-CreateVolumesFromImageTest-369757415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-406ccd36-16c7-460c-a7a1-d1e047dcf4c9 1073741824" returned: 0 in 0.824s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b25c2096-86fd-4a1e-a7aa-a580d26c5989 tempest-CreateVolumesFromImageTest-369757415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-406ccd36-16c7-460c-a7a1-d1e047dcf4c9 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:25 devstack sudo[101514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-406ccd36-16c7-460c-a7a1-d1e047dcf4c9 Nov 03 07:42:25 devstack sudo[101514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:25 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2e44f6f-4c3b-44ba-8956-faa5b648bdec tempest-CreateVolumesFromImageTest-369757415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:42:25 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f2e44f6f-4c3b-44ba-8956-faa5b648bdec tempest-CreateVolumesFromImageTest-369757415 None] Flow 'volume_create_manager' (1b48e3ff-b4a4-4e37-a18a-5751213a288c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:42:25 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f2e44f6f-4c3b-44ba-8956-faa5b648bdec tempest-CreateVolumesFromImageTest-369757415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffcaace0-def5-41fe-85d9-e62a3cd1229d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:25 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f2e44f6f-4c3b-44ba-8956-faa5b648bdec tempest-CreateVolumesFromImageTest-369757415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffcaace0-def5-41fe-85d9-e62a3cd1229d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:42:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-217312601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75106044-45bd-420c-adf6-1d54b94c747f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='524f677b0385471fbc3f01961c71157f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:42:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:42:25Z,use_quota=True,user_id='378858c0a7104599b42b8e832e48e5e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:25 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f2e44f6f-4c3b-44ba-8956-faa5b648bdec tempest-CreateVolumesFromImageTest-369757415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e3d997d-9b9e-4952-80ab-a16947b6e2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:25 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f2e44f6f-4c3b-44ba-8956-faa5b648bdec tempest-CreateVolumesFromImageTest-369757415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e3d997d-9b9e-4952-80ab-a16947b6e2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:25 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f2e44f6f-4c3b-44ba-8956-faa5b648bdec tempest-CreateVolumesFromImageTest-369757415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7611e0d2-a382-4154-995f-285669275498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:25 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f2e44f6f-4c3b-44ba-8956-faa5b648bdec tempest-CreateVolumesFromImageTest-369757415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7611e0d2-a382-4154-995f-285669275498) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75106044-45bd-420c-adf6-1d54b94c747f', 'volume_name': 'volume-75106044-45bd-420c-adf6-1d54b94c747f', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:25 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f2e44f6f-4c3b-44ba-8956-faa5b648bdec tempest-CreateVolumesFromImageTest-369757415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa7d5699-c9cc-4592-a887-59d11c8225f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:25 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f2e44f6f-4c3b-44ba-8956-faa5b648bdec tempest-CreateVolumesFromImageTest-369757415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa7d5699-c9cc-4592-a887-59d11c8225f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:25 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f2e44f6f-4c3b-44ba-8956-faa5b648bdec tempest-CreateVolumesFromImageTest-369757415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (059f4e19-ae6b-48f8-b399-cad58c79dbc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:25 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-f2e44f6f-4c3b-44ba-8956-faa5b648bdec tempest-CreateVolumesFromImageTest-369757415 None] Volume 75106044-45bd-420c-adf6-1d54b94c747f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75106044-45bd-420c-adf6-1d54b94c747f', 'volume_size': 1} Nov 03 07:42:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-f2e44f6f-4c3b-44ba-8956-faa5b648bdec tempest-CreateVolumesFromImageTest-369757415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:25 devstack sudo[101510]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-32336ef1-0f2d-4877-b112-6d1150d04474 tempest-VolumeDependencyTests-1310677104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4faba15e-d946-4025-aa03-102c04643393.0a808fd3-c2a7-4295-939f-5a10b387e53f" returned: 0 in 0.545s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-32336ef1-0f2d-4877-b112-6d1150d04474 tempest-VolumeDependencyTests-1310677104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4faba15e-d946-4025-aa03-102c04643393.0a808fd3-c2a7-4295-939f-5a10b387e53f {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:25 devstack sudo[101519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4faba15e-d946-4025-aa03-102c04643393.0a808fd3-c2a7-4295-939f-5a10b387e53f Nov 03 07:42:25 devstack sudo[101519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:25 devstack sudo[101514]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b25c2096-86fd-4a1e-a7aa-a580d26c5989 tempest-CreateVolumesFromImageTest-369757415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-406ccd36-16c7-460c-a7a1-d1e047dcf4c9" returned: 0 in 0.374s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:25 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b25c2096-86fd-4a1e-a7aa-a580d26c5989 tempest-CreateVolumesFromImageTest-369757415 None] <== create_volume: return (1328ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:42:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b25c2096-86fd-4a1e-a7aa-a580d26c5989 tempest-CreateVolumesFromImageTest-369757415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.332s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-fe038019-7790-4239-9c66-6b051abc866f tempest-CreateVolumesFromImageTest-369757415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.390s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:25 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-fe038019-7790-4239-9c66-6b051abc866f tempest-CreateVolumesFromImageTest-369757415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:42:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-881919293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3782d31-82ba-4de7-ab81-e1a3f49ebd40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='524f677b0385471fbc3f01961c71157f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:42:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:42:24Z,use_quota=True,user_id='378858c0a7104599b42b8e832e48e5e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:42:25 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-fe038019-7790-4239-9c66-6b051abc866f tempest-CreateVolumesFromImageTest-369757415 None] Creating volume a3782d31-82ba-4de7-ab81-e1a3f49ebd40 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:42:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-fe038019-7790-4239-9c66-6b051abc866f tempest-CreateVolumesFromImageTest-369757415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-fe038019-7790-4239-9c66-6b051abc866f tempest-CreateVolumesFromImageTest-369757415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:25 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-fe038019-7790-4239-9c66-6b051abc866f tempest-CreateVolumesFromImageTest-369757415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:42:25 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-fe038019-7790-4239-9c66-6b051abc866f tempest-CreateVolumesFromImageTest-369757415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:42:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-fe038019-7790-4239-9c66-6b051abc866f tempest-CreateVolumesFromImageTest-369757415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:25 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-fe038019-7790-4239-9c66-6b051abc866f tempest-CreateVolumesFromImageTest-369757415 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:42:25 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-fe038019-7790-4239-9c66-6b051abc866f tempest-CreateVolumesFromImageTest-369757415 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:42:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fe038019-7790-4239-9c66-6b051abc866f tempest-CreateVolumesFromImageTest-369757415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a3782d31-82ba-4de7-ab81-e1a3f49ebd40 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:25 devstack sudo[101522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a3782d31-82ba-4de7-ab81-e1a3f49ebd40 1073741824 Nov 03 07:42:25 devstack sudo[101522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:25 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b25c2096-86fd-4a1e-a7aa-a580d26c5989 tempest-CreateVolumesFromImageTest-369757415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47af0e8c-3a93-4a74-903f-911869b2521d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-406ccd36-16c7-460c-a7a1-d1e047dcf4c9', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:25 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b25c2096-86fd-4a1e-a7aa-a580d26c5989 tempest-CreateVolumesFromImageTest-369757415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7710893c-c6b0-4f4e-90ed-6204c5f3ccf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:25 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-b25c2096-86fd-4a1e-a7aa-a580d26c5989 tempest-CreateVolumesFromImageTest-369757415 None] Volume volume-406ccd36-16c7-460c-a7a1-d1e047dcf4c9 (406ccd36-16c7-460c-a7a1-d1e047dcf4c9): created successfully Nov 03 07:42:25 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b25c2096-86fd-4a1e-a7aa-a580d26c5989 tempest-CreateVolumesFromImageTest-369757415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7710893c-c6b0-4f4e-90ed-6204c5f3ccf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:25 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b25c2096-86fd-4a1e-a7aa-a580d26c5989 tempest-CreateVolumesFromImageTest-369757415 None] Flow 'volume_create_manager' (f19a0996-34dc-41c7-8fd1-9900b6628518) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:42:25 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-b25c2096-86fd-4a1e-a7aa-a580d26c5989 tempest-CreateVolumesFromImageTest-369757415 None] Created volume successfully. Nov 03 07:42:25 devstack sudo[101519]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-32336ef1-0f2d-4877-b112-6d1150d04474 tempest-VolumeDependencyTests-1310677104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4faba15e-d946-4025-aa03-102c04643393.0a808fd3-c2a7-4295-939f-5a10b387e53f" returned: 0 in 0.336s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:25 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-32336ef1-0f2d-4877-b112-6d1150d04474 tempest-VolumeDependencyTests-1310677104 None] Lock "cinder-quobyte-0a808fd3-c2a7-4295-939f-5a10b387e53f" released by "_delete_snapshot" :: held 3.038s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:25 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-32336ef1-0f2d-4877-b112-6d1150d04474 tempest-VolumeDependencyTests-1310677104 None] Lock "cinder-quobyte-4faba15e-d946-4025-aa03-102c04643393" released by "delete_snapshot" :: held 3.093s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:26 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-32336ef1-0f2d-4877-b112-6d1150d04474 tempest-VolumeDependencyTests-1310677104 None] Created reservations ['049cd510-b661-4d89-9ed3-eac8e30852e0', '86d2df62-7a0c-4b2b-9d8e-adee377af922', '1284f3df-5068-4049-8eef-4b9b2828814f', '3310f5fe-703b-4c11-a8c1-efd399a6dece'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:42:26 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-9641eb06-94a0-477f-a52b-8bf1d4978ecc tempest-GroupsTest-1667041417 None] Group tempest-Group1-68086587: creating Nov 03 07:42:26 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-32336ef1-0f2d-4877-b112-6d1150d04474 tempest-VolumeDependencyTests-1310677104 None] Delete snapshot completed successfully. Nov 03 07:42:26 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-32336ef1-0f2d-4877-b112-6d1150d04474 tempest-VolumeDependencyTests-1310677104 None] Lock "cinder-0a808fd3-c2a7-4295-939f-5a10b387e53f-delete_snapshot" released by "delete_snapshot" :: held 3.377s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:26 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-9641eb06-94a0-477f-a52b-8bf1d4978ecc tempest-GroupsTest-1667041417 None] Group tempest-Group1-68086587: created successfully Nov 03 07:42:26 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-9641eb06-94a0-477f-a52b-8bf1d4978ecc tempest-GroupsTest-1667041417 None] Create group completed successfully. Nov 03 07:42:26 devstack sudo[101522]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:26 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fe038019-7790-4239-9c66-6b051abc866f tempest-CreateVolumesFromImageTest-369757415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a3782d31-82ba-4de7-ab81-e1a3f49ebd40 1073741824" returned: 0 in 0.574s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:26 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fe038019-7790-4239-9c66-6b051abc866f tempest-CreateVolumesFromImageTest-369757415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a3782d31-82ba-4de7-ab81-e1a3f49ebd40 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:26 devstack sudo[101528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a3782d31-82ba-4de7-ab81-e1a3f49ebd40 Nov 03 07:42:26 devstack sudo[101528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:26 devstack sudo[101528]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:26 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fe038019-7790-4239-9c66-6b051abc866f tempest-CreateVolumesFromImageTest-369757415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a3782d31-82ba-4de7-ab81-e1a3f49ebd40" returned: 0 in 0.270s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:26 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-fe038019-7790-4239-9c66-6b051abc866f tempest-CreateVolumesFromImageTest-369757415 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:42:26 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-fe038019-7790-4239-9c66-6b051abc866f tempest-CreateVolumesFromImageTest-369757415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:26 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-1ce811a7-159f-4b77-bcf7-ebc515eccdd2 tempest-CreateVolumesFromImageTest-369757415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.649s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:26 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-1ce811a7-159f-4b77-bcf7-ebc515eccdd2 tempest-CreateVolumesFromImageTest-369757415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:42:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1951382952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6af6ec5d-05f9-4b83-b8af-b18b7cb24e19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='524f677b0385471fbc3f01961c71157f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:42:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:42:25Z,use_quota=True,user_id='378858c0a7104599b42b8e832e48e5e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:42:26 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-1ce811a7-159f-4b77-bcf7-ebc515eccdd2 tempest-CreateVolumesFromImageTest-369757415 None] Creating volume 6af6ec5d-05f9-4b83-b8af-b18b7cb24e19 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:42:26 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-1ce811a7-159f-4b77-bcf7-ebc515eccdd2 tempest-CreateVolumesFromImageTest-369757415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:26 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-1ce811a7-159f-4b77-bcf7-ebc515eccdd2 tempest-CreateVolumesFromImageTest-369757415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:26 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-1ce811a7-159f-4b77-bcf7-ebc515eccdd2 tempest-CreateVolumesFromImageTest-369757415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:42:26 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-1ce811a7-159f-4b77-bcf7-ebc515eccdd2 tempest-CreateVolumesFromImageTest-369757415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:42:26 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-1ce811a7-159f-4b77-bcf7-ebc515eccdd2 tempest-CreateVolumesFromImageTest-369757415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:26 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-1ce811a7-159f-4b77-bcf7-ebc515eccdd2 tempest-CreateVolumesFromImageTest-369757415 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:42:26 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-1ce811a7-159f-4b77-bcf7-ebc515eccdd2 tempest-CreateVolumesFromImageTest-369757415 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:42:26 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1ce811a7-159f-4b77-bcf7-ebc515eccdd2 tempest-CreateVolumesFromImageTest-369757415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6af6ec5d-05f9-4b83-b8af-b18b7cb24e19 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:26 devstack sudo[101531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6af6ec5d-05f9-4b83-b8af-b18b7cb24e19 1073741824 Nov 03 07:42:26 devstack sudo[101531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:26 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fe038019-7790-4239-9c66-6b051abc866f tempest-CreateVolumesFromImageTest-369757415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f2b955b-2c3b-4f08-883d-fd65ac5acd87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3782d31-82ba-4de7-ab81-e1a3f49ebd40', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:26 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fe038019-7790-4239-9c66-6b051abc866f tempest-CreateVolumesFromImageTest-369757415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54d84c56-a261-4e29-932b-f499999027eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:26 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-fe038019-7790-4239-9c66-6b051abc866f tempest-CreateVolumesFromImageTest-369757415 None] Volume volume-a3782d31-82ba-4de7-ab81-e1a3f49ebd40 (a3782d31-82ba-4de7-ab81-e1a3f49ebd40): created successfully Nov 03 07:42:26 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fe038019-7790-4239-9c66-6b051abc866f tempest-CreateVolumesFromImageTest-369757415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54d84c56-a261-4e29-932b-f499999027eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:26 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fe038019-7790-4239-9c66-6b051abc866f tempest-CreateVolumesFromImageTest-369757415 None] Flow 'volume_create_manager' (729d6846-2c2a-472d-8132-cd728ce1c8a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:42:26 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-fe038019-7790-4239-9c66-6b051abc866f tempest-CreateVolumesFromImageTest-369757415 None] Created volume successfully. Nov 03 07:42:27 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-8797e9af-cde5-467e-945e-2dc42e12045f tempest-VolumeDependencyTests-1310677104 None] Acquiring lock "cinder-4faba15e-d946-4025-aa03-102c04643393-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:27 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-8797e9af-cde5-467e-945e-2dc42e12045f tempest-VolumeDependencyTests-1310677104 None] Lock "cinder-4faba15e-d946-4025-aa03-102c04643393-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:27 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-8797e9af-cde5-467e-945e-2dc42e12045f tempest-VolumeDependencyTests-1310677104 None] Acquiring lock "cinder-quobyte-4faba15e-d946-4025-aa03-102c04643393" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:27 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-8797e9af-cde5-467e-945e-2dc42e12045f tempest-VolumeDependencyTests-1310677104 None] Lock "cinder-quobyte-4faba15e-d946-4025-aa03-102c04643393" acquired by "delete_volume" :: waited 0.020s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:27 devstack sudo[101531]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1ce811a7-159f-4b77-bcf7-ebc515eccdd2 tempest-CreateVolumesFromImageTest-369757415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6af6ec5d-05f9-4b83-b8af-b18b7cb24e19 1073741824" returned: 0 in 0.620s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:27 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b6b79d3-dd8f-4c53-a301-af26aef9bb5f]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:42:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8797e9af-cde5-467e-945e-2dc42e12045f tempest-VolumeDependencyTests-1310677104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4faba15e-d946-4025-aa03-102c04643393 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1ce811a7-159f-4b77-bcf7-ebc515eccdd2 tempest-CreateVolumesFromImageTest-369757415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6af6ec5d-05f9-4b83-b8af-b18b7cb24e19 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:27 devstack sudo[101538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6af6ec5d-05f9-4b83-b8af-b18b7cb24e19 Nov 03 07:42:27 devstack sudo[101538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:27 devstack sudo[101537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4faba15e-d946-4025-aa03-102c04643393 Nov 03 07:42:27 devstack sudo[101537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:27 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-c78c6e5a-cd2b-4568-9c75-c748930216c5 tempest-GroupsTest-1667041417 None] Group tempest-Group2-347592319: creating Nov 03 07:42:27 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-c78c6e5a-cd2b-4568-9c75-c748930216c5 tempest-GroupsTest-1667041417 None] Group tempest-Group2-347592319: created successfully Nov 03 07:42:27 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-c78c6e5a-cd2b-4568-9c75-c748930216c5 tempest-GroupsTest-1667041417 None] Create group completed successfully. Nov 03 07:42:27 devstack sudo[101538]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1ce811a7-159f-4b77-bcf7-ebc515eccdd2 tempest-CreateVolumesFromImageTest-369757415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6af6ec5d-05f9-4b83-b8af-b18b7cb24e19" returned: 0 in 0.375s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:27 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-1ce811a7-159f-4b77-bcf7-ebc515eccdd2 tempest-CreateVolumesFromImageTest-369757415 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:42:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-1ce811a7-159f-4b77-bcf7-ebc515eccdd2 tempest-CreateVolumesFromImageTest-369757415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-f2e44f6f-4c3b-44ba-8956-faa5b648bdec tempest-CreateVolumesFromImageTest-369757415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.182s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:27 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-f2e44f6f-4c3b-44ba-8956-faa5b648bdec tempest-CreateVolumesFromImageTest-369757415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:42:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-217312601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75106044-45bd-420c-adf6-1d54b94c747f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='524f677b0385471fbc3f01961c71157f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:42:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:42:25Z,use_quota=True,user_id='378858c0a7104599b42b8e832e48e5e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:42:27 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-f2e44f6f-4c3b-44ba-8956-faa5b648bdec tempest-CreateVolumesFromImageTest-369757415 None] Creating volume 75106044-45bd-420c-adf6-1d54b94c747f {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:42:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-f2e44f6f-4c3b-44ba-8956-faa5b648bdec tempest-CreateVolumesFromImageTest-369757415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-f2e44f6f-4c3b-44ba-8956-faa5b648bdec tempest-CreateVolumesFromImageTest-369757415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:27 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-f2e44f6f-4c3b-44ba-8956-faa5b648bdec tempest-CreateVolumesFromImageTest-369757415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:42:27 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-f2e44f6f-4c3b-44ba-8956-faa5b648bdec tempest-CreateVolumesFromImageTest-369757415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:42:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-f2e44f6f-4c3b-44ba-8956-faa5b648bdec tempest-CreateVolumesFromImageTest-369757415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:27 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-f2e44f6f-4c3b-44ba-8956-faa5b648bdec tempest-CreateVolumesFromImageTest-369757415 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:42:27 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-f2e44f6f-4c3b-44ba-8956-faa5b648bdec tempest-CreateVolumesFromImageTest-369757415 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:42:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f2e44f6f-4c3b-44ba-8956-faa5b648bdec tempest-CreateVolumesFromImageTest-369757415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-75106044-45bd-420c-adf6-1d54b94c747f 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:27 devstack sudo[101537]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8797e9af-cde5-467e-945e-2dc42e12045f tempest-VolumeDependencyTests-1310677104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4faba15e-d946-4025-aa03-102c04643393" returned: 0 in 0.453s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8797e9af-cde5-467e-945e-2dc42e12045f tempest-VolumeDependencyTests-1310677104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4faba15e-d946-4025-aa03-102c04643393 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:27 devstack sudo[101547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-75106044-45bd-420c-adf6-1d54b94c747f 1073741824 Nov 03 07:42:27 devstack sudo[101547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:27 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-1ce811a7-159f-4b77-bcf7-ebc515eccdd2 tempest-CreateVolumesFromImageTest-369757415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e33ecdab-2e49-432b-a5a4-e83a345c0db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6af6ec5d-05f9-4b83-b8af-b18b7cb24e19', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:27 devstack sudo[101548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4faba15e-d946-4025-aa03-102c04643393 Nov 03 07:42:27 devstack sudo[101548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:27 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-1ce811a7-159f-4b77-bcf7-ebc515eccdd2 tempest-CreateVolumesFromImageTest-369757415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (214668cf-4834-42d0-96a7-60d1f8d87aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:27 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-1ce811a7-159f-4b77-bcf7-ebc515eccdd2 tempest-CreateVolumesFromImageTest-369757415 None] Volume volume-6af6ec5d-05f9-4b83-b8af-b18b7cb24e19 (6af6ec5d-05f9-4b83-b8af-b18b7cb24e19): created successfully Nov 03 07:42:27 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-1ce811a7-159f-4b77-bcf7-ebc515eccdd2 tempest-CreateVolumesFromImageTest-369757415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (214668cf-4834-42d0-96a7-60d1f8d87aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:27 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-1ce811a7-159f-4b77-bcf7-ebc515eccdd2 tempest-CreateVolumesFromImageTest-369757415 None] Flow 'volume_create_manager' (bfc66372-6305-4629-b808-ce9d0a700d0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:42:27 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-1ce811a7-159f-4b77-bcf7-ebc515eccdd2 tempest-CreateVolumesFromImageTest-369757415 None] Created volume successfully. Nov 03 07:42:28 devstack sudo[101548]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8797e9af-cde5-467e-945e-2dc42e12045f tempest-VolumeDependencyTests-1310677104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4faba15e-d946-4025-aa03-102c04643393" returned: 0 in 0.296s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:28 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-8797e9af-cde5-467e-945e-2dc42e12045f tempest-VolumeDependencyTests-1310677104 None] Lock "cinder-quobyte-4faba15e-d946-4025-aa03-102c04643393" released by "delete_volume" :: held 0.861s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:28 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-8797e9af-cde5-467e-945e-2dc42e12045f tempest-VolumeDependencyTests-1310677104 None] Created reservations ['f12bd73c-c3e0-47bc-96fe-f3b7b50028b7', 'cea0afd9-b624-47b1-9c3b-36a9320bf12c', '34a976c4-db70-40db-9759-e03803b9e5a0', '5e39e233-7951-4e0a-8b1b-0ef8b4ab458a'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:42:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-8797e9af-cde5-467e-945e-2dc42e12045f tempest-VolumeDependencyTests-1310677104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-8797e9af-cde5-467e-945e-2dc42e12045f tempest-VolumeDependencyTests-1310677104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:28 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-8797e9af-cde5-467e-945e-2dc42e12045f tempest-VolumeDependencyTests-1310677104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:42:28 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-8797e9af-cde5-467e-945e-2dc42e12045f tempest-VolumeDependencyTests-1310677104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:42:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-8797e9af-cde5-467e-945e-2dc42e12045f tempest-VolumeDependencyTests-1310677104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8797e9af-cde5-467e-945e-2dc42e12045f tempest-VolumeDependencyTests-1310677104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:28 devstack sudo[101556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:42:28 devstack sudo[101556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:28 devstack sudo[101547]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f2e44f6f-4c3b-44ba-8956-faa5b648bdec tempest-CreateVolumesFromImageTest-369757415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-75106044-45bd-420c-adf6-1d54b94c747f 1073741824" returned: 0 in 0.562s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f2e44f6f-4c3b-44ba-8956-faa5b648bdec tempest-CreateVolumesFromImageTest-369757415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-75106044-45bd-420c-adf6-1d54b94c747f {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:28 devstack sudo[101558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-75106044-45bd-420c-adf6-1d54b94c747f Nov 03 07:42:28 devstack sudo[101558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:28 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ba652119-6752-4777-90d5-20aabac7d068 tempest-VolumeDependencyTests-1310677104 None] Acquiring lock "cinder-877b47af-775f-4ac8-95fc-4532ffad37d1-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:28 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ba652119-6752-4777-90d5-20aabac7d068 tempest-VolumeDependencyTests-1310677104 None] Lock "cinder-877b47af-775f-4ac8-95fc-4532ffad37d1-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:28 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ba652119-6752-4777-90d5-20aabac7d068 tempest-VolumeDependencyTests-1310677104 None] Acquiring lock "cinder-quobyte-877b47af-775f-4ac8-95fc-4532ffad37d1" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:28 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ba652119-6752-4777-90d5-20aabac7d068 tempest-VolumeDependencyTests-1310677104 None] Lock "cinder-quobyte-877b47af-775f-4ac8-95fc-4532ffad37d1" acquired by "delete_volume" :: waited 0.020s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:28 devstack sudo[101556]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8797e9af-cde5-467e-945e-2dc42e12045f tempest-VolumeDependencyTests-1310677104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.382s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:28 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-8797e9af-cde5-467e-945e-2dc42e12045f tempest-VolumeDependencyTests-1310677104 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:42:28 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-8797e9af-cde5-467e-945e-2dc42e12045f tempest-VolumeDependencyTests-1310677104 None] Deleted volume successfully. Nov 03 07:42:28 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf2d107-ce0b-4cf1-b553-0ec341c9e4a0]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:42:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ba652119-6752-4777-90d5-20aabac7d068 tempest-VolumeDependencyTests-1310677104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-877b47af-775f-4ac8-95fc-4532ffad37d1 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:28 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-8797e9af-cde5-467e-945e-2dc42e12045f tempest-VolumeDependencyTests-1310677104 None] Lock "cinder-4faba15e-d946-4025-aa03-102c04643393-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:28 devstack sudo[101558]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f2e44f6f-4c3b-44ba-8956-faa5b648bdec tempest-CreateVolumesFromImageTest-369757415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-75106044-45bd-420c-adf6-1d54b94c747f" returned: 0 in 0.394s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:28 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-f2e44f6f-4c3b-44ba-8956-faa5b648bdec tempest-CreateVolumesFromImageTest-369757415 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:42:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-f2e44f6f-4c3b-44ba-8956-faa5b648bdec tempest-CreateVolumesFromImageTest-369757415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:28 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f2e44f6f-4c3b-44ba-8956-faa5b648bdec tempest-CreateVolumesFromImageTest-369757415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (059f4e19-ae6b-48f8-b399-cad58c79dbc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75106044-45bd-420c-adf6-1d54b94c747f', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:28 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f2e44f6f-4c3b-44ba-8956-faa5b648bdec tempest-CreateVolumesFromImageTest-369757415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9aaa4a4-ed87-492b-bb2b-d27eb24097d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:28 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-f2e44f6f-4c3b-44ba-8956-faa5b648bdec tempest-CreateVolumesFromImageTest-369757415 None] Volume volume-75106044-45bd-420c-adf6-1d54b94c747f (75106044-45bd-420c-adf6-1d54b94c747f): created successfully Nov 03 07:42:28 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f2e44f6f-4c3b-44ba-8956-faa5b648bdec tempest-CreateVolumesFromImageTest-369757415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9aaa4a4-ed87-492b-bb2b-d27eb24097d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:28 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f2e44f6f-4c3b-44ba-8956-faa5b648bdec tempest-CreateVolumesFromImageTest-369757415 None] Flow 'volume_create_manager' (1b48e3ff-b4a4-4e37-a18a-5751213a288c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:42:28 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-f2e44f6f-4c3b-44ba-8956-faa5b648bdec tempest-CreateVolumesFromImageTest-369757415 None] Created volume successfully. Nov 03 07:42:28 devstack sudo[101562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-877b47af-775f-4ac8-95fc-4532ffad37d1 Nov 03 07:42:28 devstack sudo[101562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:29 devstack sudo[101562]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:29 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ba652119-6752-4777-90d5-20aabac7d068 tempest-VolumeDependencyTests-1310677104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-877b47af-775f-4ac8-95fc-4532ffad37d1" returned: 0 in 0.536s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:29 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ba652119-6752-4777-90d5-20aabac7d068 tempest-VolumeDependencyTests-1310677104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-877b47af-775f-4ac8-95fc-4532ffad37d1 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:29 devstack sudo[101567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-877b47af-775f-4ac8-95fc-4532ffad37d1 Nov 03 07:42:29 devstack sudo[101567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:29 devstack sudo[101567]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:29 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ba652119-6752-4777-90d5-20aabac7d068 tempest-VolumeDependencyTests-1310677104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-877b47af-775f-4ac8-95fc-4532ffad37d1" returned: 0 in 0.336s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:29 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ba652119-6752-4777-90d5-20aabac7d068 tempest-VolumeDependencyTests-1310677104 None] Lock "cinder-quobyte-877b47af-775f-4ac8-95fc-4532ffad37d1" released by "delete_volume" :: held 0.968s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:29 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-888737a3-b22d-4c9d-b2e3-11804abd08ec tempest-GroupsTest-1667041417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:42:29 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-888737a3-b22d-4c9d-b2e3-11804abd08ec tempest-GroupsTest-1667041417 None] Flow 'volume_create_manager' (26f20c2a-37e3-4f0b-ad4f-1f148bda68ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:42:29 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-888737a3-b22d-4c9d-b2e3-11804abd08ec tempest-GroupsTest-1667041417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dca82d6-7cdc-42b0-a235-d093ae66900d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:29 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-888737a3-b22d-4c9d-b2e3-11804abd08ec tempest-GroupsTest-1667041417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dca82d6-7cdc-42b0-a235-d093ae66900d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:42:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1668450949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a8e269ab-6119-4c5d-b84c-d20499a47d39,host='devstack@QuobyteHD#QuobyteHD',id=31de2828-ccec-4dcc-a353-470173db5f51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4767c0eec5514593a15ef4657122a528',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:42:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:42:29Z,use_quota=True,user_id='1847edabe043435a90017d53bce43208',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed188ec9-782b-4422-90a1-dc937b9231f6),volume_type_id=ed188ec9-782b-4422-90a1-dc937b9231f6)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:29 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-888737a3-b22d-4c9d-b2e3-11804abd08ec tempest-GroupsTest-1667041417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f167926f-12e7-43a5-9ad6-e1917fe09af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:29 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-888737a3-b22d-4c9d-b2e3-11804abd08ec tempest-GroupsTest-1667041417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f167926f-12e7-43a5-9ad6-e1917fe09af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:29 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-888737a3-b22d-4c9d-b2e3-11804abd08ec tempest-GroupsTest-1667041417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (753aa2c1-b6ba-404d-81e3-5bcd89dafe8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:29 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-888737a3-b22d-4c9d-b2e3-11804abd08ec tempest-GroupsTest-1667041417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (753aa2c1-b6ba-404d-81e3-5bcd89dafe8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31de2828-ccec-4dcc-a353-470173db5f51', 'volume_name': 'volume-31de2828-ccec-4dcc-a353-470173db5f51', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:29 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-888737a3-b22d-4c9d-b2e3-11804abd08ec tempest-GroupsTest-1667041417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13d9e39e-e50e-4d40-9324-6de496b10ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:29 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-888737a3-b22d-4c9d-b2e3-11804abd08ec tempest-GroupsTest-1667041417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13d9e39e-e50e-4d40-9324-6de496b10ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:29 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-888737a3-b22d-4c9d-b2e3-11804abd08ec tempest-GroupsTest-1667041417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee9f0fc3-8b84-4e48-bd42-c14f0711cb6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:29 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-888737a3-b22d-4c9d-b2e3-11804abd08ec tempest-GroupsTest-1667041417 None] Volume 31de2828-ccec-4dcc-a353-470173db5f51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31de2828-ccec-4dcc-a353-470173db5f51', 'volume_size': 1} Nov 03 07:42:29 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-888737a3-b22d-4c9d-b2e3-11804abd08ec tempest-GroupsTest-1667041417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:29 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-888737a3-b22d-4c9d-b2e3-11804abd08ec tempest-GroupsTest-1667041417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:29 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-888737a3-b22d-4c9d-b2e3-11804abd08ec tempest-GroupsTest-1667041417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a8e269ab-6119-4c5d-b84c-d20499a47d39,created_at=2026-11-03T06:42:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1668450949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a8e269ab-6119-4c5d-b84c-d20499a47d39,host='devstack@QuobyteHD#QuobyteHD',id=31de2828-ccec-4dcc-a353-470173db5f51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4767c0eec5514593a15ef4657122a528',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:42:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:42:29Z,use_quota=True,user_id='1847edabe043435a90017d53bce43208',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed188ec9-782b-4422-90a1-dc937b9231f6),volume_type_id=ed188ec9-782b-4422-90a1-dc937b9231f6)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:42:29 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-888737a3-b22d-4c9d-b2e3-11804abd08ec tempest-GroupsTest-1667041417 None] Creating volume 31de2828-ccec-4dcc-a353-470173db5f51 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:42:29 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-888737a3-b22d-4c9d-b2e3-11804abd08ec tempest-GroupsTest-1667041417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:29 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-888737a3-b22d-4c9d-b2e3-11804abd08ec tempest-GroupsTest-1667041417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:29 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-888737a3-b22d-4c9d-b2e3-11804abd08ec tempest-GroupsTest-1667041417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:42:29 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-888737a3-b22d-4c9d-b2e3-11804abd08ec tempest-GroupsTest-1667041417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:42:29 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-888737a3-b22d-4c9d-b2e3-11804abd08ec tempest-GroupsTest-1667041417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:29 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-888737a3-b22d-4c9d-b2e3-11804abd08ec tempest-GroupsTest-1667041417 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:42:29 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-888737a3-b22d-4c9d-b2e3-11804abd08ec tempest-GroupsTest-1667041417 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:42:29 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-888737a3-b22d-4c9d-b2e3-11804abd08ec tempest-GroupsTest-1667041417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-31de2828-ccec-4dcc-a353-470173db5f51 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:29 devstack sudo[101570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-31de2828-ccec-4dcc-a353-470173db5f51 1073741824 Nov 03 07:42:29 devstack sudo[101570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:29 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-ba652119-6752-4777-90d5-20aabac7d068 tempest-VolumeDependencyTests-1310677104 None] Created reservations ['f9940fc5-c505-4d1b-9f3e-0706fdde59ae', 'f8f7bbe7-e985-4dba-8032-3471a4e09a88', '6cd27c6f-4386-411f-b21b-ce3c9708bd26', 'ab738452-b99c-40c3-a369-bea8ed094892'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:42:29 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-5e83483b-81f2-454d-ab1b-70adb7e80879 tempest-CreateVolumesFromImageTest-369757415 None] Acquiring lock "cinder-75106044-45bd-420c-adf6-1d54b94c747f-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:30 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-5e83483b-81f2-454d-ab1b-70adb7e80879 tempest-CreateVolumesFromImageTest-369757415 None] Lock "cinder-75106044-45bd-420c-adf6-1d54b94c747f-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-ba652119-6752-4777-90d5-20aabac7d068 tempest-VolumeDependencyTests-1310677104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-ba652119-6752-4777-90d5-20aabac7d068 tempest-VolumeDependencyTests-1310677104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:30 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-ba652119-6752-4777-90d5-20aabac7d068 tempest-VolumeDependencyTests-1310677104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:42:30 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-ba652119-6752-4777-90d5-20aabac7d068 tempest-VolumeDependencyTests-1310677104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:42:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-ba652119-6752-4777-90d5-20aabac7d068 tempest-VolumeDependencyTests-1310677104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ba652119-6752-4777-90d5-20aabac7d068 tempest-VolumeDependencyTests-1310677104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:30 devstack sudo[101572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:42:30 devstack sudo[101572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:30 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-5e83483b-81f2-454d-ab1b-70adb7e80879 tempest-CreateVolumesFromImageTest-369757415 None] Acquiring lock "cinder-quobyte-75106044-45bd-420c-adf6-1d54b94c747f" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:30 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-5e83483b-81f2-454d-ab1b-70adb7e80879 tempest-CreateVolumesFromImageTest-369757415 None] Lock "cinder-quobyte-75106044-45bd-420c-adf6-1d54b94c747f" acquired by "delete_volume" :: waited 0.025s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:30 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c84f85e-e24c-4076-ab9d-7ab647ebf9d6]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:42:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5e83483b-81f2-454d-ab1b-70adb7e80879 tempest-CreateVolumesFromImageTest-369757415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-75106044-45bd-420c-adf6-1d54b94c747f {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:30 devstack sudo[101577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-75106044-45bd-420c-adf6-1d54b94c747f Nov 03 07:42:30 devstack sudo[101577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:30 devstack sudo[101570]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-888737a3-b22d-4c9d-b2e3-11804abd08ec tempest-GroupsTest-1667041417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-31de2828-ccec-4dcc-a353-470173db5f51 1073741824" returned: 0 in 0.751s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:30 devstack sudo[101572]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ba652119-6752-4777-90d5-20aabac7d068 tempest-VolumeDependencyTests-1310677104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.405s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:30 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-ba652119-6752-4777-90d5-20aabac7d068 tempest-VolumeDependencyTests-1310677104 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:42:30 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-ba652119-6752-4777-90d5-20aabac7d068 tempest-VolumeDependencyTests-1310677104 None] Deleted volume successfully. Nov 03 07:42:30 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ba652119-6752-4777-90d5-20aabac7d068 tempest-VolumeDependencyTests-1310677104 None] Lock "cinder-877b47af-775f-4ac8-95fc-4532ffad37d1-delete_volume" released by "delete_volume" :: held 2.024s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-888737a3-b22d-4c9d-b2e3-11804abd08ec tempest-GroupsTest-1667041417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-31de2828-ccec-4dcc-a353-470173db5f51 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:30 devstack sudo[101581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-31de2828-ccec-4dcc-a353-470173db5f51 Nov 03 07:42:30 devstack sudo[101581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:30 devstack sudo[101577]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5e83483b-81f2-454d-ab1b-70adb7e80879 tempest-CreateVolumesFromImageTest-369757415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-75106044-45bd-420c-adf6-1d54b94c747f" returned: 0 in 0.507s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5e83483b-81f2-454d-ab1b-70adb7e80879 tempest-CreateVolumesFromImageTest-369757415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-75106044-45bd-420c-adf6-1d54b94c747f {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:30 devstack sudo[101586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-75106044-45bd-420c-adf6-1d54b94c747f Nov 03 07:42:30 devstack sudo[101586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:30 devstack sudo[101581]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-888737a3-b22d-4c9d-b2e3-11804abd08ec tempest-GroupsTest-1667041417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-31de2828-ccec-4dcc-a353-470173db5f51" returned: 0 in 0.428s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:30 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-888737a3-b22d-4c9d-b2e3-11804abd08ec tempest-GroupsTest-1667041417 None] <== create_volume: return (1258ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:42:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-888737a3-b22d-4c9d-b2e3-11804abd08ec tempest-GroupsTest-1667041417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.266s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:31 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-888737a3-b22d-4c9d-b2e3-11804abd08ec tempest-GroupsTest-1667041417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee9f0fc3-8b84-4e48-bd42-c14f0711cb6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31de2828-ccec-4dcc-a353-470173db5f51', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:31 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-888737a3-b22d-4c9d-b2e3-11804abd08ec tempest-GroupsTest-1667041417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8e84430-d776-4b7e-90cb-7215acc40920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:31 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-888737a3-b22d-4c9d-b2e3-11804abd08ec tempest-GroupsTest-1667041417 None] Volume volume-31de2828-ccec-4dcc-a353-470173db5f51 (31de2828-ccec-4dcc-a353-470173db5f51): created successfully Nov 03 07:42:31 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-888737a3-b22d-4c9d-b2e3-11804abd08ec tempest-GroupsTest-1667041417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8e84430-d776-4b7e-90cb-7215acc40920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:31 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-888737a3-b22d-4c9d-b2e3-11804abd08ec tempest-GroupsTest-1667041417 None] Flow 'volume_create_manager' (26f20c2a-37e3-4f0b-ad4f-1f148bda68ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:42:31 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-888737a3-b22d-4c9d-b2e3-11804abd08ec tempest-GroupsTest-1667041417 None] Created volume successfully. Nov 03 07:42:31 devstack sudo[101586]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5e83483b-81f2-454d-ab1b-70adb7e80879 tempest-CreateVolumesFromImageTest-369757415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-75106044-45bd-420c-adf6-1d54b94c747f" returned: 0 in 0.387s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:31 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-5e83483b-81f2-454d-ab1b-70adb7e80879 tempest-CreateVolumesFromImageTest-369757415 None] Lock "cinder-quobyte-75106044-45bd-420c-adf6-1d54b94c747f" released by "delete_volume" :: held 0.954s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:31 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-5e83483b-81f2-454d-ab1b-70adb7e80879 tempest-CreateVolumesFromImageTest-369757415 None] Created reservations ['65f7ff84-9ad4-4007-9994-ab18e44659f4', '3bebaf22-fea7-445d-9688-0bc24f18291a', '968ba8e5-9c8f-49bc-af65-85f722bd9d40', '4aa58ba9-597f-4a21-b6d0-de649bcf0ea5'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:42:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-5e83483b-81f2-454d-ab1b-70adb7e80879 tempest-CreateVolumesFromImageTest-369757415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-5e83483b-81f2-454d-ab1b-70adb7e80879 tempest-CreateVolumesFromImageTest-369757415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:31 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-5e83483b-81f2-454d-ab1b-70adb7e80879 tempest-CreateVolumesFromImageTest-369757415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:42:31 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-5e83483b-81f2-454d-ab1b-70adb7e80879 tempest-CreateVolumesFromImageTest-369757415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:42:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-5e83483b-81f2-454d-ab1b-70adb7e80879 tempest-CreateVolumesFromImageTest-369757415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5e83483b-81f2-454d-ab1b-70adb7e80879 tempest-CreateVolumesFromImageTest-369757415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:31 devstack sudo[101590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:42:31 devstack sudo[101590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:31 devstack sudo[101590]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5e83483b-81f2-454d-ab1b-70adb7e80879 tempest-CreateVolumesFromImageTest-369757415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.365s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:31 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-5e83483b-81f2-454d-ab1b-70adb7e80879 tempest-CreateVolumesFromImageTest-369757415 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:42:31 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-5e83483b-81f2-454d-ab1b-70adb7e80879 tempest-CreateVolumesFromImageTest-369757415 None] Deleted volume successfully. Nov 03 07:42:31 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-5e83483b-81f2-454d-ab1b-70adb7e80879 tempest-CreateVolumesFromImageTest-369757415 None] Lock "cinder-75106044-45bd-420c-adf6-1d54b94c747f-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:32 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a13c5e39-dc75-43b0-aa78-cad57ed77050 tempest-CreateVolumesFromImageTest-369757415 None] Acquiring lock "cinder-6af6ec5d-05f9-4b83-b8af-b18b7cb24e19-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:32 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a13c5e39-dc75-43b0-aa78-cad57ed77050 tempest-CreateVolumesFromImageTest-369757415 None] Lock "cinder-6af6ec5d-05f9-4b83-b8af-b18b7cb24e19-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:32 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a13c5e39-dc75-43b0-aa78-cad57ed77050 tempest-CreateVolumesFromImageTest-369757415 None] Acquiring lock "cinder-quobyte-6af6ec5d-05f9-4b83-b8af-b18b7cb24e19" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:32 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a13c5e39-dc75-43b0-aa78-cad57ed77050 tempest-CreateVolumesFromImageTest-369757415 None] Lock "cinder-quobyte-6af6ec5d-05f9-4b83-b8af-b18b7cb24e19" acquired by "delete_volume" :: waited 0.019s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:32 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff706a34-78d0-4895-8e4f-e5776591b84c]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:42:32 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a13c5e39-dc75-43b0-aa78-cad57ed77050 tempest-CreateVolumesFromImageTest-369757415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6af6ec5d-05f9-4b83-b8af-b18b7cb24e19 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:32 devstack sudo[101597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6af6ec5d-05f9-4b83-b8af-b18b7cb24e19 Nov 03 07:42:32 devstack sudo[101597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:33 devstack sudo[101597]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a13c5e39-dc75-43b0-aa78-cad57ed77050 tempest-CreateVolumesFromImageTest-369757415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6af6ec5d-05f9-4b83-b8af-b18b7cb24e19" returned: 0 in 0.580s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a13c5e39-dc75-43b0-aa78-cad57ed77050 tempest-CreateVolumesFromImageTest-369757415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6af6ec5d-05f9-4b83-b8af-b18b7cb24e19 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:33 devstack sudo[101604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6af6ec5d-05f9-4b83-b8af-b18b7cb24e19 Nov 03 07:42:33 devstack sudo[101604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:33 devstack sudo[101604]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a13c5e39-dc75-43b0-aa78-cad57ed77050 tempest-CreateVolumesFromImageTest-369757415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6af6ec5d-05f9-4b83-b8af-b18b7cb24e19" returned: 0 in 0.376s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:33 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-82d03009-2666-4aa4-b91d-c7de2c5b62f1 tempest-GroupsTest-1667041417 None] Acquiring lock "cinder-quobyte-31de2828-ccec-4dcc-a353-470173db5f51" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:33 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a13c5e39-dc75-43b0-aa78-cad57ed77050 tempest-CreateVolumesFromImageTest-369757415 None] Lock "cinder-quobyte-6af6ec5d-05f9-4b83-b8af-b18b7cb24e19" released by "delete_volume" :: held 1.056s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:33 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-82d03009-2666-4aa4-b91d-c7de2c5b62f1 tempest-GroupsTest-1667041417 None] Lock "cinder-quobyte-31de2828-ccec-4dcc-a353-470173db5f51" acquired by "delete_volume" :: waited 0.037s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:33 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f8a00e-a491-4117-8de6-811feb3a628f]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:42:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-82d03009-2666-4aa4-b91d-c7de2c5b62f1 tempest-GroupsTest-1667041417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-31de2828-ccec-4dcc-a353-470173db5f51 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:33 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-a13c5e39-dc75-43b0-aa78-cad57ed77050 tempest-CreateVolumesFromImageTest-369757415 None] Created reservations ['5046ac2c-2acd-43e6-a3a0-e3ac996ccb96', 'aed5c6a5-4d31-43e3-b91d-b13fd9f4fd52', '680d1a98-7556-43da-bb66-547fe8ae52c9', '2a47dbd0-def2-4094-b05a-5c90919b2835'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:42:33 devstack sudo[101608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-31de2828-ccec-4dcc-a353-470173db5f51 Nov 03 07:42:33 devstack sudo[101608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a13c5e39-dc75-43b0-aa78-cad57ed77050 tempest-CreateVolumesFromImageTest-369757415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a13c5e39-dc75-43b0-aa78-cad57ed77050 tempest-CreateVolumesFromImageTest-369757415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:33 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a13c5e39-dc75-43b0-aa78-cad57ed77050 tempest-CreateVolumesFromImageTest-369757415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:42:33 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a13c5e39-dc75-43b0-aa78-cad57ed77050 tempest-CreateVolumesFromImageTest-369757415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:42:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a13c5e39-dc75-43b0-aa78-cad57ed77050 tempest-CreateVolumesFromImageTest-369757415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a13c5e39-dc75-43b0-aa78-cad57ed77050 tempest-CreateVolumesFromImageTest-369757415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:33 devstack sudo[101610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:42:33 devstack sudo[101610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:34 devstack sudo[101608]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-82d03009-2666-4aa4-b91d-c7de2c5b62f1 tempest-GroupsTest-1667041417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-31de2828-ccec-4dcc-a353-470173db5f51" returned: 0 in 0.497s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-82d03009-2666-4aa4-b91d-c7de2c5b62f1 tempest-GroupsTest-1667041417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-31de2828-ccec-4dcc-a353-470173db5f51 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:34 devstack sudo[101616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-31de2828-ccec-4dcc-a353-470173db5f51 Nov 03 07:42:34 devstack sudo[101616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:34 devstack sudo[101610]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a13c5e39-dc75-43b0-aa78-cad57ed77050 tempest-CreateVolumesFromImageTest-369757415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.410s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:34 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-a13c5e39-dc75-43b0-aa78-cad57ed77050 tempest-CreateVolumesFromImageTest-369757415 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:42:34 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-a13c5e39-dc75-43b0-aa78-cad57ed77050 tempest-CreateVolumesFromImageTest-369757415 None] Deleted volume successfully. Nov 03 07:42:34 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a13c5e39-dc75-43b0-aa78-cad57ed77050 tempest-CreateVolumesFromImageTest-369757415 None] Lock "cinder-6af6ec5d-05f9-4b83-b8af-b18b7cb24e19-delete_volume" released by "delete_volume" :: held 1.940s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:34 devstack sudo[101616]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-82d03009-2666-4aa4-b91d-c7de2c5b62f1 tempest-GroupsTest-1667041417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-31de2828-ccec-4dcc-a353-470173db5f51" returned: 0 in 0.348s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-3b90cb98-9a1c-4453-9cae-9882d29cc4fc req-37812e3c-37ff-4db9-94e0-a27f207d1bde tempest-TestStampPattern-389950066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-3b90cb98-9a1c-4453-9cae-9882d29cc4fc req-37812e3c-37ff-4db9-94e0-a27f207d1bde tempest-TestStampPattern-389950066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:34 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-82d03009-2666-4aa4-b91d-c7de2c5b62f1 tempest-GroupsTest-1667041417 None] Lock "cinder-quobyte-31de2828-ccec-4dcc-a353-470173db5f51" released by "delete_volume" :: held 0.954s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-3b90cb98-9a1c-4453-9cae-9882d29cc4fc req-37812e3c-37ff-4db9-94e0-a27f207d1bde tempest-TestStampPattern-389950066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:34 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-3b90cb98-9a1c-4453-9cae-9882d29cc4fc req-37812e3c-37ff-4db9-94e0-a27f207d1bde tempest-TestStampPattern-389950066 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1', 'name': 'volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '07b88d27-41c4-4e3d-a7df-1fce468d9d2e', 'enforce_multipath': True} {{(pid=86875) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:42:34 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-82d03009-2666-4aa4-b91d-c7de2c5b62f1 tempest-GroupsTest-1667041417 None] Created reservations ['65199385-b65d-4397-a965-2fd5d659913d'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:42:34 devstack cinder-volume[86875]: WARNING cinder.quota [None req-82d03009-2666-4aa4-b91d-c7de2c5b62f1 tempest-GroupsTest-1667041417 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1326017955 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1326017955, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:42:34 devstack cinder-volume[86875]: WARNING cinder.quota [None req-82d03009-2666-4aa4-b91d-c7de2c5b62f1 tempest-GroupsTest-1667041417 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1326017955 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1326017955, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:42:34 devstack cinder-volume[86875]: INFO cinder.volume.manager [req-3b90cb98-9a1c-4453-9cae-9882d29cc4fc req-37812e3c-37ff-4db9-94e0-a27f207d1bde tempest-TestStampPattern-389950066 None] attachment_update completed successfully. Nov 03 07:42:34 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-82d03009-2666-4aa4-b91d-c7de2c5b62f1 tempest-GroupsTest-1667041417 None] Created reservations ['9fc33037-0798-459a-9817-e1d0ce44d401', '5ea772be-3546-497b-a2dc-7a38960c4f81', '8a5df80c-1992-4f26-9abf-c46fd4bf5488', '91fef42b-1097-4a9e-b471-f7218f62aa8a'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:42:34 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-3dca3e42-365d-4de8-ac6a-646aacb68fd6 tempest-CreateVolumesFromImageTest-369757415 None] Acquiring lock "cinder-a3782d31-82ba-4de7-ab81-e1a3f49ebd40-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-82d03009-2666-4aa4-b91d-c7de2c5b62f1 tempest-GroupsTest-1667041417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-82d03009-2666-4aa4-b91d-c7de2c5b62f1 tempest-GroupsTest-1667041417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:34 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-82d03009-2666-4aa4-b91d-c7de2c5b62f1 tempest-GroupsTest-1667041417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:42:34 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-82d03009-2666-4aa4-b91d-c7de2c5b62f1 tempest-GroupsTest-1667041417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:42:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-82d03009-2666-4aa4-b91d-c7de2c5b62f1 tempest-GroupsTest-1667041417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-82d03009-2666-4aa4-b91d-c7de2c5b62f1 tempest-GroupsTest-1667041417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:34 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-3dca3e42-365d-4de8-ac6a-646aacb68fd6 tempest-CreateVolumesFromImageTest-369757415 None] Lock "cinder-a3782d31-82ba-4de7-ab81-e1a3f49ebd40-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:34 devstack sudo[101654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:42:34 devstack sudo[101654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:35 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-3dca3e42-365d-4de8-ac6a-646aacb68fd6 tempest-CreateVolumesFromImageTest-369757415 None] Acquiring lock "cinder-quobyte-a3782d31-82ba-4de7-ab81-e1a3f49ebd40" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:35 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-3dca3e42-365d-4de8-ac6a-646aacb68fd6 tempest-CreateVolumesFromImageTest-369757415 None] Lock "cinder-quobyte-a3782d31-82ba-4de7-ab81-e1a3f49ebd40" acquired by "delete_volume" :: waited 0.033s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:35 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d21094d-63a2-4a49-99f9-ecb0c6895f40]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:42:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3dca3e42-365d-4de8-ac6a-646aacb68fd6 tempest-CreateVolumesFromImageTest-369757415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a3782d31-82ba-4de7-ab81-e1a3f49ebd40 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:35 devstack sudo[101766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a3782d31-82ba-4de7-ab81-e1a3f49ebd40 Nov 03 07:42:35 devstack sudo[101766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:35 devstack sudo[101654]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-82d03009-2666-4aa4-b91d-c7de2c5b62f1 tempest-GroupsTest-1667041417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.562s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:35 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-82d03009-2666-4aa4-b91d-c7de2c5b62f1 tempest-GroupsTest-1667041417 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:42:35 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-82d03009-2666-4aa4-b91d-c7de2c5b62f1 tempest-GroupsTest-1667041417 None] Delete group completed successfully. Nov 03 07:42:35 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-03458206-4d2f-4a2c-9702-04510b5d09a8 tempest-GroupsTest-1667041417 None] Created reservations ['15aa21fd-c160-4549-b1a3-a6c3a568fcc4'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:42:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-03458206-4d2f-4a2c-9702-04510b5d09a8 tempest-GroupsTest-1667041417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-03458206-4d2f-4a2c-9702-04510b5d09a8 tempest-GroupsTest-1667041417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:35 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-03458206-4d2f-4a2c-9702-04510b5d09a8 tempest-GroupsTest-1667041417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:42:35 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-03458206-4d2f-4a2c-9702-04510b5d09a8 tempest-GroupsTest-1667041417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:42:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-03458206-4d2f-4a2c-9702-04510b5d09a8 tempest-GroupsTest-1667041417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-03458206-4d2f-4a2c-9702-04510b5d09a8 tempest-GroupsTest-1667041417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:35 devstack sudo[102051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:42:35 devstack sudo[102051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:35 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-68a3e277-659a-4bc0-b9c7-b1924d14487c tempest-CinderUnicodeTest-805292985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:42:35 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-68a3e277-659a-4bc0-b9c7-b1924d14487c tempest-CinderUnicodeTest-805292985 None] Flow 'volume_create_manager' (f892ed3a-09d6-433b-94ec-fb0e5eba4de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:42:35 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-68a3e277-659a-4bc0-b9c7-b1924d14487c tempest-CinderUnicodeTest-805292985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd523013-15ad-4127-9471-796f88a48c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:35 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-68a3e277-659a-4bc0-b9c7-b1924d14487c tempest-CinderUnicodeTest-805292985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd523013-15ad-4127-9471-796f88a48c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:42:35Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f0b1aeb-7b8d-4d8a-9760-d93f00463c43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0551a2261694a628c0a9aacdd5a951e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:42:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:42:36Z,use_quota=True,user_id='046d281c3c164242b9cc2bfd1706a923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:35 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-68a3e277-659a-4bc0-b9c7-b1924d14487c tempest-CinderUnicodeTest-805292985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0835ab79-3f7d-45b8-bc86-438f33636691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:35 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-68a3e277-659a-4bc0-b9c7-b1924d14487c tempest-CinderUnicodeTest-805292985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0835ab79-3f7d-45b8-bc86-438f33636691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:35 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-68a3e277-659a-4bc0-b9c7-b1924d14487c tempest-CinderUnicodeTest-805292985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13d6e0a6-b2c0-424e-9ef7-75f6e1f4476d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:35 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-68a3e277-659a-4bc0-b9c7-b1924d14487c tempest-CinderUnicodeTest-805292985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13d6e0a6-b2c0-424e-9ef7-75f6e1f4476d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f0b1aeb-7b8d-4d8a-9760-d93f00463c43', 'volume_name': 'volume-3f0b1aeb-7b8d-4d8a-9760-d93f00463c43', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:35 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-68a3e277-659a-4bc0-b9c7-b1924d14487c tempest-CinderUnicodeTest-805292985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (172d292b-663d-4c6b-b468-10ea9ca1c7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:35 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-68a3e277-659a-4bc0-b9c7-b1924d14487c tempest-CinderUnicodeTest-805292985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (172d292b-663d-4c6b-b468-10ea9ca1c7a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:35 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-68a3e277-659a-4bc0-b9c7-b1924d14487c tempest-CinderUnicodeTest-805292985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef239fa2-4d43-4cb4-947c-dda2f1d575c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:35 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-68a3e277-659a-4bc0-b9c7-b1924d14487c tempest-CinderUnicodeTest-805292985 None] Volume 3f0b1aeb-7b8d-4d8a-9760-d93f00463c43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f0b1aeb-7b8d-4d8a-9760-d93f00463c43', 'volume_size': 1} Nov 03 07:42:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-68a3e277-659a-4bc0-b9c7-b1924d14487c tempest-CinderUnicodeTest-805292985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-68a3e277-659a-4bc0-b9c7-b1924d14487c tempest-CinderUnicodeTest-805292985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:35 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-68a3e277-659a-4bc0-b9c7-b1924d14487c tempest-CinderUnicodeTest-805292985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:42:35Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f0b1aeb-7b8d-4d8a-9760-d93f00463c43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0551a2261694a628c0a9aacdd5a951e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:42:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:42:36Z,use_quota=True,user_id='046d281c3c164242b9cc2bfd1706a923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:42:35 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-68a3e277-659a-4bc0-b9c7-b1924d14487c tempest-CinderUnicodeTest-805292985 None] Creating volume 3f0b1aeb-7b8d-4d8a-9760-d93f00463c43 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:42:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-68a3e277-659a-4bc0-b9c7-b1924d14487c tempest-CinderUnicodeTest-805292985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-68a3e277-659a-4bc0-b9c7-b1924d14487c tempest-CinderUnicodeTest-805292985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:35 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-68a3e277-659a-4bc0-b9c7-b1924d14487c tempest-CinderUnicodeTest-805292985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:42:35 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-68a3e277-659a-4bc0-b9c7-b1924d14487c tempest-CinderUnicodeTest-805292985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:42:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-68a3e277-659a-4bc0-b9c7-b1924d14487c tempest-CinderUnicodeTest-805292985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:35 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-68a3e277-659a-4bc0-b9c7-b1924d14487c tempest-CinderUnicodeTest-805292985 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:42:35 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-68a3e277-659a-4bc0-b9c7-b1924d14487c tempest-CinderUnicodeTest-805292985 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:42:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-68a3e277-659a-4bc0-b9c7-b1924d14487c tempest-CinderUnicodeTest-805292985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3f0b1aeb-7b8d-4d8a-9760-d93f00463c43 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:35 devstack sudo[101766]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:36 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3dca3e42-365d-4de8-ac6a-646aacb68fd6 tempest-CreateVolumesFromImageTest-369757415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a3782d31-82ba-4de7-ab81-e1a3f49ebd40" returned: 0 in 0.896s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:36 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3dca3e42-365d-4de8-ac6a-646aacb68fd6 tempest-CreateVolumesFromImageTest-369757415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a3782d31-82ba-4de7-ab81-e1a3f49ebd40 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:36 devstack sudo[102060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3f0b1aeb-7b8d-4d8a-9760-d93f00463c43 1073741824 Nov 03 07:42:36 devstack sudo[102060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:36 devstack sudo[102061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a3782d31-82ba-4de7-ab81-e1a3f49ebd40 Nov 03 07:42:36 devstack sudo[102061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:36 devstack sudo[102051]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:36 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-03458206-4d2f-4a2c-9702-04510b5d09a8 tempest-GroupsTest-1667041417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.524s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:36 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-03458206-4d2f-4a2c-9702-04510b5d09a8 tempest-GroupsTest-1667041417 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:42:36 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-03458206-4d2f-4a2c-9702-04510b5d09a8 tempest-GroupsTest-1667041417 None] Delete group completed successfully. Nov 03 07:42:36 devstack sudo[102061]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:36 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3dca3e42-365d-4de8-ac6a-646aacb68fd6 tempest-CreateVolumesFromImageTest-369757415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a3782d31-82ba-4de7-ab81-e1a3f49ebd40" returned: 0 in 0.400s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:36 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-3dca3e42-365d-4de8-ac6a-646aacb68fd6 tempest-CreateVolumesFromImageTest-369757415 None] Lock "cinder-quobyte-a3782d31-82ba-4de7-ab81-e1a3f49ebd40" released by "delete_volume" :: held 1.408s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:36 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-3dca3e42-365d-4de8-ac6a-646aacb68fd6 tempest-CreateVolumesFromImageTest-369757415 None] Created reservations ['b613cc2f-db45-4465-9251-2ed229dd8015', '25bc1220-97c6-42fb-bb66-1c9b4618a251', '8611b61c-5760-47ab-9086-25c46371ff92', '79fe9b5e-3863-4781-bd45-5f05aceb1df0'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:42:36 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3dca3e42-365d-4de8-ac6a-646aacb68fd6 tempest-CreateVolumesFromImageTest-369757415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:36 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3dca3e42-365d-4de8-ac6a-646aacb68fd6 tempest-CreateVolumesFromImageTest-369757415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:36 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-3dca3e42-365d-4de8-ac6a-646aacb68fd6 tempest-CreateVolumesFromImageTest-369757415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:42:36 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-3dca3e42-365d-4de8-ac6a-646aacb68fd6 tempest-CreateVolumesFromImageTest-369757415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:42:36 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3dca3e42-365d-4de8-ac6a-646aacb68fd6 tempest-CreateVolumesFromImageTest-369757415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:36 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3dca3e42-365d-4de8-ac6a-646aacb68fd6 tempest-CreateVolumesFromImageTest-369757415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:36 devstack sudo[102073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:42:36 devstack sudo[102073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:36 devstack sudo[102060]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:36 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-68a3e277-659a-4bc0-b9c7-b1924d14487c tempest-CinderUnicodeTest-805292985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3f0b1aeb-7b8d-4d8a-9760-d93f00463c43 1073741824" returned: 0 in 0.791s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:36 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-68a3e277-659a-4bc0-b9c7-b1924d14487c tempest-CinderUnicodeTest-805292985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3f0b1aeb-7b8d-4d8a-9760-d93f00463c43 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:36 devstack sudo[102075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3f0b1aeb-7b8d-4d8a-9760-d93f00463c43 Nov 03 07:42:36 devstack sudo[102075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:37 devstack sudo[102073]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3dca3e42-365d-4de8-ac6a-646aacb68fd6 tempest-CreateVolumesFromImageTest-369757415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.383s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:37 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-3dca3e42-365d-4de8-ac6a-646aacb68fd6 tempest-CreateVolumesFromImageTest-369757415 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:42:37 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-3dca3e42-365d-4de8-ac6a-646aacb68fd6 tempest-CreateVolumesFromImageTest-369757415 None] Deleted volume successfully. Nov 03 07:42:37 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-3dca3e42-365d-4de8-ac6a-646aacb68fd6 tempest-CreateVolumesFromImageTest-369757415 None] Lock "cinder-a3782d31-82ba-4de7-ab81-e1a3f49ebd40-delete_volume" released by "delete_volume" :: held 2.147s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:37 devstack sudo[102075]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-68a3e277-659a-4bc0-b9c7-b1924d14487c tempest-CinderUnicodeTest-805292985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3f0b1aeb-7b8d-4d8a-9760-d93f00463c43" returned: 0 in 0.354s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:37 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-68a3e277-659a-4bc0-b9c7-b1924d14487c tempest-CinderUnicodeTest-805292985 None] <== create_volume: return (1246ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:42:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-68a3e277-659a-4bc0-b9c7-b1924d14487c tempest-CinderUnicodeTest-805292985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.249s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:37 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-68a3e277-659a-4bc0-b9c7-b1924d14487c tempest-CinderUnicodeTest-805292985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef239fa2-4d43-4cb4-947c-dda2f1d575c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f0b1aeb-7b8d-4d8a-9760-d93f00463c43', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:37 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-68a3e277-659a-4bc0-b9c7-b1924d14487c tempest-CinderUnicodeTest-805292985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70ae0efa-633a-4bb7-bbb4-c0cbcaba3a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:37 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-68a3e277-659a-4bc0-b9c7-b1924d14487c tempest-CinderUnicodeTest-805292985 None] Volume volume-3f0b1aeb-7b8d-4d8a-9760-d93f00463c43 (3f0b1aeb-7b8d-4d8a-9760-d93f00463c43): created successfully Nov 03 07:42:37 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-68a3e277-659a-4bc0-b9c7-b1924d14487c tempest-CinderUnicodeTest-805292985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70ae0efa-633a-4bb7-bbb4-c0cbcaba3a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:37 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-68a3e277-659a-4bc0-b9c7-b1924d14487c tempest-CinderUnicodeTest-805292985 None] Flow 'volume_create_manager' (f892ed3a-09d6-433b-94ec-fb0e5eba4de0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:42:37 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-76fca292-e6be-488b-86da-9ca7d75d9ee5 tempest-GroupsTest-1667041417 None] Group tempest-GroupsTest-Group-1484124003: creating Nov 03 07:42:37 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-68a3e277-659a-4bc0-b9c7-b1924d14487c tempest-CinderUnicodeTest-805292985 None] Created volume successfully. Nov 03 07:42:37 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-76fca292-e6be-488b-86da-9ca7d75d9ee5 tempest-GroupsTest-1667041417 None] Group tempest-GroupsTest-Group-1484124003: created successfully Nov 03 07:42:37 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-76fca292-e6be-488b-86da-9ca7d75d9ee5 tempest-GroupsTest-1667041417 None] Create group completed successfully. Nov 03 07:42:37 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a5b81c80-eda4-46d9-96a9-f2db0c6095db tempest-CreateVolumesFromImageTest-369757415 None] Acquiring lock "cinder-406ccd36-16c7-460c-a7a1-d1e047dcf4c9-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:37 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a5b81c80-eda4-46d9-96a9-f2db0c6095db tempest-CreateVolumesFromImageTest-369757415 None] Lock "cinder-406ccd36-16c7-460c-a7a1-d1e047dcf4c9-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:37 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a5b81c80-eda4-46d9-96a9-f2db0c6095db tempest-CreateVolumesFromImageTest-369757415 None] Acquiring lock "cinder-quobyte-406ccd36-16c7-460c-a7a1-d1e047dcf4c9" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:37 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a5b81c80-eda4-46d9-96a9-f2db0c6095db tempest-CreateVolumesFromImageTest-369757415 None] Lock "cinder-quobyte-406ccd36-16c7-460c-a7a1-d1e047dcf4c9" acquired by "delete_volume" :: waited 0.015s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:37 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7fa7457-2097-4388-aa93-731bc4cd714e]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:42:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a5b81c80-eda4-46d9-96a9-f2db0c6095db tempest-CreateVolumesFromImageTest-369757415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-406ccd36-16c7-460c-a7a1-d1e047dcf4c9 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:37 devstack sudo[102087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-406ccd36-16c7-460c-a7a1-d1e047dcf4c9 Nov 03 07:42:37 devstack sudo[102087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:37 devstack sudo[102087]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a5b81c80-eda4-46d9-96a9-f2db0c6095db tempest-CreateVolumesFromImageTest-369757415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-406ccd36-16c7-460c-a7a1-d1e047dcf4c9" returned: 0 in 0.425s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a5b81c80-eda4-46d9-96a9-f2db0c6095db tempest-CreateVolumesFromImageTest-369757415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-406ccd36-16c7-460c-a7a1-d1e047dcf4c9 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:37 devstack sudo[102098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-406ccd36-16c7-460c-a7a1-d1e047dcf4c9 Nov 03 07:42:37 devstack sudo[102098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:38 devstack sudo[102098]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a5b81c80-eda4-46d9-96a9-f2db0c6095db tempest-CreateVolumesFromImageTest-369757415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-406ccd36-16c7-460c-a7a1-d1e047dcf4c9" returned: 0 in 0.336s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:38 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a5b81c80-eda4-46d9-96a9-f2db0c6095db tempest-CreateVolumesFromImageTest-369757415 None] Lock "cinder-quobyte-406ccd36-16c7-460c-a7a1-d1e047dcf4c9" released by "delete_volume" :: held 0.825s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:38 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-a5b81c80-eda4-46d9-96a9-f2db0c6095db tempest-CreateVolumesFromImageTest-369757415 None] Created reservations ['5c686ddd-504c-48e3-9819-e85804076464', '2485eafc-bedf-45d3-8a6a-4b0c31d89a36', 'f34fc70e-f2cc-4a42-83e2-bc7758bdac1a', '50f559c6-c665-4a83-9336-9bb77e18d9fd'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:42:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a5b81c80-eda4-46d9-96a9-f2db0c6095db tempest-CreateVolumesFromImageTest-369757415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a5b81c80-eda4-46d9-96a9-f2db0c6095db tempest-CreateVolumesFromImageTest-369757415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:38 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a5b81c80-eda4-46d9-96a9-f2db0c6095db tempest-CreateVolumesFromImageTest-369757415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:42:38 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a5b81c80-eda4-46d9-96a9-f2db0c6095db tempest-CreateVolumesFromImageTest-369757415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:42:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a5b81c80-eda4-46d9-96a9-f2db0c6095db tempest-CreateVolumesFromImageTest-369757415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a5b81c80-eda4-46d9-96a9-f2db0c6095db tempest-CreateVolumesFromImageTest-369757415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:38 devstack sudo[102101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:42:38 devstack sudo[102101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:38 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-5099358b-3137-4418-ab98-d5c29baab417 tempest-CreateVolumesFromImageTest-369757415 None] Acquiring lock "cinder-c301beb2-2743-4442-b583-5233a9d7d507-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:38 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-5099358b-3137-4418-ab98-d5c29baab417 tempest-CreateVolumesFromImageTest-369757415 None] Lock "cinder-c301beb2-2743-4442-b583-5233a9d7d507-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:38 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-5099358b-3137-4418-ab98-d5c29baab417 tempest-CreateVolumesFromImageTest-369757415 None] Acquiring lock "cinder-quobyte-c301beb2-2743-4442-b583-5233a9d7d507" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:38 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-636d4172-3be1-4194-80f0-cff045828b31 tempest-CinderUnicodeTest-805292985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:42:38 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-636d4172-3be1-4194-80f0-cff045828b31 tempest-CinderUnicodeTest-805292985 None] Flow 'volume_create_manager' (5b62cd0c-b287-4e80-8ac4-1d7bd89101ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:42:38 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-636d4172-3be1-4194-80f0-cff045828b31 tempest-CinderUnicodeTest-805292985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (038614bb-b714-4240-9d77-890b5d6be780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:39 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-5099358b-3137-4418-ab98-d5c29baab417 tempest-CreateVolumesFromImageTest-369757415 None] Lock "cinder-quobyte-c301beb2-2743-4442-b583-5233a9d7d507" acquired by "delete_volume" :: waited 0.107s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:39 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-636d4172-3be1-4194-80f0-cff045828b31 tempest-CinderUnicodeTest-805292985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (038614bb-b714-4240-9d77-890b5d6be780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:42:38Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-181153248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4d65c82-7d3c-484d-8f29-df51412c8511,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0551a2261694a628c0a9aacdd5a951e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:42:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:42:39Z,use_quota=True,user_id='046d281c3c164242b9cc2bfd1706a923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:39 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-636d4172-3be1-4194-80f0-cff045828b31 tempest-CinderUnicodeTest-805292985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fc86298-3324-4ea5-b509-b58c3286d91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:39 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-636d4172-3be1-4194-80f0-cff045828b31 tempest-CinderUnicodeTest-805292985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fc86298-3324-4ea5-b509-b58c3286d91a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:39 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-636d4172-3be1-4194-80f0-cff045828b31 tempest-CinderUnicodeTest-805292985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9fcdf9d-e69d-4758-bb24-6a1c90fdb5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:39 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-636d4172-3be1-4194-80f0-cff045828b31 tempest-CinderUnicodeTest-805292985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9fcdf9d-e69d-4758-bb24-6a1c90fdb5df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4d65c82-7d3c-484d-8f29-df51412c8511', 'volume_name': 'volume-b4d65c82-7d3c-484d-8f29-df51412c8511', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:39 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-636d4172-3be1-4194-80f0-cff045828b31 tempest-CinderUnicodeTest-805292985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c75ff3f-31d3-4d68-a56c-4b31357d38e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:39 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-636d4172-3be1-4194-80f0-cff045828b31 tempest-CinderUnicodeTest-805292985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c75ff3f-31d3-4d68-a56c-4b31357d38e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:39 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-636d4172-3be1-4194-80f0-cff045828b31 tempest-CinderUnicodeTest-805292985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bcb013b-27e4-4108-b469-9846ef0f1b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:39 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-636d4172-3be1-4194-80f0-cff045828b31 tempest-CinderUnicodeTest-805292985 None] Volume b4d65c82-7d3c-484d-8f29-df51412c8511: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4d65c82-7d3c-484d-8f29-df51412c8511', 'volume_size': 1} Nov 03 07:42:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-636d4172-3be1-4194-80f0-cff045828b31 tempest-CinderUnicodeTest-805292985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-636d4172-3be1-4194-80f0-cff045828b31 tempest-CinderUnicodeTest-805292985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:39 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-636d4172-3be1-4194-80f0-cff045828b31 tempest-CinderUnicodeTest-805292985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:42:38Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-181153248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4d65c82-7d3c-484d-8f29-df51412c8511,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0551a2261694a628c0a9aacdd5a951e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:42:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:42:39Z,use_quota=True,user_id='046d281c3c164242b9cc2bfd1706a923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:42:39 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-636d4172-3be1-4194-80f0-cff045828b31 tempest-CinderUnicodeTest-805292985 None] Creating volume b4d65c82-7d3c-484d-8f29-df51412c8511 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:42:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-636d4172-3be1-4194-80f0-cff045828b31 tempest-CinderUnicodeTest-805292985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-636d4172-3be1-4194-80f0-cff045828b31 tempest-CinderUnicodeTest-805292985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:39 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-636d4172-3be1-4194-80f0-cff045828b31 tempest-CinderUnicodeTest-805292985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:42:39 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-636d4172-3be1-4194-80f0-cff045828b31 tempest-CinderUnicodeTest-805292985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:42:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-636d4172-3be1-4194-80f0-cff045828b31 tempest-CinderUnicodeTest-805292985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:39 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-636d4172-3be1-4194-80f0-cff045828b31 tempest-CinderUnicodeTest-805292985 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:42:39 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-636d4172-3be1-4194-80f0-cff045828b31 tempest-CinderUnicodeTest-805292985 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:42:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-636d4172-3be1-4194-80f0-cff045828b31 tempest-CinderUnicodeTest-805292985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b4d65c82-7d3c-484d-8f29-df51412c8511 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:39 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[884ba8bc-e286-42b4-965e-aa78976911e6]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:42:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5099358b-3137-4418-ab98-d5c29baab417 tempest-CreateVolumesFromImageTest-369757415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c301beb2-2743-4442-b583-5233a9d7d507 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:39 devstack sudo[102104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b4d65c82-7d3c-484d-8f29-df51412c8511 1073741824 Nov 03 07:42:39 devstack sudo[102104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:39 devstack sudo[102101]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a5b81c80-eda4-46d9-96a9-f2db0c6095db tempest-CreateVolumesFromImageTest-369757415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.706s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:39 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-a5b81c80-eda4-46d9-96a9-f2db0c6095db tempest-CreateVolumesFromImageTest-369757415 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:42:39 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-a5b81c80-eda4-46d9-96a9-f2db0c6095db tempest-CreateVolumesFromImageTest-369757415 None] Deleted volume successfully. Nov 03 07:42:39 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a5b81c80-eda4-46d9-96a9-f2db0c6095db tempest-CreateVolumesFromImageTest-369757415 None] Lock "cinder-406ccd36-16c7-460c-a7a1-d1e047dcf4c9-delete_volume" released by "delete_volume" :: held 1.922s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:39 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-c921f5ba-4751-4881-a96f-7afa811686b5 tempest-GroupsTest-1667041417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:42:39 devstack sudo[102105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c301beb2-2743-4442-b583-5233a9d7d507 Nov 03 07:42:39 devstack sudo[102105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:39 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c921f5ba-4751-4881-a96f-7afa811686b5 tempest-GroupsTest-1667041417 None] Flow 'volume_create_manager' (8192f76f-37fb-4ded-9c9b-ca1cc9e84a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:42:39 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c921f5ba-4751-4881-a96f-7afa811686b5 tempest-GroupsTest-1667041417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d44ccae-be5e-4e31-8a5a-5d3fb6db5015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:39 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c921f5ba-4751-4881-a96f-7afa811686b5 tempest-GroupsTest-1667041417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d44ccae-be5e-4e31-8a5a-5d3fb6db5015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:42:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-81448713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e511ddd3-9ea5-4823-acd8-3bba81700642,host='devstack@QuobyteHD#QuobyteHD',id=9d9de56a-2abe-4f7b-9fa0-e3a429e0bc86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4767c0eec5514593a15ef4657122a528',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:42:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:42:39Z,use_quota=True,user_id='1847edabe043435a90017d53bce43208',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(badec9e4-ba6a-4b26-9e2b-9287ee6a6d1f),volume_type_id=badec9e4-ba6a-4b26-9e2b-9287ee6a6d1f)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:39 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c921f5ba-4751-4881-a96f-7afa811686b5 tempest-GroupsTest-1667041417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f44836cb-f550-4644-8fe7-a72bde236213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:39 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c921f5ba-4751-4881-a96f-7afa811686b5 tempest-GroupsTest-1667041417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f44836cb-f550-4644-8fe7-a72bde236213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:39 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c921f5ba-4751-4881-a96f-7afa811686b5 tempest-GroupsTest-1667041417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81438740-87d6-43f7-8930-c5a00a5cd652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:39 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c921f5ba-4751-4881-a96f-7afa811686b5 tempest-GroupsTest-1667041417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81438740-87d6-43f7-8930-c5a00a5cd652) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d9de56a-2abe-4f7b-9fa0-e3a429e0bc86', 'volume_name': 'volume-9d9de56a-2abe-4f7b-9fa0-e3a429e0bc86', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:39 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c921f5ba-4751-4881-a96f-7afa811686b5 tempest-GroupsTest-1667041417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f0d4fe1-b451-4d9f-aca4-2fc922621307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:39 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c921f5ba-4751-4881-a96f-7afa811686b5 tempest-GroupsTest-1667041417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f0d4fe1-b451-4d9f-aca4-2fc922621307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:39 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c921f5ba-4751-4881-a96f-7afa811686b5 tempest-GroupsTest-1667041417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (596e4310-4edb-4ed2-a3bb-707afbb1e0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:39 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-c921f5ba-4751-4881-a96f-7afa811686b5 tempest-GroupsTest-1667041417 None] Volume 9d9de56a-2abe-4f7b-9fa0-e3a429e0bc86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d9de56a-2abe-4f7b-9fa0-e3a429e0bc86', 'volume_size': 1} Nov 03 07:42:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-c921f5ba-4751-4881-a96f-7afa811686b5 tempest-GroupsTest-1667041417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:39 devstack sudo[102105]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5099358b-3137-4418-ab98-d5c29baab417 tempest-CreateVolumesFromImageTest-369757415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c301beb2-2743-4442-b583-5233a9d7d507" returned: 0 in 0.695s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5099358b-3137-4418-ab98-d5c29baab417 tempest-CreateVolumesFromImageTest-369757415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c301beb2-2743-4442-b583-5233a9d7d507 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:39 devstack sudo[102115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c301beb2-2743-4442-b583-5233a9d7d507 Nov 03 07:42:39 devstack sudo[102115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:39 devstack sudo[102104]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-636d4172-3be1-4194-80f0-cff045828b31 tempest-CinderUnicodeTest-805292985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b4d65c82-7d3c-484d-8f29-df51412c8511 1073741824" returned: 0 in 0.802s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-636d4172-3be1-4194-80f0-cff045828b31 tempest-CinderUnicodeTest-805292985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b4d65c82-7d3c-484d-8f29-df51412c8511 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:40 devstack sudo[102117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b4d65c82-7d3c-484d-8f29-df51412c8511 Nov 03 07:42:40 devstack sudo[102117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:40 devstack sudo[102115]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5099358b-3137-4418-ab98-d5c29baab417 tempest-CreateVolumesFromImageTest-369757415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c301beb2-2743-4442-b583-5233a9d7d507" returned: 0 in 0.415s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:40 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-5099358b-3137-4418-ab98-d5c29baab417 tempest-CreateVolumesFromImageTest-369757415 None] Lock "cinder-quobyte-c301beb2-2743-4442-b583-5233a9d7d507" released by "delete_volume" :: held 1.292s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:40 devstack sudo[102117]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-636d4172-3be1-4194-80f0-cff045828b31 tempest-CinderUnicodeTest-805292985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b4d65c82-7d3c-484d-8f29-df51412c8511" returned: 0 in 0.358s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:40 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-636d4172-3be1-4194-80f0-cff045828b31 tempest-CinderUnicodeTest-805292985 None] <== create_volume: return (1227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:42:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-636d4172-3be1-4194-80f0-cff045828b31 tempest-CinderUnicodeTest-805292985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.230s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-c921f5ba-4751-4881-a96f-7afa811686b5 tempest-GroupsTest-1667041417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.885s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:40 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-c921f5ba-4751-4881-a96f-7afa811686b5 tempest-GroupsTest-1667041417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e511ddd3-9ea5-4823-acd8-3bba81700642,created_at=2026-11-03T06:42:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-81448713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e511ddd3-9ea5-4823-acd8-3bba81700642,host='devstack@QuobyteHD#QuobyteHD',id=9d9de56a-2abe-4f7b-9fa0-e3a429e0bc86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4767c0eec5514593a15ef4657122a528',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:42:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:42:39Z,use_quota=True,user_id='1847edabe043435a90017d53bce43208',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(badec9e4-ba6a-4b26-9e2b-9287ee6a6d1f),volume_type_id=badec9e4-ba6a-4b26-9e2b-9287ee6a6d1f)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:42:40 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-c921f5ba-4751-4881-a96f-7afa811686b5 tempest-GroupsTest-1667041417 None] Creating volume 9d9de56a-2abe-4f7b-9fa0-e3a429e0bc86 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:42:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-c921f5ba-4751-4881-a96f-7afa811686b5 tempest-GroupsTest-1667041417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-c921f5ba-4751-4881-a96f-7afa811686b5 tempest-GroupsTest-1667041417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:40 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-c921f5ba-4751-4881-a96f-7afa811686b5 tempest-GroupsTest-1667041417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:42:40 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-c921f5ba-4751-4881-a96f-7afa811686b5 tempest-GroupsTest-1667041417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:42:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-c921f5ba-4751-4881-a96f-7afa811686b5 tempest-GroupsTest-1667041417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:40 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-c921f5ba-4751-4881-a96f-7afa811686b5 tempest-GroupsTest-1667041417 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:42:40 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-c921f5ba-4751-4881-a96f-7afa811686b5 tempest-GroupsTest-1667041417 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:42:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c921f5ba-4751-4881-a96f-7afa811686b5 tempest-GroupsTest-1667041417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9d9de56a-2abe-4f7b-9fa0-e3a429e0bc86 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:40 devstack sudo[102124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9d9de56a-2abe-4f7b-9fa0-e3a429e0bc86 1073741824 Nov 03 07:42:40 devstack sudo[102124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:40 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-636d4172-3be1-4194-80f0-cff045828b31 tempest-CinderUnicodeTest-805292985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bcb013b-27e4-4108-b469-9846ef0f1b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4d65c82-7d3c-484d-8f29-df51412c8511', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:40 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-636d4172-3be1-4194-80f0-cff045828b31 tempest-CinderUnicodeTest-805292985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2f95602-de54-49c0-a21a-f53c75aa6267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:40 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-636d4172-3be1-4194-80f0-cff045828b31 tempest-CinderUnicodeTest-805292985 None] Volume volume-b4d65c82-7d3c-484d-8f29-df51412c8511 (b4d65c82-7d3c-484d-8f29-df51412c8511): created successfully Nov 03 07:42:40 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-636d4172-3be1-4194-80f0-cff045828b31 tempest-CinderUnicodeTest-805292985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2f95602-de54-49c0-a21a-f53c75aa6267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:40 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-636d4172-3be1-4194-80f0-cff045828b31 tempest-CinderUnicodeTest-805292985 None] Flow 'volume_create_manager' (5b62cd0c-b287-4e80-8ac4-1d7bd89101ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:42:40 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-5099358b-3137-4418-ab98-d5c29baab417 tempest-CreateVolumesFromImageTest-369757415 None] Created reservations ['b14f8c8c-ca55-4ed3-91bb-855ec4a802d6', '1477f7b1-453e-49c7-8058-3e8698c23ad7', 'e2b3533f-f9b0-46ba-935d-3dbec58031b2', 'a7ccf293-9797-4452-b3d9-90769e40f9e4'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:42:40 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-636d4172-3be1-4194-80f0-cff045828b31 tempest-CinderUnicodeTest-805292985 None] Created volume successfully. Nov 03 07:42:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-5099358b-3137-4418-ab98-d5c29baab417 tempest-CreateVolumesFromImageTest-369757415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-5099358b-3137-4418-ab98-d5c29baab417 tempest-CreateVolumesFromImageTest-369757415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:40 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-5099358b-3137-4418-ab98-d5c29baab417 tempest-CreateVolumesFromImageTest-369757415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:42:40 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-5099358b-3137-4418-ab98-d5c29baab417 tempest-CreateVolumesFromImageTest-369757415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:42:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-5099358b-3137-4418-ab98-d5c29baab417 tempest-CreateVolumesFromImageTest-369757415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5099358b-3137-4418-ab98-d5c29baab417 tempest-CreateVolumesFromImageTest-369757415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:40 devstack sudo[102130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:42:40 devstack sudo[102130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:41 devstack sudo[102130]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5099358b-3137-4418-ab98-d5c29baab417 tempest-CreateVolumesFromImageTest-369757415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.508s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:41 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-5099358b-3137-4418-ab98-d5c29baab417 tempest-CreateVolumesFromImageTest-369757415 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:42:41 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-5099358b-3137-4418-ab98-d5c29baab417 tempest-CreateVolumesFromImageTest-369757415 None] Deleted volume successfully. Nov 03 07:42:41 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-5099358b-3137-4418-ab98-d5c29baab417 tempest-CreateVolumesFromImageTest-369757415 None] Lock "cinder-c301beb2-2743-4442-b583-5233a9d7d507-delete_volume" released by "delete_volume" :: held 2.450s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:41 devstack sudo[102124]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c921f5ba-4751-4881-a96f-7afa811686b5 tempest-GroupsTest-1667041417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9d9de56a-2abe-4f7b-9fa0-e3a429e0bc86 1073741824" returned: 0 in 0.868s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c921f5ba-4751-4881-a96f-7afa811686b5 tempest-GroupsTest-1667041417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9d9de56a-2abe-4f7b-9fa0-e3a429e0bc86 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7d53e4e1-2925-4e0a-9503-69f272bb8571 tempest-CinderUnicodeTest-805292985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:41 devstack sudo[102141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9d9de56a-2abe-4f7b-9fa0-e3a429e0bc86 Nov 03 07:42:41 devstack sudo[102141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:41 devstack sudo[102141]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c921f5ba-4751-4881-a96f-7afa811686b5 tempest-GroupsTest-1667041417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9d9de56a-2abe-4f7b-9fa0-e3a429e0bc86" returned: 0 in 0.334s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:41 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-c921f5ba-4751-4881-a96f-7afa811686b5 tempest-GroupsTest-1667041417 None] <== create_volume: return (1301ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:42:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-c921f5ba-4751-4881-a96f-7afa811686b5 tempest-GroupsTest-1667041417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.304s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7d53e4e1-2925-4e0a-9503-69f272bb8571 tempest-CinderUnicodeTest-805292985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.324s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:41 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c921f5ba-4751-4881-a96f-7afa811686b5 tempest-GroupsTest-1667041417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (596e4310-4edb-4ed2-a3bb-707afbb1e0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d9de56a-2abe-4f7b-9fa0-e3a429e0bc86', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:41 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c921f5ba-4751-4881-a96f-7afa811686b5 tempest-GroupsTest-1667041417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12faa468-c636-4a28-94c0-0b049b40910a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:41 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-7d53e4e1-2925-4e0a-9503-69f272bb8571 tempest-CinderUnicodeTest-805292985 None] Creating offline snapshot 48b42834-06e8-454d-974d-5b2b91e059ad of volume b4d65c82-7d3c-484d-8f29-df51412c8511 {{(pid=86875) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:42:41 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-c921f5ba-4751-4881-a96f-7afa811686b5 tempest-GroupsTest-1667041417 None] Volume volume-9d9de56a-2abe-4f7b-9fa0-e3a429e0bc86 (9d9de56a-2abe-4f7b-9fa0-e3a429e0bc86): created successfully Nov 03 07:42:41 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c921f5ba-4751-4881-a96f-7afa811686b5 tempest-GroupsTest-1667041417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12faa468-c636-4a28-94c0-0b049b40910a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:41 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c921f5ba-4751-4881-a96f-7afa811686b5 tempest-GroupsTest-1667041417 None] Flow 'volume_create_manager' (8192f76f-37fb-4ded-9c9b-ca1cc9e84a02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:42:41 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6e97ba-6d32-4c96-b773-52b452ae8209]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:42:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7d53e4e1-2925-4e0a-9503-69f272bb8571 tempest-CinderUnicodeTest-805292985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b4d65c82-7d3c-484d-8f29-df51412c8511 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:41 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-c921f5ba-4751-4881-a96f-7afa811686b5 tempest-GroupsTest-1667041417 None] Created volume successfully. Nov 03 07:42:41 devstack sudo[102144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b4d65c82-7d3c-484d-8f29-df51412c8511 Nov 03 07:42:41 devstack sudo[102144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:42 devstack sudo[102144]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7d53e4e1-2925-4e0a-9503-69f272bb8571 tempest-CinderUnicodeTest-805292985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b4d65c82-7d3c-484d-8f29-df51412c8511" returned: 0 in 0.535s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7d53e4e1-2925-4e0a-9503-69f272bb8571 tempest-CinderUnicodeTest-805292985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b4d65c82-7d3c-484d-8f29-df51412c8511,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b4d65c82-7d3c-484d-8f29-df51412c8511.48b42834-06e8-454d-974d-5b2b91e059ad 1G {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:42 devstack sudo[102150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b4d65c82-7d3c-484d-8f29-df51412c8511,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b4d65c82-7d3c-484d-8f29-df51412c8511.48b42834-06e8-454d-974d-5b2b91e059ad 1G Nov 03 07:42:42 devstack sudo[102150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:42 devstack cinder-volume[86875]: INFO cinder.volume.manager [req-5d1b3444-a604-4cf1-9708-82990297c9bf req-c20f0b59-0fe5-44eb-bc30-76782de3909b tempest-TestStampPattern-389950066 None] Terminate volume connection completed successfully. Nov 03 07:42:42 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-5d1b3444-a604-4cf1-9708-82990297c9bf req-c20f0b59-0fe5-44eb-bc30-76782de3909b tempest-TestStampPattern-389950066 None] Deleting attachment 07b88d27-41c4-4e3d-a7df-1fce468d9d2e. {{(pid=86875) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:42:42 devstack sudo[102150]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7d53e4e1-2925-4e0a-9503-69f272bb8571 tempest-CinderUnicodeTest-805292985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b4d65c82-7d3c-484d-8f29-df51412c8511,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b4d65c82-7d3c-484d-8f29-df51412c8511.48b42834-06e8-454d-974d-5b2b91e059ad 1G" returned: 0 in 0.648s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7d53e4e1-2925-4e0a-9503-69f272bb8571 tempest-CinderUnicodeTest-805292985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4d65c82-7d3c-484d-8f29-df51412c8511 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b4d65c82-7d3c-484d-8f29-df51412c8511.48b42834-06e8-454d-974d-5b2b91e059ad {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:42 devstack sudo[102183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4d65c82-7d3c-484d-8f29-df51412c8511 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b4d65c82-7d3c-484d-8f29-df51412c8511.48b42834-06e8-454d-974d-5b2b91e059ad Nov 03 07:42:42 devstack sudo[102183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:43 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-62797078-a486-4d06-b0e5-23e5df9f4a7a tempest-TestStampPattern-389950066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:43 devstack sudo[102183]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:43 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7d53e4e1-2925-4e0a-9503-69f272bb8571 tempest-CinderUnicodeTest-805292985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4d65c82-7d3c-484d-8f29-df51412c8511 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b4d65c82-7d3c-484d-8f29-df51412c8511.48b42834-06e8-454d-974d-5b2b91e059ad" returned: 0 in 0.666s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:43 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-7d53e4e1-2925-4e0a-9503-69f272bb8571 tempest-CinderUnicodeTest-805292985 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b4d65c82-7d3c-484d-8f29-df51412c8511.48b42834-06e8-454d-974d-5b2b91e059ad is being set with open permissions: ugo+rw Nov 03 07:42:43 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7d53e4e1-2925-4e0a-9503-69f272bb8571 tempest-CinderUnicodeTest-805292985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b4d65c82-7d3c-484d-8f29-df51412c8511.48b42834-06e8-454d-974d-5b2b91e059ad {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:43 devstack sudo[102188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b4d65c82-7d3c-484d-8f29-df51412c8511.48b42834-06e8-454d-974d-5b2b91e059ad Nov 03 07:42:43 devstack sudo[102188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:43 devstack sudo[102188]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:43 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7d53e4e1-2925-4e0a-9503-69f272bb8571 tempest-CinderUnicodeTest-805292985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b4d65c82-7d3c-484d-8f29-df51412c8511.48b42834-06e8-454d-974d-5b2b91e059ad" returned: 0 in 0.313s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7d53e4e1-2925-4e0a-9503-69f272bb8571 tempest-CinderUnicodeTest-805292985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b4d65c82-7d3c-484d-8f29-df51412c8511.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:44 devstack sudo[102191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b4d65c82-7d3c-484d-8f29-df51412c8511.info Nov 03 07:42:44 devstack sudo[102191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:44 devstack sudo[102191]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7d53e4e1-2925-4e0a-9503-69f272bb8571 tempest-CinderUnicodeTest-805292985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b4d65c82-7d3c-484d-8f29-df51412c8511.info" returned: 0 in 0.273s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:44 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-7d53e4e1-2925-4e0a-9503-69f272bb8571 tempest-CinderUnicodeTest-805292985 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b4d65c82-7d3c-484d-8f29-df51412c8511.info is being set with open permissions: ugo+rw Nov 03 07:42:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7d53e4e1-2925-4e0a-9503-69f272bb8571 tempest-CinderUnicodeTest-805292985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b4d65c82-7d3c-484d-8f29-df51412c8511.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:44 devstack sudo[102194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b4d65c82-7d3c-484d-8f29-df51412c8511.info Nov 03 07:42:44 devstack sudo[102194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:44 devstack sudo[102194]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7d53e4e1-2925-4e0a-9503-69f272bb8571 tempest-CinderUnicodeTest-805292985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b4d65c82-7d3c-484d-8f29-df51412c8511.info" returned: 0 in 0.277s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7d53e4e1-2925-4e0a-9503-69f272bb8571 tempest-CinderUnicodeTest-805292985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.361s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-62797078-a486-4d06-b0e5-23e5df9f4a7a tempest-TestStampPattern-389950066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.454s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:45 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-62797078-a486-4d06-b0e5-23e5df9f4a7a tempest-TestStampPattern-389950066 None] Creating offline snapshot c0a8a75f-a530-446b-9813-62cc8183dafe of volume 9118d4a4-1e9c-4c31-b4e8-9b48cad4a771 {{(pid=86875) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:42:45 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[31fbfa31-708f-4ced-81a7-ae5248a20622]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:42:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-62797078-a486-4d06-b0e5-23e5df9f4a7a tempest-TestStampPattern-389950066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:45 devstack sudo[102197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771 Nov 03 07:42:45 devstack sudo[102197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:45 devstack sudo[102197]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-62797078-a486-4d06-b0e5-23e5df9f4a7a tempest-TestStampPattern-389950066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771" returned: 0 in 0.357s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-62797078-a486-4d06-b0e5-23e5df9f4a7a tempest-TestStampPattern-389950066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771.c0a8a75f-a530-446b-9813-62cc8183dafe 1G {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:45 devstack sudo[102202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771.c0a8a75f-a530-446b-9813-62cc8183dafe 1G Nov 03 07:42:45 devstack sudo[102202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:45 devstack sudo[102202]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-62797078-a486-4d06-b0e5-23e5df9f4a7a tempest-TestStampPattern-389950066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771.c0a8a75f-a530-446b-9813-62cc8183dafe 1G" returned: 0 in 0.435s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-62797078-a486-4d06-b0e5-23e5df9f4a7a tempest-TestStampPattern-389950066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771.c0a8a75f-a530-446b-9813-62cc8183dafe {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:45 devstack sudo[102208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771.c0a8a75f-a530-446b-9813-62cc8183dafe Nov 03 07:42:45 devstack sudo[102208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:46 devstack sudo[102208]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-62797078-a486-4d06-b0e5-23e5df9f4a7a tempest-TestStampPattern-389950066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771.c0a8a75f-a530-446b-9813-62cc8183dafe" returned: 0 in 0.274s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:46 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-62797078-a486-4d06-b0e5-23e5df9f4a7a tempest-TestStampPattern-389950066 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771.c0a8a75f-a530-446b-9813-62cc8183dafe is being set with open permissions: ugo+rw Nov 03 07:42:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-62797078-a486-4d06-b0e5-23e5df9f4a7a tempest-TestStampPattern-389950066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771.c0a8a75f-a530-446b-9813-62cc8183dafe {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:46 devstack sudo[102213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771.c0a8a75f-a530-446b-9813-62cc8183dafe Nov 03 07:42:46 devstack sudo[102213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:46 devstack sudo[102213]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-62797078-a486-4d06-b0e5-23e5df9f4a7a tempest-TestStampPattern-389950066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771.c0a8a75f-a530-446b-9813-62cc8183dafe" returned: 0 in 0.231s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:47 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-7d53e4e1-2925-4e0a-9503-69f272bb8571 tempest-CinderUnicodeTest-805292985 None] Create snapshot completed successfully Nov 03 07:42:47 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-62797078-a486-4d06-b0e5-23e5df9f4a7a tempest-TestStampPattern-389950066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:47 devstack sudo[102216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771.info Nov 03 07:42:47 devstack sudo[102216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:47 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-e449092e-2ff4-4fac-9b45-d5a2d91b0913 tempest-GroupsTest-1667041417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:42:47 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e449092e-2ff4-4fac-9b45-d5a2d91b0913 tempest-GroupsTest-1667041417 None] Flow 'volume_create_manager' (3f2d6d7e-2deb-4d8c-bec6-b1fff5165414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:42:47 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e449092e-2ff4-4fac-9b45-d5a2d91b0913 tempest-GroupsTest-1667041417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d3893bd-c8d9-4f6b-90d9-bb7ea9d7e50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:47 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e449092e-2ff4-4fac-9b45-d5a2d91b0913 tempest-GroupsTest-1667041417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d3893bd-c8d9-4f6b-90d9-bb7ea9d7e50a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:42:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1668677475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e511ddd3-9ea5-4823-acd8-3bba81700642,host='devstack@QuobyteHD#QuobyteHD',id=150bc743-36c0-43e4-9098-bcd893214fa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4767c0eec5514593a15ef4657122a528',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:42:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:42:48Z,use_quota=True,user_id='1847edabe043435a90017d53bce43208',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(badec9e4-ba6a-4b26-9e2b-9287ee6a6d1f),volume_type_id=badec9e4-ba6a-4b26-9e2b-9287ee6a6d1f)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:47 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e449092e-2ff4-4fac-9b45-d5a2d91b0913 tempest-GroupsTest-1667041417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (877077bc-f080-45e1-9937-84d06c541e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:47 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e449092e-2ff4-4fac-9b45-d5a2d91b0913 tempest-GroupsTest-1667041417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (877077bc-f080-45e1-9937-84d06c541e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:47 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e449092e-2ff4-4fac-9b45-d5a2d91b0913 tempest-GroupsTest-1667041417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb835ee6-b7ca-4296-ac21-cf343cc50701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:47 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e449092e-2ff4-4fac-9b45-d5a2d91b0913 tempest-GroupsTest-1667041417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb835ee6-b7ca-4296-ac21-cf343cc50701) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '150bc743-36c0-43e4-9098-bcd893214fa0', 'volume_name': 'volume-150bc743-36c0-43e4-9098-bcd893214fa0', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:47 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e449092e-2ff4-4fac-9b45-d5a2d91b0913 tempest-GroupsTest-1667041417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb83b782-57b5-4d09-b32a-616cdd7cfd00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:48 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e449092e-2ff4-4fac-9b45-d5a2d91b0913 tempest-GroupsTest-1667041417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb83b782-57b5-4d09-b32a-616cdd7cfd00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:48 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e449092e-2ff4-4fac-9b45-d5a2d91b0913 tempest-GroupsTest-1667041417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6245eb6f-ea70-4ada-8d71-3b195b5372ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:48 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-e449092e-2ff4-4fac-9b45-d5a2d91b0913 tempest-GroupsTest-1667041417 None] Volume 150bc743-36c0-43e4-9098-bcd893214fa0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-150bc743-36c0-43e4-9098-bcd893214fa0', 'volume_size': 1} Nov 03 07:42:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e449092e-2ff4-4fac-9b45-d5a2d91b0913 tempest-GroupsTest-1667041417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:48 devstack sudo[102216]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-62797078-a486-4d06-b0e5-23e5df9f4a7a tempest-TestStampPattern-389950066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771.info" returned: 0 in 0.380s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:48 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-62797078-a486-4d06-b0e5-23e5df9f4a7a tempest-TestStampPattern-389950066 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771.info is being set with open permissions: ugo+rw Nov 03 07:42:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-62797078-a486-4d06-b0e5-23e5df9f4a7a tempest-TestStampPattern-389950066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:48 devstack sudo[102220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771.info Nov 03 07:42:48 devstack sudo[102220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:48 devstack sudo[102220]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-62797078-a486-4d06-b0e5-23e5df9f4a7a tempest-TestStampPattern-389950066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771.info" returned: 0 in 0.264s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-62797078-a486-4d06-b0e5-23e5df9f4a7a tempest-TestStampPattern-389950066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.295s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e449092e-2ff4-4fac-9b45-d5a2d91b0913 tempest-GroupsTest-1667041417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.305s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:48 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-e449092e-2ff4-4fac-9b45-d5a2d91b0913 tempest-GroupsTest-1667041417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e511ddd3-9ea5-4823-acd8-3bba81700642,created_at=2026-11-03T06:42:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1668677475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e511ddd3-9ea5-4823-acd8-3bba81700642,host='devstack@QuobyteHD#QuobyteHD',id=150bc743-36c0-43e4-9098-bcd893214fa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4767c0eec5514593a15ef4657122a528',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:42:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:42:48Z,use_quota=True,user_id='1847edabe043435a90017d53bce43208',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(badec9e4-ba6a-4b26-9e2b-9287ee6a6d1f),volume_type_id=badec9e4-ba6a-4b26-9e2b-9287ee6a6d1f)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:42:48 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-e449092e-2ff4-4fac-9b45-d5a2d91b0913 tempest-GroupsTest-1667041417 None] Creating volume 150bc743-36c0-43e4-9098-bcd893214fa0 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:42:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e449092e-2ff4-4fac-9b45-d5a2d91b0913 tempest-GroupsTest-1667041417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e449092e-2ff4-4fac-9b45-d5a2d91b0913 tempest-GroupsTest-1667041417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:48 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-e449092e-2ff4-4fac-9b45-d5a2d91b0913 tempest-GroupsTest-1667041417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:42:48 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-e449092e-2ff4-4fac-9b45-d5a2d91b0913 tempest-GroupsTest-1667041417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:42:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e449092e-2ff4-4fac-9b45-d5a2d91b0913 tempest-GroupsTest-1667041417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:48 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-e449092e-2ff4-4fac-9b45-d5a2d91b0913 tempest-GroupsTest-1667041417 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:42:48 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-e449092e-2ff4-4fac-9b45-d5a2d91b0913 tempest-GroupsTest-1667041417 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:42:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e449092e-2ff4-4fac-9b45-d5a2d91b0913 tempest-GroupsTest-1667041417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-150bc743-36c0-43e4-9098-bcd893214fa0 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:48 devstack sudo[102223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-150bc743-36c0-43e4-9098-bcd893214fa0 1073741824 Nov 03 07:42:48 devstack sudo[102223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:48 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-62797078-a486-4d06-b0e5-23e5df9f4a7a tempest-TestStampPattern-389950066 None] Create snapshot completed successfully Nov 03 07:42:48 devstack sudo[102223]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e449092e-2ff4-4fac-9b45-d5a2d91b0913 tempest-GroupsTest-1667041417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-150bc743-36c0-43e4-9098-bcd893214fa0 1073741824" returned: 0 in 0.569s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:49 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-808042cc-2767-4c41-97f1-1dd9b7f32770 tempest-CinderUnicodeTest-805292985 None] Acquiring lock "cinder-48b42834-06e8-454d-974d-5b2b91e059ad-delete_snapshot" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:49 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-808042cc-2767-4c41-97f1-1dd9b7f32770 tempest-CinderUnicodeTest-805292985 None] Lock "cinder-48b42834-06e8-454d-974d-5b2b91e059ad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:49 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-808042cc-2767-4c41-97f1-1dd9b7f32770 tempest-CinderUnicodeTest-805292985 None] Acquiring lock "cinder-quobyte-b4d65c82-7d3c-484d-8f29-df51412c8511" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:49 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-808042cc-2767-4c41-97f1-1dd9b7f32770 tempest-CinderUnicodeTest-805292985 None] Lock "cinder-quobyte-b4d65c82-7d3c-484d-8f29-df51412c8511" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:49 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-808042cc-2767-4c41-97f1-1dd9b7f32770 tempest-CinderUnicodeTest-805292985 None] Acquiring lock "cinder-quobyte-48b42834-06e8-454d-974d-5b2b91e059ad" by "_delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:49 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-808042cc-2767-4c41-97f1-1dd9b7f32770 tempest-CinderUnicodeTest-805292985 None] Lock "cinder-quobyte-48b42834-06e8-454d-974d-5b2b91e059ad" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:49 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-808042cc-2767-4c41-97f1-1dd9b7f32770 tempest-CinderUnicodeTest-805292985 None] Deleting offline snapshot 48b42834-06e8-454d-974d-5b2b91e059ad of volume b4d65c82-7d3c-484d-8f29-df51412c8511 {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:42:49 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-808042cc-2767-4c41-97f1-1dd9b7f32770 tempest-CinderUnicodeTest-805292985 None] snapshot_file for this snap is: volume-b4d65c82-7d3c-484d-8f29-df51412c8511.48b42834-06e8-454d-974d-5b2b91e059ad {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:42:49 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[17058134-b1f1-4034-841d-9d0913719af9]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:42:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-808042cc-2767-4c41-97f1-1dd9b7f32770 tempest-CinderUnicodeTest-805292985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b4d65c82-7d3c-484d-8f29-df51412c8511.48b42834-06e8-454d-974d-5b2b91e059ad {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:49 devstack sudo[102229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b4d65c82-7d3c-484d-8f29-df51412c8511.48b42834-06e8-454d-974d-5b2b91e059ad Nov 03 07:42:49 devstack sudo[102229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:49 devstack sudo[102229]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-808042cc-2767-4c41-97f1-1dd9b7f32770 tempest-CinderUnicodeTest-805292985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b4d65c82-7d3c-484d-8f29-df51412c8511.48b42834-06e8-454d-974d-5b2b91e059ad" returned: 0 in 0.390s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:49 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-808042cc-2767-4c41-97f1-1dd9b7f32770 tempest-CinderUnicodeTest-805292985 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4d65c82-7d3c-484d-8f29-df51412c8511(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:42:49 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c32eba-99e9-4373-9c00-72bcb981eeaa]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:42:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-808042cc-2767-4c41-97f1-1dd9b7f32770 tempest-CinderUnicodeTest-805292985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b4d65c82-7d3c-484d-8f29-df51412c8511 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:49 devstack sudo[102234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b4d65c82-7d3c-484d-8f29-df51412c8511 Nov 03 07:42:49 devstack sudo[102234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:50 devstack sudo[102234]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-808042cc-2767-4c41-97f1-1dd9b7f32770 tempest-CinderUnicodeTest-805292985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b4d65c82-7d3c-484d-8f29-df51412c8511" returned: 0 in 0.412s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-808042cc-2767-4c41-97f1-1dd9b7f32770 tempest-CinderUnicodeTest-805292985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b4d65c82-7d3c-484d-8f29-df51412c8511.48b42834-06e8-454d-974d-5b2b91e059ad {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:50 devstack sudo[102239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b4d65c82-7d3c-484d-8f29-df51412c8511.48b42834-06e8-454d-974d-5b2b91e059ad Nov 03 07:42:50 devstack sudo[102239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:50 devstack sudo[102239]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-808042cc-2767-4c41-97f1-1dd9b7f32770 tempest-CinderUnicodeTest-805292985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b4d65c82-7d3c-484d-8f29-df51412c8511.48b42834-06e8-454d-974d-5b2b91e059ad" returned: 0 in 0.320s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-808042cc-2767-4c41-97f1-1dd9b7f32770 tempest-CinderUnicodeTest-805292985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b4d65c82-7d3c-484d-8f29-df51412c8511.48b42834-06e8-454d-974d-5b2b91e059ad {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:50 devstack sudo[102245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b4d65c82-7d3c-484d-8f29-df51412c8511.48b42834-06e8-454d-974d-5b2b91e059ad Nov 03 07:42:50 devstack sudo[102245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:50 devstack sudo[102245]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-808042cc-2767-4c41-97f1-1dd9b7f32770 tempest-CinderUnicodeTest-805292985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b4d65c82-7d3c-484d-8f29-df51412c8511.48b42834-06e8-454d-974d-5b2b91e059ad" returned: 0 in 0.237s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:50 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-808042cc-2767-4c41-97f1-1dd9b7f32770 tempest-CinderUnicodeTest-805292985 None] Lock "cinder-quobyte-48b42834-06e8-454d-974d-5b2b91e059ad" released by "_delete_snapshot" :: held 1.482s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:50 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-808042cc-2767-4c41-97f1-1dd9b7f32770 tempest-CinderUnicodeTest-805292985 None] Lock "cinder-quobyte-b4d65c82-7d3c-484d-8f29-df51412c8511" released by "delete_snapshot" :: held 1.509s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e449092e-2ff4-4fac-9b45-d5a2d91b0913 tempest-GroupsTest-1667041417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-150bc743-36c0-43e4-9098-bcd893214fa0 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:50 devstack sudo[102248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-150bc743-36c0-43e4-9098-bcd893214fa0 Nov 03 07:42:50 devstack sudo[102248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:50 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-808042cc-2767-4c41-97f1-1dd9b7f32770 tempest-CinderUnicodeTest-805292985 None] Created reservations ['c2153110-7059-41e2-ba9c-cd6eb7717bed', '83219eab-35e9-43d4-9d7a-14ee9e5abfa5', '4ac566cf-28a0-46a2-a0ba-c4c2aa9193b2', '20b61453-a19a-487b-8e9c-4e102b3386d8'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:42:51 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-808042cc-2767-4c41-97f1-1dd9b7f32770 tempest-CinderUnicodeTest-805292985 None] Delete snapshot completed successfully. Nov 03 07:42:51 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-808042cc-2767-4c41-97f1-1dd9b7f32770 tempest-CinderUnicodeTest-805292985 None] Lock "cinder-48b42834-06e8-454d-974d-5b2b91e059ad-delete_snapshot" released by "delete_snapshot" :: held 1.956s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:51 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d33cb11f-cb77-4b51-b70b-b6aad0bc274b tempest-CinderUnicodeTest-805292985 None] Acquiring lock "cinder-b4d65c82-7d3c-484d-8f29-df51412c8511-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:51 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d33cb11f-cb77-4b51-b70b-b6aad0bc274b tempest-CinderUnicodeTest-805292985 None] Lock "cinder-b4d65c82-7d3c-484d-8f29-df51412c8511-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:51 devstack sudo[102248]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e449092e-2ff4-4fac-9b45-d5a2d91b0913 tempest-GroupsTest-1667041417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-150bc743-36c0-43e4-9098-bcd893214fa0" returned: 0 in 0.467s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:51 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-e449092e-2ff4-4fac-9b45-d5a2d91b0913 tempest-GroupsTest-1667041417 None] <== create_volume: return (3041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:42:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e449092e-2ff4-4fac-9b45-d5a2d91b0913 tempest-GroupsTest-1667041417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.044s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:51 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e449092e-2ff4-4fac-9b45-d5a2d91b0913 tempest-GroupsTest-1667041417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6245eb6f-ea70-4ada-8d71-3b195b5372ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-150bc743-36c0-43e4-9098-bcd893214fa0', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:51 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e449092e-2ff4-4fac-9b45-d5a2d91b0913 tempest-GroupsTest-1667041417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bafad1b-b1c1-40c3-887a-1c68d3fe8cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:51 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-e449092e-2ff4-4fac-9b45-d5a2d91b0913 tempest-GroupsTest-1667041417 None] Volume volume-150bc743-36c0-43e4-9098-bcd893214fa0 (150bc743-36c0-43e4-9098-bcd893214fa0): created successfully Nov 03 07:42:51 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e449092e-2ff4-4fac-9b45-d5a2d91b0913 tempest-GroupsTest-1667041417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bafad1b-b1c1-40c3-887a-1c68d3fe8cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:51 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e449092e-2ff4-4fac-9b45-d5a2d91b0913 tempest-GroupsTest-1667041417 None] Flow 'volume_create_manager' (3f2d6d7e-2deb-4d8c-bec6-b1fff5165414) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:42:51 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-e449092e-2ff4-4fac-9b45-d5a2d91b0913 tempest-GroupsTest-1667041417 None] Created volume successfully. Nov 03 07:42:51 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d33cb11f-cb77-4b51-b70b-b6aad0bc274b tempest-CinderUnicodeTest-805292985 None] Acquiring lock "cinder-quobyte-b4d65c82-7d3c-484d-8f29-df51412c8511" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:51 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d33cb11f-cb77-4b51-b70b-b6aad0bc274b tempest-CinderUnicodeTest-805292985 None] Lock "cinder-quobyte-b4d65c82-7d3c-484d-8f29-df51412c8511" acquired by "delete_volume" :: waited 0.032s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:51 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd028c42-d98b-4f03-bd7b-cb9e58a617d1]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:42:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d33cb11f-cb77-4b51-b70b-b6aad0bc274b tempest-CinderUnicodeTest-805292985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b4d65c82-7d3c-484d-8f29-df51412c8511 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:51 devstack sudo[102251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b4d65c82-7d3c-484d-8f29-df51412c8511 Nov 03 07:42:51 devstack sudo[102251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:52 devstack sudo[102251]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d33cb11f-cb77-4b51-b70b-b6aad0bc274b tempest-CinderUnicodeTest-805292985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b4d65c82-7d3c-484d-8f29-df51412c8511" returned: 0 in 0.482s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d33cb11f-cb77-4b51-b70b-b6aad0bc274b tempest-CinderUnicodeTest-805292985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b4d65c82-7d3c-484d-8f29-df51412c8511 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:52 devstack sudo[102262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b4d65c82-7d3c-484d-8f29-df51412c8511 Nov 03 07:42:52 devstack sudo[102262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:52 devstack sudo[102262]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d33cb11f-cb77-4b51-b70b-b6aad0bc274b tempest-CinderUnicodeTest-805292985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b4d65c82-7d3c-484d-8f29-df51412c8511" returned: 0 in 0.339s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:52 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d33cb11f-cb77-4b51-b70b-b6aad0bc274b tempest-CinderUnicodeTest-805292985 None] Lock "cinder-quobyte-b4d65c82-7d3c-484d-8f29-df51412c8511" released by "delete_volume" :: held 0.931s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:52 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-d33cb11f-cb77-4b51-b70b-b6aad0bc274b tempest-CinderUnicodeTest-805292985 None] Created reservations ['57989a6b-ab35-431e-bcb5-a74b4b4a05f4', 'a31ee6de-e1a7-4320-999c-53ebe0b7b59c', 'b37f5293-d8c3-4cb6-bd86-2c80260abb30', 'e6ad3c4b-a899-42de-b5ba-a81546c98e40'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:42:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-d33cb11f-cb77-4b51-b70b-b6aad0bc274b tempest-CinderUnicodeTest-805292985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-d33cb11f-cb77-4b51-b70b-b6aad0bc274b tempest-CinderUnicodeTest-805292985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:52 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-d33cb11f-cb77-4b51-b70b-b6aad0bc274b tempest-CinderUnicodeTest-805292985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:42:52 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-d33cb11f-cb77-4b51-b70b-b6aad0bc274b tempest-CinderUnicodeTest-805292985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:42:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-d33cb11f-cb77-4b51-b70b-b6aad0bc274b tempest-CinderUnicodeTest-805292985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d33cb11f-cb77-4b51-b70b-b6aad0bc274b tempest-CinderUnicodeTest-805292985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:52 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-4196645d-c0e3-4c8d-95bb-815d6b5e8b44 tempest-GroupsTest-1667041417 None] Update group completed successfully. Nov 03 07:42:52 devstack sudo[102295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:42:52 devstack sudo[102295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:52 devstack sudo[102295]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d33cb11f-cb77-4b51-b70b-b6aad0bc274b tempest-CinderUnicodeTest-805292985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.316s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:53 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-d33cb11f-cb77-4b51-b70b-b6aad0bc274b tempest-CinderUnicodeTest-805292985 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:42:53 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-d33cb11f-cb77-4b51-b70b-b6aad0bc274b tempest-CinderUnicodeTest-805292985 None] Deleted volume successfully. Nov 03 07:42:53 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d33cb11f-cb77-4b51-b70b-b6aad0bc274b tempest-CinderUnicodeTest-805292985 None] Lock "cinder-b4d65c82-7d3c-484d-8f29-df51412c8511-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:53 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:42:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] Flow 'volume_create_manager' (9807ab86-c1c6-4fe4-85fb-7e6ffb753c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:42:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bdb3a17-1e59-41ae-9a8f-b9bce5366805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bdb3a17-1e59-41ae-9a8f-b9bce5366805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:42:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86cade6b-c1bf-4804-81ea-bed3bae8b695,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09a4e11996da4c01b50eeabc83fe6700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:42:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:42:53Z,use_quota=True,user_id='a3ad3790bba64f0f9ba12514146d83dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8141698c-f6c9-42ff-b924-722a4a387d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8141698c-f6c9-42ff-b924-722a4a387d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (658d527f-da7a-4372-b82e-5c8e9a3255dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:53 devstack cinder-volume[86875]: DEBUG cinder.image.glance [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] Creating Keystone auth plugin from conf {{(pid=86875) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 07:42:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (658d527f-da7a-4372-b82e-5c8e9a3255dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '86cade6b-c1bf-4804-81ea-bed3bae8b695', 'volume_name': 'volume-86cade6b-c1bf-4804-81ea-bed3bae8b695', 'volume_size': 1, 'image_id': 'f38015ac-e943-474c-b4a3-0970a2c62b0a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f38015ac-e943-474c-b4a3-0970a2c62b0a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '09eea89d8bf80b29f6cdb610f5b9d387', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '09a4e11996da4c01b50eeabc83fe6700', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3ca7919f2929d16f64cc88d4a7ee3830d15c9897fbb2d89f973fcd9b4b31436e50af96f793a1cb898f191b7d316b1a3d1d76cd0f9c665311c643e710966d1ce0', 'id': 'f38015ac-e943-474c-b4a3-0970a2c62b0a', 'created_at': datetime.datetime(2026, 11, 3, 6, 42, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 42, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f38015ac-e943-474c-b4a3-0970a2c62b0a/file', 'properties': {}}, 'image_service': }' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2f6e83a-c9cf-4126-a47d-66f7a630fc62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2f6e83a-c9cf-4126-a47d-66f7a630fc62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ade930ee-f4a5-4ffa-bf45-6915b5c1598b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:53 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] Volume 86cade6b-c1bf-4804-81ea-bed3bae8b695: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-86cade6b-c1bf-4804-81ea-bed3bae8b695', 'volume_size': 1, 'image_id': 'f38015ac-e943-474c-b4a3-0970a2c62b0a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f38015ac-e943-474c-b4a3-0970a2c62b0a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '09eea89d8bf80b29f6cdb610f5b9d387', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '09a4e11996da4c01b50eeabc83fe6700', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3ca7919f2929d16f64cc88d4a7ee3830d15c9897fbb2d89f973fcd9b4b31436e50af96f793a1cb898f191b7d316b1a3d1d76cd0f9c665311c643e710966d1ce0', 'id': 'f38015ac-e943-474c-b4a3-0970a2c62b0a', 'created_at': datetime.datetime(2026, 11, 3, 6, 42, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 42, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f38015ac-e943-474c-b4a3-0970a2c62b0a/file', 'properties': {}}, 'image_service': } Nov 03 07:42:53 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] Trying to clone 86cade6b-c1bf-4804-81ea-bed3bae8b695 from image f38015ac-e943-474c-b4a3-0970a2c62b0a at location (None, [{'url': 'file:///opt/stack/data/glance/images/f38015ac-e943-474c-b4a3-0970a2c62b0a', 'metadata': {}}]). {{(pid=86875) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 07:42:53 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f38015ac-e943-474c-b4a3-0970a2c62b0a_mit8hs16devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86875) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 07:42:53 devstack cinder-volume[86875]: INFO cinder.image.image_utils [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] Image download 0.00 MB at 0.00 MB/s Nov 03 07:42:53 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-907531a2-6cd9-4a74-a591-50e5d90e9cd5 tempest-CinderUnicodeTest-805292985 None] Acquiring lock "cinder-3f0b1aeb-7b8d-4d8a-9760-d93f00463c43-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:53 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-907531a2-6cd9-4a74-a591-50e5d90e9cd5 tempest-CinderUnicodeTest-805292985 None] Lock "cinder-3f0b1aeb-7b8d-4d8a-9760-d93f00463c43-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:53 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-907531a2-6cd9-4a74-a591-50e5d90e9cd5 tempest-CinderUnicodeTest-805292985 None] Acquiring lock "cinder-quobyte-3f0b1aeb-7b8d-4d8a-9760-d93f00463c43" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:53 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[80468969-cbcf-4d50-8a54-cfa8722b4a5f]: (4, 'raw') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:42:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f38015ac-e943-474c-b4a3-0970a2c62b0a_mit8hs16devstack@QuobyteHD {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:53 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-907531a2-6cd9-4a74-a591-50e5d90e9cd5 tempest-CinderUnicodeTest-805292985 None] Lock "cinder-quobyte-3f0b1aeb-7b8d-4d8a-9760-d93f00463c43" acquired by "delete_volume" :: waited 0.042s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:53 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[5293310b-862f-4cec-b51b-27c30c92ca43]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:42:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-907531a2-6cd9-4a74-a591-50e5d90e9cd5 tempest-CinderUnicodeTest-805292985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3f0b1aeb-7b8d-4d8a-9760-d93f00463c43 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:53 devstack sudo[102306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f38015ac-e943-474c-b4a3-0970a2c62b0a_mit8hs16devstack@QuobyteHD Nov 03 07:42:53 devstack sudo[102306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:53 devstack sudo[102307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3f0b1aeb-7b8d-4d8a-9760-d93f00463c43 Nov 03 07:42:53 devstack sudo[102307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:54 devstack sudo[102306]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f38015ac-e943-474c-b4a3-0970a2c62b0a_mit8hs16devstack@QuobyteHD" returned: 0 in 0.449s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f38015ac-e943-474c-b4a3-0970a2c62b0a_mit8hs16devstack@QuobyteHD {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:54 devstack sudo[102312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f38015ac-e943-474c-b4a3-0970a2c62b0a_mit8hs16devstack@QuobyteHD Nov 03 07:42:54 devstack sudo[102312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:54 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-19b25531-0dab-4daa-ae39-06ffe27d9499 tempest-GroupsTest-1667041417 None] Update group completed successfully. Nov 03 07:42:54 devstack sudo[102307]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-907531a2-6cd9-4a74-a591-50e5d90e9cd5 tempest-CinderUnicodeTest-805292985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3f0b1aeb-7b8d-4d8a-9760-d93f00463c43" returned: 0 in 0.625s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-907531a2-6cd9-4a74-a591-50e5d90e9cd5 tempest-CinderUnicodeTest-805292985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3f0b1aeb-7b8d-4d8a-9760-d93f00463c43 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:54 devstack sudo[102318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3f0b1aeb-7b8d-4d8a-9760-d93f00463c43 Nov 03 07:42:54 devstack sudo[102318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:54 devstack sudo[102312]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f38015ac-e943-474c-b4a3-0970a2c62b0a_mit8hs16devstack@QuobyteHD" returned: 1 in 0.449s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f38015ac-e943-474c-b4a3-0970a2c62b0a_mit8hs16devstack@QuobyteHD' failed. Not Retrying. {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:42:54 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] Temporary image f38015ac-e943-474c-b4a3-0970a2c62b0a is fetched for user a3ad3790bba64f0f9ba12514146d83dd. {{(pid=86875) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 07:42:54 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[748d7ade-a606-4b31-bf1f-1484327c6fe2]: (4, 'raw') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:42:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f38015ac-e943-474c-b4a3-0970a2c62b0a_mit8hs16devstack@QuobyteHD {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:54 devstack sudo[102318]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-907531a2-6cd9-4a74-a591-50e5d90e9cd5 tempest-CinderUnicodeTest-805292985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3f0b1aeb-7b8d-4d8a-9760-d93f00463c43" returned: 0 in 0.316s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:54 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-907531a2-6cd9-4a74-a591-50e5d90e9cd5 tempest-CinderUnicodeTest-805292985 None] Lock "cinder-quobyte-3f0b1aeb-7b8d-4d8a-9760-d93f00463c43" released by "delete_volume" :: held 1.010s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:54 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-907531a2-6cd9-4a74-a591-50e5d90e9cd5 tempest-CinderUnicodeTest-805292985 None] Created reservations ['f5fff3ec-771f-4c8f-923d-65cbf9bc7640', '83637990-834c-47d1-b8ba-82a46dc2a9ad', 'f2280681-e52d-46f7-ae90-6ea7e2ef31b4', '839f31bb-4ea4-4b6f-a559-fc9ecf1dcb41'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:42:54 devstack sudo[102324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f38015ac-e943-474c-b4a3-0970a2c62b0a_mit8hs16devstack@QuobyteHD Nov 03 07:42:54 devstack sudo[102324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-907531a2-6cd9-4a74-a591-50e5d90e9cd5 tempest-CinderUnicodeTest-805292985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-907531a2-6cd9-4a74-a591-50e5d90e9cd5 tempest-CinderUnicodeTest-805292985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:54 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-907531a2-6cd9-4a74-a591-50e5d90e9cd5 tempest-CinderUnicodeTest-805292985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:42:54 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-907531a2-6cd9-4a74-a591-50e5d90e9cd5 tempest-CinderUnicodeTest-805292985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:42:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-907531a2-6cd9-4a74-a591-50e5d90e9cd5 tempest-CinderUnicodeTest-805292985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-907531a2-6cd9-4a74-a591-50e5d90e9cd5 tempest-CinderUnicodeTest-805292985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:54 devstack sudo[102326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:42:54 devstack sudo[102326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:55 devstack sudo[102324]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f38015ac-e943-474c-b4a3-0970a2c62b0a_mit8hs16devstack@QuobyteHD" returned: 0 in 0.386s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f38015ac-e943-474c-b4a3-0970a2c62b0a_mit8hs16devstack@QuobyteHD {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:55 devstack sudo[102330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f38015ac-e943-474c-b4a3-0970a2c62b0a_mit8hs16devstack@QuobyteHD Nov 03 07:42:55 devstack sudo[102330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:55 devstack sudo[102326]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-907531a2-6cd9-4a74-a591-50e5d90e9cd5 tempest-CinderUnicodeTest-805292985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.310s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:55 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-907531a2-6cd9-4a74-a591-50e5d90e9cd5 tempest-CinderUnicodeTest-805292985 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:42:55 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-907531a2-6cd9-4a74-a591-50e5d90e9cd5 tempest-CinderUnicodeTest-805292985 None] Deleted volume successfully. Nov 03 07:42:55 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-907531a2-6cd9-4a74-a591-50e5d90e9cd5 tempest-CinderUnicodeTest-805292985 None] Lock "cinder-3f0b1aeb-7b8d-4d8a-9760-d93f00463c43-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:55 devstack sudo[102330]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f38015ac-e943-474c-b4a3-0970a2c62b0a_mit8hs16devstack@QuobyteHD" returned: 1 in 0.412s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f38015ac-e943-474c-b4a3-0970a2c62b0a_mit8hs16devstack@QuobyteHD' failed. Not Retrying. {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:42:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:55 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:42:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86cade6b-c1bf-4804-81ea-bed3bae8b695,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09a4e11996da4c01b50eeabc83fe6700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:42:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:42:53Z,use_quota=True,user_id='a3ad3790bba64f0f9ba12514146d83dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:42:55 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] Creating volume 86cade6b-c1bf-4804-81ea-bed3bae8b695 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:42:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:55 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:42:55 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:42:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:55 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:42:55 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:42:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-86cade6b-c1bf-4804-81ea-bed3bae8b695 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:55 devstack sudo[102336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-86cade6b-c1bf-4804-81ea-bed3bae8b695 1073741824 Nov 03 07:42:55 devstack sudo[102336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:56 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-02b08e84-9a52-444c-9f57-316accc3af76 tempest-GroupsTest-1667041417 None] Acquiring lock "cinder-quobyte-150bc743-36c0-43e4-9098-bcd893214fa0" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:56 devstack sudo[102336]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-86cade6b-c1bf-4804-81ea-bed3bae8b695 1073741824" returned: 0 in 0.652s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:56 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-02b08e84-9a52-444c-9f57-316accc3af76 tempest-GroupsTest-1667041417 None] Lock "cinder-quobyte-150bc743-36c0-43e4-9098-bcd893214fa0" acquired by "delete_volume" :: waited 0.071s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:56 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a8538a-8683-43f4-a79e-f50f4ac7024a]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:42:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-02b08e84-9a52-444c-9f57-316accc3af76 tempest-GroupsTest-1667041417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-150bc743-36c0-43e4-9098-bcd893214fa0 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-86cade6b-c1bf-4804-81ea-bed3bae8b695 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:56 devstack sudo[102343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-86cade6b-c1bf-4804-81ea-bed3bae8b695 Nov 03 07:42:56 devstack sudo[102343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:56 devstack sudo[102342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-150bc743-36c0-43e4-9098-bcd893214fa0 Nov 03 07:42:56 devstack sudo[102342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:56 devstack sudo[102343]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-86cade6b-c1bf-4804-81ea-bed3bae8b695" returned: 0 in 0.429s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:56 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] <== create_volume: return (1229ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:42:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.232s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:56 devstack cinder-volume[86875]: DEBUG cinder.volume.volume_utils [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] Attempting download of f38015ac-e943-474c-b4a3-0970a2c62b0a ((None, [{'url': 'file:///opt/stack/data/glance/images/f38015ac-e943-474c-b4a3-0970a2c62b0a', 'metadata': {}}])) to volume 86cade6b-c1bf-4804-81ea-bed3bae8b695. {{(pid=86875) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 07:42:56 devstack sudo[102342]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-02b08e84-9a52-444c-9f57-316accc3af76 tempest-GroupsTest-1667041417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-150bc743-36c0-43e4-9098-bcd893214fa0" returned: 0 in 0.509s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-02b08e84-9a52-444c-9f57-316accc3af76 tempest-GroupsTest-1667041417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-150bc743-36c0-43e4-9098-bcd893214fa0 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:56 devstack sudo[102350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-150bc743-36c0-43e4-9098-bcd893214fa0 Nov 03 07:42:56 devstack sudo[102350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:56 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da3cb12-8631-4862-9237-4df1a95993d2]: (4, 'raw') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:42:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f38015ac-e943-474c-b4a3-0970a2c62b0a_t0xn3gyh {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:57 devstack sudo[102352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f38015ac-e943-474c-b4a3-0970a2c62b0a_t0xn3gyh Nov 03 07:42:57 devstack sudo[102352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:57 devstack sudo[102350]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-02b08e84-9a52-444c-9f57-316accc3af76 tempest-GroupsTest-1667041417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-150bc743-36c0-43e4-9098-bcd893214fa0" returned: 0 in 0.377s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:57 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-02b08e84-9a52-444c-9f57-316accc3af76 tempest-GroupsTest-1667041417 None] Lock "cinder-quobyte-150bc743-36c0-43e4-9098-bcd893214fa0" released by "delete_volume" :: held 0.972s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:57 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-02b08e84-9a52-444c-9f57-316accc3af76 tempest-GroupsTest-1667041417 None] Acquiring lock "cinder-quobyte-9d9de56a-2abe-4f7b-9fa0-e3a429e0bc86" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:57 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-02b08e84-9a52-444c-9f57-316accc3af76 tempest-GroupsTest-1667041417 None] Lock "cinder-quobyte-9d9de56a-2abe-4f7b-9fa0-e3a429e0bc86" acquired by "delete_volume" :: waited 0.024s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:57 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[676e9ba9-ac1e-4adf-bd09-84ce0208538d]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:42:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-02b08e84-9a52-444c-9f57-316accc3af76 tempest-GroupsTest-1667041417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9d9de56a-2abe-4f7b-9fa0-e3a429e0bc86 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:57 devstack sudo[102355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9d9de56a-2abe-4f7b-9fa0-e3a429e0bc86 Nov 03 07:42:57 devstack sudo[102355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:57 devstack sudo[102352]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f38015ac-e943-474c-b4a3-0970a2c62b0a_t0xn3gyh" returned: 0 in 0.629s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f38015ac-e943-474c-b4a3-0970a2c62b0a_t0xn3gyh {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:57 devstack sudo[102359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f38015ac-e943-474c-b4a3-0970a2c62b0a_t0xn3gyh Nov 03 07:42:57 devstack sudo[102359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:57 devstack sudo[102355]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-02b08e84-9a52-444c-9f57-316accc3af76 tempest-GroupsTest-1667041417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9d9de56a-2abe-4f7b-9fa0-e3a429e0bc86" returned: 0 in 0.593s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-02b08e84-9a52-444c-9f57-316accc3af76 tempest-GroupsTest-1667041417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9d9de56a-2abe-4f7b-9fa0-e3a429e0bc86 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:57 devstack sudo[102367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9d9de56a-2abe-4f7b-9fa0-e3a429e0bc86 Nov 03 07:42:57 devstack sudo[102367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:57 devstack sudo[102359]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f38015ac-e943-474c-b4a3-0970a2c62b0a_t0xn3gyh" returned: 1 in 0.414s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f38015ac-e943-474c-b4a3-0970a2c62b0a_t0xn3gyh' failed. Not Retrying. {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:42:57 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[6475ed24-c539-407b-b121-b7beb1546b90]: (4, 'raw') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:42:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f38015ac-e943-474c-b4a3-0970a2c62b0a_mit8hs16devstack@QuobyteHD {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:58 devstack sudo[102369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f38015ac-e943-474c-b4a3-0970a2c62b0a_mit8hs16devstack@QuobyteHD Nov 03 07:42:58 devstack sudo[102369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:58 devstack sudo[102367]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-02b08e84-9a52-444c-9f57-316accc3af76 tempest-GroupsTest-1667041417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9d9de56a-2abe-4f7b-9fa0-e3a429e0bc86" returned: 0 in 0.460s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:58 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-02b08e84-9a52-444c-9f57-316accc3af76 tempest-GroupsTest-1667041417 None] Lock "cinder-quobyte-9d9de56a-2abe-4f7b-9fa0-e3a429e0bc86" released by "delete_volume" :: held 1.131s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:42:58 devstack sudo[102369]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f38015ac-e943-474c-b4a3-0970a2c62b0a_mit8hs16devstack@QuobyteHD" returned: 0 in 0.506s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f38015ac-e943-474c-b4a3-0970a2c62b0a_mit8hs16devstack@QuobyteHD {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:58 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-02b08e84-9a52-444c-9f57-316accc3af76 tempest-GroupsTest-1667041417 None] Created reservations ['b3240a98-2db5-42fb-bbc5-ffca41fac95a'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:42:58 devstack cinder-volume[86875]: WARNING cinder.quota [None req-02b08e84-9a52-444c-9f57-316accc3af76 tempest-GroupsTest-1667041417 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1794949235 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1794949235, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:42:58 devstack cinder-volume[86875]: WARNING cinder.quota [None req-02b08e84-9a52-444c-9f57-316accc3af76 tempest-GroupsTest-1667041417 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1794949235 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1794949235, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:42:58 devstack sudo[102374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f38015ac-e943-474c-b4a3-0970a2c62b0a_mit8hs16devstack@QuobyteHD Nov 03 07:42:58 devstack sudo[102374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:58 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-02b08e84-9a52-444c-9f57-316accc3af76 tempest-GroupsTest-1667041417 None] Created reservations ['146d17fd-e62c-477e-954c-4e0cb530c8ad', '7dbc8928-b570-4554-ae9e-4ac986a5fa8d', 'dff7092a-a771-4b21-804e-45e3954f0ecf', 'f8a84d36-502b-42f2-be53-66e2a21503f0'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:42:58 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd115825-2c58-4b8d-a31d-9b018c658da5 tempest-TestStampPattern-389950066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:42:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fd115825-2c58-4b8d-a31d-9b018c658da5 tempest-TestStampPattern-389950066 None] Flow 'volume_create_manager' (a0f46a42-ebe6-4daf-a9ce-faa5acf3bc72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:42:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fd115825-2c58-4b8d-a31d-9b018c658da5 tempest-TestStampPattern-389950066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c60a5910-49ed-413a-9972-04a1b928c11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fd115825-2c58-4b8d-a31d-9b018c658da5 tempest-TestStampPattern-389950066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c60a5910-49ed-413a-9972-04a1b928c11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:42:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-115177188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d84b5fe-6751-49e5-aa4f-da1792293ad1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5955babb10394b628242793a9e918848',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:42:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c0a8a75f-a530-446b-9813-62cc8183dafe,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:42:59Z,use_quota=True,user_id='8a04ead9cb7f4d189c52bb02fa81fa14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fd115825-2c58-4b8d-a31d-9b018c658da5 tempest-TestStampPattern-389950066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67d41c7b-2bb7-4784-860c-f41107aed831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fd115825-2c58-4b8d-a31d-9b018c658da5 tempest-TestStampPattern-389950066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67d41c7b-2bb7-4784-860c-f41107aed831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fd115825-2c58-4b8d-a31d-9b018c658da5 tempest-TestStampPattern-389950066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c432088-e392-4868-83b1-075dffce899e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fd115825-2c58-4b8d-a31d-9b018c658da5 tempest-TestStampPattern-389950066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c432088-e392-4868-83b1-075dffce899e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8d84b5fe-6751-49e5-aa4f-da1792293ad1', 'volume_name': 'volume-8d84b5fe-6751-49e5-aa4f-da1792293ad1', 'volume_size': 1, 'snapshot_id': 'c0a8a75f-a530-446b-9813-62cc8183dafe'}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fd115825-2c58-4b8d-a31d-9b018c658da5 tempest-TestStampPattern-389950066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d01924be-be01-402b-88cb-92dd85b733c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fd115825-2c58-4b8d-a31d-9b018c658da5 tempest-TestStampPattern-389950066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d01924be-be01-402b-88cb-92dd85b733c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:42:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fd115825-2c58-4b8d-a31d-9b018c658da5 tempest-TestStampPattern-389950066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be8ecd43-d7ae-44d3-a049-ad3cd547bdfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:42:58 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-fd115825-2c58-4b8d-a31d-9b018c658da5 tempest-TestStampPattern-389950066 None] Volume 8d84b5fe-6751-49e5-aa4f-da1792293ad1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8d84b5fe-6751-49e5-aa4f-da1792293ad1', 'volume_size': 1, 'snapshot_id': 'c0a8a75f-a530-446b-9813-62cc8183dafe'} Nov 03 07:42:58 devstack sudo[102374]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-fd115825-2c58-4b8d-a31d-9b018c658da5 tempest-TestStampPattern-389950066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-fd115825-2c58-4b8d-a31d-9b018c658da5 tempest-TestStampPattern-389950066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:58 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-fd115825-2c58-4b8d-a31d-9b018c658da5 tempest-TestStampPattern-389950066 None] Acquiring lock "cinder-quobyte-c0a8a75f-a530-446b-9813-62cc8183dafe-8d84b5fe-6751-49e5-aa4f-da1792293ad1" by "_create_volume_from_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f38015ac-e943-474c-b4a3-0970a2c62b0a_mit8hs16devstack@QuobyteHD" returned: 1 in 0.460s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f38015ac-e943-474c-b4a3-0970a2c62b0a_mit8hs16devstack@QuobyteHD' failed. Not Retrying. {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:42:58 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] f38015ac-e943-474c-b4a3-0970a2c62b0a was raw, converting to qcow2 {{(pid=86875) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 07:42:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f38015ac-e943-474c-b4a3-0970a2c62b0a_mit8hs16devstack@QuobyteHD /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-86cade6b-c1bf-4804-81ea-bed3bae8b695 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:58 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-fd115825-2c58-4b8d-a31d-9b018c658da5 tempest-TestStampPattern-389950066 None] Lock "cinder-quobyte-c0a8a75f-a530-446b-9813-62cc8183dafe-8d84b5fe-6751-49e5-aa4f-da1792293ad1" acquired by "_create_volume_from_snapshot" :: waited 0.074s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:58 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-fd115825-2c58-4b8d-a31d-9b018c658da5 tempest-TestStampPattern-389950066 None] Creating volume 8d84b5fe-6751-49e5-aa4f-da1792293ad1 from snapshot c0a8a75f-a530-446b-9813-62cc8183dafe {{(pid=86875) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 07:42:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-fd115825-2c58-4b8d-a31d-9b018c658da5 tempest-TestStampPattern-389950066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-fd115825-2c58-4b8d-a31d-9b018c658da5 tempest-TestStampPattern-389950066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:58 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-fd115825-2c58-4b8d-a31d-9b018c658da5 tempest-TestStampPattern-389950066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:42:58 devstack sudo[102379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f38015ac-e943-474c-b4a3-0970a2c62b0a_mit8hs16devstack@QuobyteHD /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-86cade6b-c1bf-4804-81ea-bed3bae8b695 Nov 03 07:42:58 devstack sudo[102379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:58 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-fd115825-2c58-4b8d-a31d-9b018c658da5 tempest-TestStampPattern-389950066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:42:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-fd115825-2c58-4b8d-a31d-9b018c658da5 tempest-TestStampPattern-389950066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:58 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-fd115825-2c58-4b8d-a31d-9b018c658da5 tempest-TestStampPattern-389950066 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:42:58 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-fd115825-2c58-4b8d-a31d-9b018c658da5 tempest-TestStampPattern-389950066 None] Acquiring lock "cinder-quobyte-8d84b5fe-6751-49e5-aa4f-da1792293ad1" by "_copy_volume_from_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:42:59 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-fd115825-2c58-4b8d-a31d-9b018c658da5 tempest-TestStampPattern-389950066 None] Lock "cinder-quobyte-8d84b5fe-6751-49e5-aa4f-da1792293ad1" acquired by "_copy_volume_from_snapshot" :: waited 0.045s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:42:59 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-fd115825-2c58-4b8d-a31d-9b018c658da5 tempest-TestStampPattern-389950066 None] snapshot: c0a8a75f-a530-446b-9813-62cc8183dafe, volume: 8d84b5fe-6751-49e5-aa4f-da1792293ad1, {{(pid=86875) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 07:42:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-fd115825-2c58-4b8d-a31d-9b018c658da5 tempest-TestStampPattern-389950066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-fd115825-2c58-4b8d-a31d-9b018c658da5 tempest-TestStampPattern-389950066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:59 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-fd115825-2c58-4b8d-a31d-9b018c658da5 tempest-TestStampPattern-389950066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:42:59 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-fd115825-2c58-4b8d-a31d-9b018c658da5 tempest-TestStampPattern-389950066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:42:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-fd115825-2c58-4b8d-a31d-9b018c658da5 tempest-TestStampPattern-389950066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:59 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae315414-1c48-41d4-bdbb-0e20cf58730f]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:42:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fd115825-2c58-4b8d-a31d-9b018c658da5 tempest-TestStampPattern-389950066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771.c0a8a75f-a530-446b-9813-62cc8183dafe {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:59 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-02b08e84-9a52-444c-9f57-316accc3af76 tempest-GroupsTest-1667041417 None] Created reservations ['1f883312-1917-4e6e-8578-70522e5ee255', '9eef8bde-ea62-4ed2-86ff-761f8a7f4322', 'bc5329a4-8b46-4451-925c-abe230d6128e', 'd3aa2f8e-1e9d-4029-86cb-66251580176a'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:42:59 devstack sudo[102381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771.c0a8a75f-a530-446b-9813-62cc8183dafe Nov 03 07:42:59 devstack sudo[102381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-02b08e84-9a52-444c-9f57-316accc3af76 tempest-GroupsTest-1667041417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:42:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-02b08e84-9a52-444c-9f57-316accc3af76 tempest-GroupsTest-1667041417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:42:59 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-02b08e84-9a52-444c-9f57-316accc3af76 tempest-GroupsTest-1667041417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:42:59 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-02b08e84-9a52-444c-9f57-316accc3af76 tempest-GroupsTest-1667041417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:42:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-02b08e84-9a52-444c-9f57-316accc3af76 tempest-GroupsTest-1667041417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:42:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-02b08e84-9a52-444c-9f57-316accc3af76 tempest-GroupsTest-1667041417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:59 devstack sudo[102386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:42:59 devstack sudo[102386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:59 devstack sudo[102379]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f38015ac-e943-474c-b4a3-0970a2c62b0a_mit8hs16devstack@QuobyteHD /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-86cade6b-c1bf-4804-81ea-bed3bae8b695" returned: 0 in 0.844s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:59 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f38015ac-e943-474c-b4a3-0970a2c62b0a_mit8hs16devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-86cade6b-c1bf-4804-81ea-bed3bae8b695 {{(pid=86875) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:42:59 devstack cinder-volume[86875]: INFO cinder.image.image_utils [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] Converted 0.00 MB image at 0.00 MB/s Nov 03 07:42:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-86cade6b-c1bf-4804-81ea-bed3bae8b695 1G {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:42:59 devstack sudo[102392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-86cade6b-c1bf-4804-81ea-bed3bae8b695 1G Nov 03 07:42:59 devstack sudo[102392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:42:59 devstack sudo[102381]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fd115825-2c58-4b8d-a31d-9b018c658da5 tempest-TestStampPattern-389950066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771.c0a8a75f-a530-446b-9813-62cc8183dafe" returned: 0 in 0.702s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:59 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-fd115825-2c58-4b8d-a31d-9b018c658da5 tempest-TestStampPattern-389950066 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:42:59 devstack sudo[102386]: pam_unix(sudo:session): session closed for user root Nov 03 07:42:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-02b08e84-9a52-444c-9f57-316accc3af76 tempest-GroupsTest-1667041417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.398s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:42:59 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-02b08e84-9a52-444c-9f57-316accc3af76 tempest-GroupsTest-1667041417 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:42:59 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-02b08e84-9a52-444c-9f57-316accc3af76 tempest-GroupsTest-1667041417 None] Delete group completed successfully. Nov 03 07:42:59 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[526c8e10-bd4c-459b-b6bc-8b47be02e047]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:42:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fd115825-2c58-4b8d-a31d-9b018c658da5 tempest-TestStampPattern-389950066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:00 devstack sudo[102395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771 Nov 03 07:43:00 devstack sudo[102395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:00 devstack sudo[102392]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-86cade6b-c1bf-4804-81ea-bed3bae8b695 1G" returned: 0 in 0.514s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:00 devstack cinder-volume[86875]: DEBUG cinder.volume.volume_utils [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] Downloaded image f38015ac-e943-474c-b4a3-0970a2c62b0a ((None, [{'url': 'file:///opt/stack/data/glance/images/f38015ac-e943-474c-b4a3-0970a2c62b0a', 'metadata': {}}])) to volume 86cade6b-c1bf-4804-81ea-bed3bae8b695 successfully. {{(pid=86875) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 07:43:00 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] Temporary image f38015ac-e943-474c-b4a3-0970a2c62b0a for user a3ad3790bba64f0f9ba12514146d83dd is deleted. {{(pid=86875) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 07:43:00 devstack cinder-volume[86875]: DEBUG cinder.volume.volume_utils [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] Marking volume 86cade6b-c1bf-4804-81ea-bed3bae8b695 as bootable. {{(pid=86875) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 07:43:00 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] Copying metadata from image f38015ac-e943-474c-b4a3-0970a2c62b0a to 86cade6b-c1bf-4804-81ea-bed3bae8b695. {{(pid=86875) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 07:43:00 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] Creating volume glance metadata for volume 86cade6b-c1bf-4804-81ea-bed3bae8b695 backed by image f38015ac-e943-474c-b4a3-0970a2c62b0a with: {'image_id': 'f38015ac-e943-474c-b4a3-0970a2c62b0a', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '09eea89d8bf80b29f6cdb610f5b9d387', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86875) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 07:43:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ade930ee-f4a5-4ffa-bf45-6915b5c1598b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86cade6b-c1bf-4804-81ea-bed3bae8b695', 'volume_size': 1, 'image_id': 'f38015ac-e943-474c-b4a3-0970a2c62b0a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f38015ac-e943-474c-b4a3-0970a2c62b0a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '09eea89d8bf80b29f6cdb610f5b9d387', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '09a4e11996da4c01b50eeabc83fe6700', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3ca7919f2929d16f64cc88d4a7ee3830d15c9897fbb2d89f973fcd9b4b31436e50af96f793a1cb898f191b7d316b1a3d1d76cd0f9c665311c643e710966d1ce0', 'id': 'f38015ac-e943-474c-b4a3-0970a2c62b0a', 'created_at': datetime.datetime(2026, 11, 3, 6, 42, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 42, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f38015ac-e943-474c-b4a3-0970a2c62b0a/file', 'properties': {}}, 'image_service': }' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:43:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54b135fe-2be2-4f1b-a5a6-9583aa21d750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:43:00 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] Volume volume-86cade6b-c1bf-4804-81ea-bed3bae8b695 (86cade6b-c1bf-4804-81ea-bed3bae8b695): created successfully Nov 03 07:43:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54b135fe-2be2-4f1b-a5a6-9583aa21d750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:43:00 devstack sudo[102395]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] Flow 'volume_create_manager' (9807ab86-c1c6-4fe4-85fb-7e6ffb753c9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:43:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fd115825-2c58-4b8d-a31d-9b018c658da5 tempest-TestStampPattern-389950066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771" returned: 0 in 0.643s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:00 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-fd115825-2c58-4b8d-a31d-9b018c658da5 tempest-TestStampPattern-389950066 None] will copy from snapshot at /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771 {{(pid=86875) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 07:43:00 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-fd115825-2c58-4b8d-a31d-9b018c658da5 tempest-TestStampPattern-389950066 None] Creating direct copy from snapshot {{(pid=86875) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 07:43:00 devstack cinder-volume[86875]: DEBUG cinder.utils [None req-fd115825-2c58-4b8d-a31d-9b018c658da5 tempest-TestStampPattern-389950066 None] Path /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d84b5fe-6751-49e5-aa4f-da1792293ad1 not found in is_blk_device check {{(pid=86875) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 07:43:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fd115825-2c58-4b8d-a31d-9b018c658da5 tempest-TestStampPattern-389950066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d84b5fe-6751-49e5-aa4f-da1792293ad1 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:00 devstack sudo[102406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d84b5fe-6751-49e5-aa4f-da1792293ad1 Nov 03 07:43:00 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-1083d861-e448-4a61-bded-b6355c04d51d tempest-VolumeImageDependencyTests-113646136 None] Created volume successfully. Nov 03 07:43:00 devstack sudo[102406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:01 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-c5d71270-eb7a-486c-80e9-6104f212d1b9 tempest-VolumeImageDependencyTests-113646136 None] Acquiring lock "cinder-86cade6b-c1bf-4804-81ea-bed3bae8b695-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:43:01 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-c5d71270-eb7a-486c-80e9-6104f212d1b9 tempest-VolumeImageDependencyTests-113646136 None] Lock "cinder-86cade6b-c1bf-4804-81ea-bed3bae8b695-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:43:01 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-c5d71270-eb7a-486c-80e9-6104f212d1b9 tempest-VolumeImageDependencyTests-113646136 None] Acquiring lock "cinder-quobyte-86cade6b-c1bf-4804-81ea-bed3bae8b695" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:43:01 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-c5d71270-eb7a-486c-80e9-6104f212d1b9 tempest-VolumeImageDependencyTests-113646136 None] Lock "cinder-quobyte-86cade6b-c1bf-4804-81ea-bed3bae8b695" acquired by "delete_volume" :: waited 0.026s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:43:01 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[590dca72-78bf-413b-83ed-652b47d22241]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:43:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c5d71270-eb7a-486c-80e9-6104f212d1b9 tempest-VolumeImageDependencyTests-113646136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-86cade6b-c1bf-4804-81ea-bed3bae8b695 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:01 devstack sudo[102412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-86cade6b-c1bf-4804-81ea-bed3bae8b695 Nov 03 07:43:01 devstack sudo[102412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:02 devstack sudo[102412]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c5d71270-eb7a-486c-80e9-6104f212d1b9 tempest-VolumeImageDependencyTests-113646136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-86cade6b-c1bf-4804-81ea-bed3bae8b695" returned: 0 in 0.949s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c5d71270-eb7a-486c-80e9-6104f212d1b9 tempest-VolumeImageDependencyTests-113646136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-86cade6b-c1bf-4804-81ea-bed3bae8b695 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:02 devstack sudo[102424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-86cade6b-c1bf-4804-81ea-bed3bae8b695 Nov 03 07:43:02 devstack sudo[102424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:03 devstack sudo[102424]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c5d71270-eb7a-486c-80e9-6104f212d1b9 tempest-VolumeImageDependencyTests-113646136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-86cade6b-c1bf-4804-81ea-bed3bae8b695" returned: 0 in 0.862s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:03 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-c5d71270-eb7a-486c-80e9-6104f212d1b9 tempest-VolumeImageDependencyTests-113646136 None] Lock "cinder-quobyte-86cade6b-c1bf-4804-81ea-bed3bae8b695" released by "delete_volume" :: held 1.913s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:43:03 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-c5d71270-eb7a-486c-80e9-6104f212d1b9 tempest-VolumeImageDependencyTests-113646136 None] Created reservations ['9c73057c-4f94-41cb-8026-29015d433aff', '68f2ffef-554d-4858-83c7-87146d1b18ec', 'b24c3a34-d859-4060-a56b-347b4649a75e', '20805118-a324-4f63-bf04-f48663405fe2'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:43:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-c5d71270-eb7a-486c-80e9-6104f212d1b9 tempest-VolumeImageDependencyTests-113646136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:43:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-c5d71270-eb7a-486c-80e9-6104f212d1b9 tempest-VolumeImageDependencyTests-113646136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:43:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-c5d71270-eb7a-486c-80e9-6104f212d1b9 tempest-VolumeImageDependencyTests-113646136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:43:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-c5d71270-eb7a-486c-80e9-6104f212d1b9 tempest-VolumeImageDependencyTests-113646136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:43:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-c5d71270-eb7a-486c-80e9-6104f212d1b9 tempest-VolumeImageDependencyTests-113646136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:43:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c5d71270-eb7a-486c-80e9-6104f212d1b9 tempest-VolumeImageDependencyTests-113646136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:03 devstack cinder-volume[86875]: DEBUG oslo_service.periodic_task [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86875) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:43:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:43:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:43:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:43:03 devstack sudo[102427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:43:03 devstack sudo[102427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:43:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:43:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:03 devstack sudo[102429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:43:03 devstack sudo[102429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:04 devstack sudo[102429]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.555s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:04 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:43:04 devstack cinder-volume[86875]: DEBUG oslo_service.periodic_task [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running periodic task VolumeManager._thread_info {{(pid=86875) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:43:04 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] thread count: 28 {{(pid=86875) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:43:04 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] thread info: [<_MainThread(MainThread, started 125626325639296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86875) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:43:04 devstack sudo[102427]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c5d71270-eb7a-486c-80e9-6104f212d1b9 tempest-VolumeImageDependencyTests-113646136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 1.315s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:04 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-c5d71270-eb7a-486c-80e9-6104f212d1b9 tempest-VolumeImageDependencyTests-113646136 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:43:04 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-c5d71270-eb7a-486c-80e9-6104f212d1b9 tempest-VolumeImageDependencyTests-113646136 None] Deleted volume successfully. Nov 03 07:43:05 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-c5d71270-eb7a-486c-80e9-6104f212d1b9 tempest-VolumeImageDependencyTests-113646136 None] Lock "cinder-86cade6b-c1bf-4804-81ea-bed3bae8b695-delete_volume" released by "delete_volume" :: held 3.922s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:43:12 devstack sudo[102406]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:12 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fd115825-2c58-4b8d-a31d-9b018c658da5 tempest-TestStampPattern-389950066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d84b5fe-6751-49e5-aa4f-da1792293ad1" returned: 0 in 11.938s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:12 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-fd115825-2c58-4b8d-a31d-9b018c658da5 tempest-TestStampPattern-389950066 None] Image conversion details: src /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771, size 1024.00 MB, duration 11.94 sec, destination /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d84b5fe-6751-49e5-aa4f-da1792293ad1 {{(pid=86875) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:43:12 devstack cinder-volume[86875]: INFO cinder.image.image_utils [None req-fd115825-2c58-4b8d-a31d-9b018c658da5 tempest-TestStampPattern-389950066 None] Converted 1024.00 MB image at 85.77 MB/s Nov 03 07:43:12 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-fd115825-2c58-4b8d-a31d-9b018c658da5 tempest-TestStampPattern-389950066 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d84b5fe-6751-49e5-aa4f-da1792293ad1 is being set with open permissions: ugo+rw Nov 03 07:43:12 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fd115825-2c58-4b8d-a31d-9b018c658da5 tempest-TestStampPattern-389950066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d84b5fe-6751-49e5-aa4f-da1792293ad1 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:12 devstack sudo[102461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d84b5fe-6751-49e5-aa4f-da1792293ad1 Nov 03 07:43:12 devstack sudo[102461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:13 devstack sudo[102461]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fd115825-2c58-4b8d-a31d-9b018c658da5 tempest-TestStampPattern-389950066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d84b5fe-6751-49e5-aa4f-da1792293ad1" returned: 0 in 0.576s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:13 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-fd115825-2c58-4b8d-a31d-9b018c658da5 tempest-TestStampPattern-389950066 None] Lock "cinder-quobyte-8d84b5fe-6751-49e5-aa4f-da1792293ad1" released by "_copy_volume_from_snapshot" :: held 14.053s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:43:13 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-fd115825-2c58-4b8d-a31d-9b018c658da5 tempest-TestStampPattern-389950066 None] Lock "cinder-quobyte-c0a8a75f-a530-446b-9813-62cc8183dafe-8d84b5fe-6751-49e5-aa4f-da1792293ad1" released by "_create_volume_from_snapshot" :: held 14.178s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:43:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-fd115825-2c58-4b8d-a31d-9b018c658da5 tempest-TestStampPattern-389950066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.256s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:43:13 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fd115825-2c58-4b8d-a31d-9b018c658da5 tempest-TestStampPattern-389950066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be8ecd43-d7ae-44d3-a049-ad3cd547bdfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d84b5fe-6751-49e5-aa4f-da1792293ad1', 'volume_size': 1, 'snapshot_id': 'c0a8a75f-a530-446b-9813-62cc8183dafe'}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:43:13 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fd115825-2c58-4b8d-a31d-9b018c658da5 tempest-TestStampPattern-389950066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88453738-2616-44bc-b22a-ecee1e2a7bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:43:13 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-fd115825-2c58-4b8d-a31d-9b018c658da5 tempest-TestStampPattern-389950066 None] Volume volume-8d84b5fe-6751-49e5-aa4f-da1792293ad1 (8d84b5fe-6751-49e5-aa4f-da1792293ad1): created successfully Nov 03 07:43:13 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fd115825-2c58-4b8d-a31d-9b018c658da5 tempest-TestStampPattern-389950066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88453738-2616-44bc-b22a-ecee1e2a7bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:43:13 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fd115825-2c58-4b8d-a31d-9b018c658da5 tempest-TestStampPattern-389950066 None] Flow 'volume_create_manager' (a0f46a42-ebe6-4daf-a9ce-faa5acf3bc72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:43:13 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-fd115825-2c58-4b8d-a31d-9b018c658da5 tempest-TestStampPattern-389950066 None] Created volume successfully. Nov 03 07:43:19 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-a318ee17-34fd-4552-acb0-007ec0e46b4c tempest-GroupsV320Test-1046611922 None] Group tempest-GroupsV320Test-Group-676854195: creating Nov 03 07:43:19 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-a318ee17-34fd-4552-acb0-007ec0e46b4c tempest-GroupsV320Test-1046611922 None] Group tempest-GroupsV320Test-Group-676854195: created successfully Nov 03 07:43:19 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-a318ee17-34fd-4552-acb0-007ec0e46b4c tempest-GroupsV320Test-1046611922 None] Create group completed successfully. Nov 03 07:43:21 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:SELECT=161,cinder:UPDATE=166,cinder:DELETE=14,cinder:INSERT=48 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:43:21 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:UPDATE=181,cinder:INSERT=39,cinder:SELECT=131,cinder:DELETE=11 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:43:21 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-89c02e34-6dc3-422d-b4c4-13be6291da71 tempest-GroupsV320Test-1046611922 None] Created reservations ['de0f9cae-f9c0-4d7d-8ceb-3b04acf21dfe'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:43:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-89c02e34-6dc3-422d-b4c4-13be6291da71 tempest-GroupsV320Test-1046611922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:43:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-89c02e34-6dc3-422d-b4c4-13be6291da71 tempest-GroupsV320Test-1046611922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:43:21 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-89c02e34-6dc3-422d-b4c4-13be6291da71 tempest-GroupsV320Test-1046611922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:43:21 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-89c02e34-6dc3-422d-b4c4-13be6291da71 tempest-GroupsV320Test-1046611922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:43:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-89c02e34-6dc3-422d-b4c4-13be6291da71 tempest-GroupsV320Test-1046611922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:43:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-89c02e34-6dc3-422d-b4c4-13be6291da71 tempest-GroupsV320Test-1046611922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:21 devstack sudo[102514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:43:21 devstack sudo[102514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:22 devstack sudo[102514]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-89c02e34-6dc3-422d-b4c4-13be6291da71 tempest-GroupsV320Test-1046611922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.460s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:22 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-89c02e34-6dc3-422d-b4c4-13be6291da71 tempest-GroupsV320Test-1046611922 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:43:22 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-89c02e34-6dc3-422d-b4c4-13be6291da71 tempest-GroupsV320Test-1046611922 None] Delete group completed successfully. Nov 03 07:43:31 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:43:31 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:INSERT=1,cinder:SELECT=2,cinder:UPDATE=2 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:43:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-6a2a7ca6-d07d-40b1-87dd-acf24e2e0850 req-cc91bc3d-37c1-42cb-8c84-07dc6a59e7aa tempest-TestStampPattern-389950066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:43:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-6a2a7ca6-d07d-40b1-87dd-acf24e2e0850 req-cc91bc3d-37c1-42cb-8c84-07dc6a59e7aa tempest-TestStampPattern-389950066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:43:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-6a2a7ca6-d07d-40b1-87dd-acf24e2e0850 req-cc91bc3d-37c1-42cb-8c84-07dc6a59e7aa tempest-TestStampPattern-389950066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:43:46 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-6a2a7ca6-d07d-40b1-87dd-acf24e2e0850 req-cc91bc3d-37c1-42cb-8c84-07dc6a59e7aa tempest-TestStampPattern-389950066 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1', 'name': 'volume-8d84b5fe-6751-49e5-aa4f-da1792293ad1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ce4dd368-5cf8-4a57-9469-d82774f65d58', 'enforce_multipath': True} {{(pid=86875) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:43:46 devstack cinder-volume[86875]: INFO cinder.volume.manager [req-6a2a7ca6-d07d-40b1-87dd-acf24e2e0850 req-cc91bc3d-37c1-42cb-8c84-07dc6a59e7aa tempest-TestStampPattern-389950066 None] attachment_update completed successfully. Nov 03 07:43:47 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6e7688a-a199-4334-9a3f-f43405d0f9cd tempest-SnapshotDependencyTests-1706728912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:43:47 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e6e7688a-a199-4334-9a3f-f43405d0f9cd tempest-SnapshotDependencyTests-1706728912 None] Flow 'volume_create_manager' (d3bc67a8-c794-4c66-ad67-be8207eca5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:43:47 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e6e7688a-a199-4334-9a3f-f43405d0f9cd tempest-SnapshotDependencyTests-1706728912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7169b19f-1560-4bbb-b514-894930fe9235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:43:47 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e6e7688a-a199-4334-9a3f-f43405d0f9cd tempest-SnapshotDependencyTests-1706728912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7169b19f-1560-4bbb-b514-894930fe9235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:43:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1474326165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf95b8a8-5e11-47a4-af49-a892efdd0237,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f509dc0eda94393b11235660fe4c91a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:43:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:43:47Z,use_quota=True,user_id='8a7aee7eb0df423e9ffd6ec1ba2c7cad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:43:47 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e6e7688a-a199-4334-9a3f-f43405d0f9cd tempest-SnapshotDependencyTests-1706728912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9d9889d-dc69-4eaf-9df2-bd37ab307b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:43:47 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e6e7688a-a199-4334-9a3f-f43405d0f9cd tempest-SnapshotDependencyTests-1706728912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9d9889d-dc69-4eaf-9df2-bd37ab307b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:43:47 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e6e7688a-a199-4334-9a3f-f43405d0f9cd tempest-SnapshotDependencyTests-1706728912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (656b8878-a548-4309-9de4-b7914d646634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:43:47 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e6e7688a-a199-4334-9a3f-f43405d0f9cd tempest-SnapshotDependencyTests-1706728912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (656b8878-a548-4309-9de4-b7914d646634) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf95b8a8-5e11-47a4-af49-a892efdd0237', 'volume_name': 'volume-cf95b8a8-5e11-47a4-af49-a892efdd0237', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:43:47 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e6e7688a-a199-4334-9a3f-f43405d0f9cd tempest-SnapshotDependencyTests-1706728912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d95ddc97-a4ea-4ff9-a4b5-d549e628f3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:43:47 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e6e7688a-a199-4334-9a3f-f43405d0f9cd tempest-SnapshotDependencyTests-1706728912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d95ddc97-a4ea-4ff9-a4b5-d549e628f3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:43:47 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e6e7688a-a199-4334-9a3f-f43405d0f9cd tempest-SnapshotDependencyTests-1706728912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (317b1e6d-f3e0-4195-a680-6c2b97b27310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:43:47 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-e6e7688a-a199-4334-9a3f-f43405d0f9cd tempest-SnapshotDependencyTests-1706728912 None] Volume cf95b8a8-5e11-47a4-af49-a892efdd0237: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf95b8a8-5e11-47a4-af49-a892efdd0237', 'volume_size': 1} Nov 03 07:43:47 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e6e7688a-a199-4334-9a3f-f43405d0f9cd tempest-SnapshotDependencyTests-1706728912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:43:47 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e6e7688a-a199-4334-9a3f-f43405d0f9cd tempest-SnapshotDependencyTests-1706728912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:43:47 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-e6e7688a-a199-4334-9a3f-f43405d0f9cd tempest-SnapshotDependencyTests-1706728912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:43:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1474326165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf95b8a8-5e11-47a4-af49-a892efdd0237,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f509dc0eda94393b11235660fe4c91a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:43:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:43:47Z,use_quota=True,user_id='8a7aee7eb0df423e9ffd6ec1ba2c7cad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:43:47 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-e6e7688a-a199-4334-9a3f-f43405d0f9cd tempest-SnapshotDependencyTests-1706728912 None] Creating volume cf95b8a8-5e11-47a4-af49-a892efdd0237 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:43:47 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e6e7688a-a199-4334-9a3f-f43405d0f9cd tempest-SnapshotDependencyTests-1706728912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:43:47 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e6e7688a-a199-4334-9a3f-f43405d0f9cd tempest-SnapshotDependencyTests-1706728912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:43:47 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-e6e7688a-a199-4334-9a3f-f43405d0f9cd tempest-SnapshotDependencyTests-1706728912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:43:47 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-e6e7688a-a199-4334-9a3f-f43405d0f9cd tempest-SnapshotDependencyTests-1706728912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:43:47 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e6e7688a-a199-4334-9a3f-f43405d0f9cd tempest-SnapshotDependencyTests-1706728912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:43:47 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-e6e7688a-a199-4334-9a3f-f43405d0f9cd tempest-SnapshotDependencyTests-1706728912 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:43:47 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-e6e7688a-a199-4334-9a3f-f43405d0f9cd tempest-SnapshotDependencyTests-1706728912 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:43:47 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e6e7688a-a199-4334-9a3f-f43405d0f9cd tempest-SnapshotDependencyTests-1706728912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf95b8a8-5e11-47a4-af49-a892efdd0237 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:47 devstack sudo[103016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf95b8a8-5e11-47a4-af49-a892efdd0237 1073741824 Nov 03 07:43:47 devstack sudo[103016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:48 devstack sudo[103016]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e6e7688a-a199-4334-9a3f-f43405d0f9cd tempest-SnapshotDependencyTests-1706728912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf95b8a8-5e11-47a4-af49-a892efdd0237 1073741824" returned: 0 in 0.730s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e6e7688a-a199-4334-9a3f-f43405d0f9cd tempest-SnapshotDependencyTests-1706728912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf95b8a8-5e11-47a4-af49-a892efdd0237 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:48 devstack sudo[103024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf95b8a8-5e11-47a4-af49-a892efdd0237 Nov 03 07:43:48 devstack sudo[103024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:48 devstack sudo[103024]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e6e7688a-a199-4334-9a3f-f43405d0f9cd tempest-SnapshotDependencyTests-1706728912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf95b8a8-5e11-47a4-af49-a892efdd0237" returned: 0 in 0.321s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:48 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-e6e7688a-a199-4334-9a3f-f43405d0f9cd tempest-SnapshotDependencyTests-1706728912 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:43:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e6e7688a-a199-4334-9a3f-f43405d0f9cd tempest-SnapshotDependencyTests-1706728912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:43:48 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e6e7688a-a199-4334-9a3f-f43405d0f9cd tempest-SnapshotDependencyTests-1706728912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (317b1e6d-f3e0-4195-a680-6c2b97b27310) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf95b8a8-5e11-47a4-af49-a892efdd0237', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:43:48 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e6e7688a-a199-4334-9a3f-f43405d0f9cd tempest-SnapshotDependencyTests-1706728912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03281ce6-d173-44bc-ad94-5497c3bc6ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:43:48 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-e6e7688a-a199-4334-9a3f-f43405d0f9cd tempest-SnapshotDependencyTests-1706728912 None] Volume volume-cf95b8a8-5e11-47a4-af49-a892efdd0237 (cf95b8a8-5e11-47a4-af49-a892efdd0237): created successfully Nov 03 07:43:48 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e6e7688a-a199-4334-9a3f-f43405d0f9cd tempest-SnapshotDependencyTests-1706728912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03281ce6-d173-44bc-ad94-5497c3bc6ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:43:48 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e6e7688a-a199-4334-9a3f-f43405d0f9cd tempest-SnapshotDependencyTests-1706728912 None] Flow 'volume_create_manager' (d3bc67a8-c794-4c66-ad67-be8207eca5bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:43:48 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-e6e7688a-a199-4334-9a3f-f43405d0f9cd tempest-SnapshotDependencyTests-1706728912 None] Created volume successfully. Nov 03 07:43:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e10dfe14-5355-4720-8f62-6783c86c5c35 tempest-SnapshotDependencyTests-1706728912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:43:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e10dfe14-5355-4720-8f62-6783c86c5c35 tempest-SnapshotDependencyTests-1706728912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:43:49 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-e10dfe14-5355-4720-8f62-6783c86c5c35 tempest-SnapshotDependencyTests-1706728912 None] Creating offline snapshot fd213bbf-575a-4c76-952f-73bcff026964 of volume cf95b8a8-5e11-47a4-af49-a892efdd0237 {{(pid=86875) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:43:49 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a27c9a1-1d5b-45b3-b2c1-c67c6b4c9b39]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:43:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e10dfe14-5355-4720-8f62-6783c86c5c35 tempest-SnapshotDependencyTests-1706728912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf95b8a8-5e11-47a4-af49-a892efdd0237 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:49 devstack sudo[103043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf95b8a8-5e11-47a4-af49-a892efdd0237 Nov 03 07:43:49 devstack sudo[103043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:49 devstack sudo[103043]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e10dfe14-5355-4720-8f62-6783c86c5c35 tempest-SnapshotDependencyTests-1706728912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf95b8a8-5e11-47a4-af49-a892efdd0237" returned: 0 in 0.453s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e10dfe14-5355-4720-8f62-6783c86c5c35 tempest-SnapshotDependencyTests-1706728912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf95b8a8-5e11-47a4-af49-a892efdd0237,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf95b8a8-5e11-47a4-af49-a892efdd0237.fd213bbf-575a-4c76-952f-73bcff026964 1G {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:50 devstack sudo[103048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf95b8a8-5e11-47a4-af49-a892efdd0237,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf95b8a8-5e11-47a4-af49-a892efdd0237.fd213bbf-575a-4c76-952f-73bcff026964 1G Nov 03 07:43:50 devstack sudo[103048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:50 devstack cinder-volume[86875]: INFO cinder.volume.manager [req-96df6ed2-e4d5-49e9-a7ab-d8f07a5a0354 req-c8923724-7438-4da4-af9e-9f702371c2b5 tempest-TestStampPattern-389950066 None] Terminate volume connection completed successfully. Nov 03 07:43:50 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-96df6ed2-e4d5-49e9-a7ab-d8f07a5a0354 req-c8923724-7438-4da4-af9e-9f702371c2b5 tempest-TestStampPattern-389950066 None] Deleting attachment ce4dd368-5cf8-4a57-9469-d82774f65d58. {{(pid=86875) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:43:50 devstack sudo[103048]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e10dfe14-5355-4720-8f62-6783c86c5c35 tempest-SnapshotDependencyTests-1706728912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf95b8a8-5e11-47a4-af49-a892efdd0237,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf95b8a8-5e11-47a4-af49-a892efdd0237.fd213bbf-575a-4c76-952f-73bcff026964 1G" returned: 0 in 0.628s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e10dfe14-5355-4720-8f62-6783c86c5c35 tempest-SnapshotDependencyTests-1706728912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf95b8a8-5e11-47a4-af49-a892efdd0237 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf95b8a8-5e11-47a4-af49-a892efdd0237.fd213bbf-575a-4c76-952f-73bcff026964 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:50 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-89dda154-6fad-4c6e-bf2b-c9a0e18190af tempest-VolumesImageMetadata-111476473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:43:50 devstack sudo[103082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf95b8a8-5e11-47a4-af49-a892efdd0237 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf95b8a8-5e11-47a4-af49-a892efdd0237.fd213bbf-575a-4c76-952f-73bcff026964 Nov 03 07:43:50 devstack sudo[103082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:50 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-89dda154-6fad-4c6e-bf2b-c9a0e18190af tempest-VolumesImageMetadata-111476473 None] Flow 'volume_create_manager' (a1b2174f-e062-4acc-a869-146443fc42c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:43:50 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-89dda154-6fad-4c6e-bf2b-c9a0e18190af tempest-VolumesImageMetadata-111476473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88e8d0c4-08f5-46ec-ba8f-371ae5daba82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:43:50 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-89dda154-6fad-4c6e-bf2b-c9a0e18190af tempest-VolumesImageMetadata-111476473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88e8d0c4-08f5-46ec-ba8f-371ae5daba82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:43:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-772264018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=745905a5-768a-4e8d-ae75-cd8e289c538b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5ec8cb6df2240b19c7dc47dca2760eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:43:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:43:51Z,use_quota=True,user_id='3ddfc83d336249289723b8b9645f552d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:43:50 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-89dda154-6fad-4c6e-bf2b-c9a0e18190af tempest-VolumesImageMetadata-111476473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb850de9-11f6-45b4-ad18-b11b1ace5d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:43:50 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-89dda154-6fad-4c6e-bf2b-c9a0e18190af tempest-VolumesImageMetadata-111476473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb850de9-11f6-45b4-ad18-b11b1ace5d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:43:50 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-89dda154-6fad-4c6e-bf2b-c9a0e18190af tempest-VolumesImageMetadata-111476473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cfc97e8-125e-41dc-9261-db54d40ef099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:43:50 devstack cinder-volume[86875]: DEBUG cinder.image.glance [None req-89dda154-6fad-4c6e-bf2b-c9a0e18190af tempest-VolumesImageMetadata-111476473 None] Creating Keystone auth plugin from conf {{(pid=86875) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 07:43:50 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-89dda154-6fad-4c6e-bf2b-c9a0e18190af tempest-VolumesImageMetadata-111476473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cfc97e8-125e-41dc-9261-db54d40ef099) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '745905a5-768a-4e8d-ae75-cd8e289c538b', 'volume_name': 'volume-745905a5-768a-4e8d-ae75-cd8e289c538b', 'volume_size': 1, 'image_id': 'eb68a148-0c9c-4237-9d8d-94a6a7cd87d9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eb68a148-0c9c-4237-9d8d-94a6a7cd87d9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c9ace38ee46b42979b3d4c79532bd66e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eb68a148-0c9c-4237-9d8d-94a6a7cd87d9', 'created_at': datetime.datetime(2026, 11, 3, 6, 21, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 21, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eb68a148-0c9c-4237-9d8d-94a6a7cd87d9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:43:50 devstack sudo[103082]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:50 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-89dda154-6fad-4c6e-bf2b-c9a0e18190af tempest-VolumesImageMetadata-111476473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0fdb1fa-7d17-478c-9d75-3b9d7dc01e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:43:50 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-89dda154-6fad-4c6e-bf2b-c9a0e18190af tempest-VolumesImageMetadata-111476473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0fdb1fa-7d17-478c-9d75-3b9d7dc01e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:43:51 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-89dda154-6fad-4c6e-bf2b-c9a0e18190af tempest-VolumesImageMetadata-111476473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d87e6d6-bb52-49d9-97ab-cb6074c5de8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:43:51 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-89dda154-6fad-4c6e-bf2b-c9a0e18190af tempest-VolumesImageMetadata-111476473 None] Volume 745905a5-768a-4e8d-ae75-cd8e289c538b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-745905a5-768a-4e8d-ae75-cd8e289c538b', 'volume_size': 1, 'image_id': 'eb68a148-0c9c-4237-9d8d-94a6a7cd87d9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eb68a148-0c9c-4237-9d8d-94a6a7cd87d9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c9ace38ee46b42979b3d4c79532bd66e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eb68a148-0c9c-4237-9d8d-94a6a7cd87d9', 'created_at': datetime.datetime(2026, 11, 3, 6, 21, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 21, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eb68a148-0c9c-4237-9d8d-94a6a7cd87d9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 03 07:43:51 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-89dda154-6fad-4c6e-bf2b-c9a0e18190af tempest-VolumesImageMetadata-111476473 None] Trying to clone 745905a5-768a-4e8d-ae75-cd8e289c538b from image eb68a148-0c9c-4237-9d8d-94a6a7cd87d9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/eb68a148-0c9c-4237-9d8d-94a6a7cd87d9', 'metadata': {}}]). {{(pid=86875) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 07:43:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e10dfe14-5355-4720-8f62-6783c86c5c35 tempest-SnapshotDependencyTests-1706728912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf95b8a8-5e11-47a4-af49-a892efdd0237 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf95b8a8-5e11-47a4-af49-a892efdd0237.fd213bbf-575a-4c76-952f-73bcff026964" returned: 0 in 0.377s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:51 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-e10dfe14-5355-4720-8f62-6783c86c5c35 tempest-SnapshotDependencyTests-1706728912 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf95b8a8-5e11-47a4-af49-a892efdd0237.fd213bbf-575a-4c76-952f-73bcff026964 is being set with open permissions: ugo+rw Nov 03 07:43:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e10dfe14-5355-4720-8f62-6783c86c5c35 tempest-SnapshotDependencyTests-1706728912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf95b8a8-5e11-47a4-af49-a892efdd0237.fd213bbf-575a-4c76-952f-73bcff026964 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:51 devstack sudo[103088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf95b8a8-5e11-47a4-af49-a892efdd0237.fd213bbf-575a-4c76-952f-73bcff026964 Nov 03 07:43:51 devstack sudo[103088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:51 devstack sudo[103088]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e10dfe14-5355-4720-8f62-6783c86c5c35 tempest-SnapshotDependencyTests-1706728912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf95b8a8-5e11-47a4-af49-a892efdd0237.fd213bbf-575a-4c76-952f-73bcff026964" returned: 0 in 0.329s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:51 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-89dda154-6fad-4c6e-bf2b-c9a0e18190af tempest-VolumesImageMetadata-111476473 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_3ck7csvadevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86875) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 07:43:51 devstack cinder-volume[86875]: INFO cinder.image.image_utils [None req-89dda154-6fad-4c6e-bf2b-c9a0e18190af tempest-VolumesImageMetadata-111476473 None] Image download 20.69 MB at 20.69 MB/s Nov 03 07:43:51 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21e521a-6986-4df6-9d94-96fbed40a053]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:43:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-89dda154-6fad-4c6e-bf2b-c9a0e18190af tempest-VolumesImageMetadata-111476473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_3ck7csvadevstack@QuobyteHD {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e10dfe14-5355-4720-8f62-6783c86c5c35 tempest-SnapshotDependencyTests-1706728912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf95b8a8-5e11-47a4-af49-a892efdd0237.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:51 devstack sudo[103093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf95b8a8-5e11-47a4-af49-a892efdd0237.info Nov 03 07:43:51 devstack sudo[103093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:51 devstack sudo[103092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_3ck7csvadevstack@QuobyteHD Nov 03 07:43:51 devstack sudo[103092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:51 devstack sudo[103093]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e10dfe14-5355-4720-8f62-6783c86c5c35 tempest-SnapshotDependencyTests-1706728912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf95b8a8-5e11-47a4-af49-a892efdd0237.info" returned: 0 in 0.358s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:51 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-e10dfe14-5355-4720-8f62-6783c86c5c35 tempest-SnapshotDependencyTests-1706728912 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf95b8a8-5e11-47a4-af49-a892efdd0237.info is being set with open permissions: ugo+rw Nov 03 07:43:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e10dfe14-5355-4720-8f62-6783c86c5c35 tempest-SnapshotDependencyTests-1706728912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf95b8a8-5e11-47a4-af49-a892efdd0237.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:51 devstack sudo[103098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf95b8a8-5e11-47a4-af49-a892efdd0237.info Nov 03 07:43:51 devstack sudo[103098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:51 devstack sudo[103092]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-89dda154-6fad-4c6e-bf2b-c9a0e18190af tempest-VolumesImageMetadata-111476473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_3ck7csvadevstack@QuobyteHD" returned: 0 in 0.463s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:51 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-89dda154-6fad-4c6e-bf2b-c9a0e18190af tempest-VolumesImageMetadata-111476473 None] Temporary image eb68a148-0c9c-4237-9d8d-94a6a7cd87d9 is fetched for user 3ddfc83d336249289723b8b9645f552d. {{(pid=86875) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 07:43:51 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc29ba95-ec82-4c5b-9f82-2f48ad7efc0a]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:43:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-89dda154-6fad-4c6e-bf2b-c9a0e18190af tempest-VolumesImageMetadata-111476473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_3ck7csvadevstack@QuobyteHD {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:52 devstack sudo[103098]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:52 devstack sudo[103104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_3ck7csvadevstack@QuobyteHD Nov 03 07:43:52 devstack sudo[103104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e10dfe14-5355-4720-8f62-6783c86c5c35 tempest-SnapshotDependencyTests-1706728912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf95b8a8-5e11-47a4-af49-a892efdd0237.info" returned: 0 in 0.412s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e10dfe14-5355-4720-8f62-6783c86c5c35 tempest-SnapshotDependencyTests-1706728912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.756s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:43:52 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-e10dfe14-5355-4720-8f62-6783c86c5c35 tempest-SnapshotDependencyTests-1706728912 None] Create snapshot completed successfully Nov 03 07:43:52 devstack sudo[103104]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-89dda154-6fad-4c6e-bf2b-c9a0e18190af tempest-VolumesImageMetadata-111476473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_3ck7csvadevstack@QuobyteHD" returned: 0 in 0.659s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-89dda154-6fad-4c6e-bf2b-c9a0e18190af tempest-VolumesImageMetadata-111476473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:43:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-89dda154-6fad-4c6e-bf2b-c9a0e18190af tempest-VolumesImageMetadata-111476473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:43:52 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-89dda154-6fad-4c6e-bf2b-c9a0e18190af tempest-VolumesImageMetadata-111476473 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:43:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-772264018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=745905a5-768a-4e8d-ae75-cd8e289c538b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5ec8cb6df2240b19c7dc47dca2760eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:43:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:43:51Z,use_quota=True,user_id='3ddfc83d336249289723b8b9645f552d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:43:52 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-89dda154-6fad-4c6e-bf2b-c9a0e18190af tempest-VolumesImageMetadata-111476473 None] Creating volume 745905a5-768a-4e8d-ae75-cd8e289c538b {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:43:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-89dda154-6fad-4c6e-bf2b-c9a0e18190af tempest-VolumesImageMetadata-111476473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:43:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-89dda154-6fad-4c6e-bf2b-c9a0e18190af tempest-VolumesImageMetadata-111476473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:43:52 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-89dda154-6fad-4c6e-bf2b-c9a0e18190af tempest-VolumesImageMetadata-111476473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:43:52 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-89dda154-6fad-4c6e-bf2b-c9a0e18190af tempest-VolumesImageMetadata-111476473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:43:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-89dda154-6fad-4c6e-bf2b-c9a0e18190af tempest-VolumesImageMetadata-111476473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:43:52 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-89dda154-6fad-4c6e-bf2b-c9a0e18190af tempest-VolumesImageMetadata-111476473 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:43:52 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-89dda154-6fad-4c6e-bf2b-c9a0e18190af tempest-VolumesImageMetadata-111476473 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:43:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-89dda154-6fad-4c6e-bf2b-c9a0e18190af tempest-VolumesImageMetadata-111476473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-745905a5-768a-4e8d-ae75-cd8e289c538b 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:52 devstack sudo[103125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-745905a5-768a-4e8d-ae75-cd8e289c538b 1073741824 Nov 03 07:43:52 devstack sudo[103125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:53 devstack sudo[103125]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-89dda154-6fad-4c6e-bf2b-c9a0e18190af tempest-VolumesImageMetadata-111476473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-745905a5-768a-4e8d-ae75-cd8e289c538b 1073741824" returned: 0 in 0.731s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-89dda154-6fad-4c6e-bf2b-c9a0e18190af tempest-VolumesImageMetadata-111476473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-745905a5-768a-4e8d-ae75-cd8e289c538b {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:53 devstack sudo[103138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-745905a5-768a-4e8d-ae75-cd8e289c538b Nov 03 07:43:53 devstack sudo[103138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:53 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-dba78f69-0ae6-44a6-9750-41d6efe31782 tempest-SnapshotDependencyTests-1706728912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:43:53 devstack sudo[103138]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-dba78f69-0ae6-44a6-9750-41d6efe31782 tempest-SnapshotDependencyTests-1706728912 None] Flow 'volume_create_manager' (9ec72cc1-2bb3-436b-b08e-e75b8a24ab09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:43:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-dba78f69-0ae6-44a6-9750-41d6efe31782 tempest-SnapshotDependencyTests-1706728912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d882acc-a022-4832-b543-e8e810fedfdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:43:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-89dda154-6fad-4c6e-bf2b-c9a0e18190af tempest-VolumesImageMetadata-111476473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-745905a5-768a-4e8d-ae75-cd8e289c538b" returned: 0 in 0.443s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:53 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-89dda154-6fad-4c6e-bf2b-c9a0e18190af tempest-VolumesImageMetadata-111476473 None] <== create_volume: return (1247ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:43:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-89dda154-6fad-4c6e-bf2b-c9a0e18190af tempest-VolumesImageMetadata-111476473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.251s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:43:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-dba78f69-0ae6-44a6-9750-41d6efe31782 tempest-SnapshotDependencyTests-1706728912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d882acc-a022-4832-b543-e8e810fedfdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:43:53Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e9a7787-ed00-4c8f-82a2-f19d4ebc8bf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f509dc0eda94393b11235660fe4c91a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:43:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fd213bbf-575a-4c76-952f-73bcff026964,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:43:54Z,use_quota=True,user_id='8a7aee7eb0df423e9ffd6ec1ba2c7cad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:43:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-dba78f69-0ae6-44a6-9750-41d6efe31782 tempest-SnapshotDependencyTests-1706728912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d5e7a91-5aff-40a7-864c-e4f46c4f486e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:43:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-dba78f69-0ae6-44a6-9750-41d6efe31782 tempest-SnapshotDependencyTests-1706728912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d5e7a91-5aff-40a7-864c-e4f46c4f486e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:43:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-dba78f69-0ae6-44a6-9750-41d6efe31782 tempest-SnapshotDependencyTests-1706728912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6545c6b9-eb68-4538-9237-b6ca77d41113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:43:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-dba78f69-0ae6-44a6-9750-41d6efe31782 tempest-SnapshotDependencyTests-1706728912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6545c6b9-eb68-4538-9237-b6ca77d41113) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0e9a7787-ed00-4c8f-82a2-f19d4ebc8bf3', 'volume_name': 'volume-0e9a7787-ed00-4c8f-82a2-f19d4ebc8bf3', 'volume_size': 1, 'snapshot_id': 'fd213bbf-575a-4c76-952f-73bcff026964'}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:43:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-dba78f69-0ae6-44a6-9750-41d6efe31782 tempest-SnapshotDependencyTests-1706728912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51f73960-e45b-4eeb-bbd4-c87f3e960421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:43:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-dba78f69-0ae6-44a6-9750-41d6efe31782 tempest-SnapshotDependencyTests-1706728912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51f73960-e45b-4eeb-bbd4-c87f3e960421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:43:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-dba78f69-0ae6-44a6-9750-41d6efe31782 tempest-SnapshotDependencyTests-1706728912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c020e6d5-7faa-45ca-b225-3cdf450eab70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:43:53 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-dba78f69-0ae6-44a6-9750-41d6efe31782 tempest-SnapshotDependencyTests-1706728912 None] Volume 0e9a7787-ed00-4c8f-82a2-f19d4ebc8bf3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0e9a7787-ed00-4c8f-82a2-f19d4ebc8bf3', 'volume_size': 1, 'snapshot_id': 'fd213bbf-575a-4c76-952f-73bcff026964'} Nov 03 07:43:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-dba78f69-0ae6-44a6-9750-41d6efe31782 tempest-SnapshotDependencyTests-1706728912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:43:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-dba78f69-0ae6-44a6-9750-41d6efe31782 tempest-SnapshotDependencyTests-1706728912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:43:53 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-dba78f69-0ae6-44a6-9750-41d6efe31782 tempest-SnapshotDependencyTests-1706728912 None] Acquiring lock "cinder-quobyte-fd213bbf-575a-4c76-952f-73bcff026964-0e9a7787-ed00-4c8f-82a2-f19d4ebc8bf3" by "_create_volume_from_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:43:53 devstack cinder-volume[86875]: DEBUG cinder.volume.volume_utils [None req-89dda154-6fad-4c6e-bf2b-c9a0e18190af tempest-VolumesImageMetadata-111476473 None] Attempting download of eb68a148-0c9c-4237-9d8d-94a6a7cd87d9 ((None, [{'url': 'file:///opt/stack/data/glance/images/eb68a148-0c9c-4237-9d8d-94a6a7cd87d9', 'metadata': {}}])) to volume 745905a5-768a-4e8d-ae75-cd8e289c538b. {{(pid=86875) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 07:43:54 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-dba78f69-0ae6-44a6-9750-41d6efe31782 tempest-SnapshotDependencyTests-1706728912 None] Lock "cinder-quobyte-fd213bbf-575a-4c76-952f-73bcff026964-0e9a7787-ed00-4c8f-82a2-f19d4ebc8bf3" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:43:54 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-dba78f69-0ae6-44a6-9750-41d6efe31782 tempest-SnapshotDependencyTests-1706728912 None] Creating volume 0e9a7787-ed00-4c8f-82a2-f19d4ebc8bf3 from snapshot fd213bbf-575a-4c76-952f-73bcff026964 {{(pid=86875) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 07:43:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-dba78f69-0ae6-44a6-9750-41d6efe31782 tempest-SnapshotDependencyTests-1706728912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:43:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-dba78f69-0ae6-44a6-9750-41d6efe31782 tempest-SnapshotDependencyTests-1706728912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:43:54 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-dba78f69-0ae6-44a6-9750-41d6efe31782 tempest-SnapshotDependencyTests-1706728912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:43:54 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-dba78f69-0ae6-44a6-9750-41d6efe31782 tempest-SnapshotDependencyTests-1706728912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:43:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-dba78f69-0ae6-44a6-9750-41d6efe31782 tempest-SnapshotDependencyTests-1706728912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:43:54 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-dba78f69-0ae6-44a6-9750-41d6efe31782 tempest-SnapshotDependencyTests-1706728912 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:43:54 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-dba78f69-0ae6-44a6-9750-41d6efe31782 tempest-SnapshotDependencyTests-1706728912 None] Acquiring lock "cinder-quobyte-0e9a7787-ed00-4c8f-82a2-f19d4ebc8bf3" by "_copy_volume_from_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:43:54 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-dba78f69-0ae6-44a6-9750-41d6efe31782 tempest-SnapshotDependencyTests-1706728912 None] Lock "cinder-quobyte-0e9a7787-ed00-4c8f-82a2-f19d4ebc8bf3" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:43:54 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-dba78f69-0ae6-44a6-9750-41d6efe31782 tempest-SnapshotDependencyTests-1706728912 None] snapshot: fd213bbf-575a-4c76-952f-73bcff026964, volume: 0e9a7787-ed00-4c8f-82a2-f19d4ebc8bf3, {{(pid=86875) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 07:43:54 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71e7390-4c9e-4831-9909-0f1194d4f776]: (4, 'raw') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:43:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-89dda154-6fad-4c6e-bf2b-c9a0e18190af tempest-VolumesImageMetadata-111476473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_5y3bb0bu {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-dba78f69-0ae6-44a6-9750-41d6efe31782 tempest-SnapshotDependencyTests-1706728912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:43:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-dba78f69-0ae6-44a6-9750-41d6efe31782 tempest-SnapshotDependencyTests-1706728912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:43:54 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-dba78f69-0ae6-44a6-9750-41d6efe31782 tempest-SnapshotDependencyTests-1706728912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:43:54 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-dba78f69-0ae6-44a6-9750-41d6efe31782 tempest-SnapshotDependencyTests-1706728912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:43:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-dba78f69-0ae6-44a6-9750-41d6efe31782 tempest-SnapshotDependencyTests-1706728912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:43:54 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb80c548-0b94-4536-9c5d-331f174fb732]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:43:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-dba78f69-0ae6-44a6-9750-41d6efe31782 tempest-SnapshotDependencyTests-1706728912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf95b8a8-5e11-47a4-af49-a892efdd0237.fd213bbf-575a-4c76-952f-73bcff026964 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:54 devstack sudo[103141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_5y3bb0bu Nov 03 07:43:54 devstack sudo[103141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:54 devstack sudo[103143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf95b8a8-5e11-47a4-af49-a892efdd0237.fd213bbf-575a-4c76-952f-73bcff026964 Nov 03 07:43:54 devstack sudo[103143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:54 devstack sudo[103141]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-89dda154-6fad-4c6e-bf2b-c9a0e18190af tempest-VolumesImageMetadata-111476473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_5y3bb0bu" returned: 0 in 0.422s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-89dda154-6fad-4c6e-bf2b-c9a0e18190af tempest-VolumesImageMetadata-111476473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_5y3bb0bu {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:54 devstack sudo[103149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_5y3bb0bu Nov 03 07:43:54 devstack sudo[103149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:54 devstack sudo[103143]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-dba78f69-0ae6-44a6-9750-41d6efe31782 tempest-SnapshotDependencyTests-1706728912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf95b8a8-5e11-47a4-af49-a892efdd0237.fd213bbf-575a-4c76-952f-73bcff026964" returned: 0 in 0.489s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:54 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-dba78f69-0ae6-44a6-9750-41d6efe31782 tempest-SnapshotDependencyTests-1706728912 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf95b8a8-5e11-47a4-af49-a892efdd0237(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:43:54 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eea8948-521b-4259-b0e0-6c6c2a8de68b]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:43:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-dba78f69-0ae6-44a6-9750-41d6efe31782 tempest-SnapshotDependencyTests-1706728912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf95b8a8-5e11-47a4-af49-a892efdd0237 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:54 devstack sudo[103155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf95b8a8-5e11-47a4-af49-a892efdd0237 Nov 03 07:43:54 devstack sudo[103155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:54 devstack sudo[103149]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-89dda154-6fad-4c6e-bf2b-c9a0e18190af tempest-VolumesImageMetadata-111476473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_5y3bb0bu" returned: 1 in 0.416s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-89dda154-6fad-4c6e-bf2b-c9a0e18190af tempest-VolumesImageMetadata-111476473 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_5y3bb0bu' failed. Not Retrying. {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:43:54 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d855ba-d604-48d3-9594-c87e64588f96]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:43:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-89dda154-6fad-4c6e-bf2b-c9a0e18190af tempest-VolumesImageMetadata-111476473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_3ck7csvadevstack@QuobyteHD {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:55 devstack sudo[103159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_3ck7csvadevstack@QuobyteHD Nov 03 07:43:55 devstack sudo[103159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:55 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-5521755e-ea45-43d2-bc1d-3f7c9f1b5c65 tempest-TestStampPattern-389950066 None] Acquiring lock "cinder-8d84b5fe-6751-49e5-aa4f-da1792293ad1-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:43:55 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-5521755e-ea45-43d2-bc1d-3f7c9f1b5c65 tempest-TestStampPattern-389950066 None] Lock "cinder-8d84b5fe-6751-49e5-aa4f-da1792293ad1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:43:55 devstack sudo[103155]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-dba78f69-0ae6-44a6-9750-41d6efe31782 tempest-SnapshotDependencyTests-1706728912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf95b8a8-5e11-47a4-af49-a892efdd0237" returned: 0 in 0.513s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:55 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-dba78f69-0ae6-44a6-9750-41d6efe31782 tempest-SnapshotDependencyTests-1706728912 None] will copy from snapshot at /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf95b8a8-5e11-47a4-af49-a892efdd0237 {{(pid=86875) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 07:43:55 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-dba78f69-0ae6-44a6-9750-41d6efe31782 tempest-SnapshotDependencyTests-1706728912 None] Creating direct copy from snapshot {{(pid=86875) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 07:43:55 devstack cinder-volume[86875]: DEBUG cinder.utils [None req-dba78f69-0ae6-44a6-9750-41d6efe31782 tempest-SnapshotDependencyTests-1706728912 None] Path /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0e9a7787-ed00-4c8f-82a2-f19d4ebc8bf3 not found in is_blk_device check {{(pid=86875) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 07:43:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-dba78f69-0ae6-44a6-9750-41d6efe31782 tempest-SnapshotDependencyTests-1706728912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf95b8a8-5e11-47a4-af49-a892efdd0237 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0e9a7787-ed00-4c8f-82a2-f19d4ebc8bf3 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:55 devstack sudo[103164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf95b8a8-5e11-47a4-af49-a892efdd0237 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0e9a7787-ed00-4c8f-82a2-f19d4ebc8bf3 Nov 03 07:43:55 devstack sudo[103164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:55 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-5521755e-ea45-43d2-bc1d-3f7c9f1b5c65 tempest-TestStampPattern-389950066 None] Acquiring lock "cinder-quobyte-8d84b5fe-6751-49e5-aa4f-da1792293ad1" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:43:55 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-5521755e-ea45-43d2-bc1d-3f7c9f1b5c65 tempest-TestStampPattern-389950066 None] Lock "cinder-quobyte-8d84b5fe-6751-49e5-aa4f-da1792293ad1" acquired by "delete_volume" :: waited 0.021s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:43:55 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd9b4da-4e85-4ec0-a948-7c5e0ef7c0f4]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:43:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5521755e-ea45-43d2-bc1d-3f7c9f1b5c65 tempest-TestStampPattern-389950066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d84b5fe-6751-49e5-aa4f-da1792293ad1 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:55 devstack sudo[103159]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-89dda154-6fad-4c6e-bf2b-c9a0e18190af tempest-VolumesImageMetadata-111476473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_3ck7csvadevstack@QuobyteHD" returned: 0 in 0.483s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:55 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-89dda154-6fad-4c6e-bf2b-c9a0e18190af tempest-VolumesImageMetadata-111476473 None] eb68a148-0c9c-4237-9d8d-94a6a7cd87d9 was qcow2, converting to qcow2 {{(pid=86875) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 07:43:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-89dda154-6fad-4c6e-bf2b-c9a0e18190af tempest-VolumesImageMetadata-111476473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_3ck7csvadevstack@QuobyteHD /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-745905a5-768a-4e8d-ae75-cd8e289c538b {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:55 devstack sudo[103171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_3ck7csvadevstack@QuobyteHD /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-745905a5-768a-4e8d-ae75-cd8e289c538b Nov 03 07:43:55 devstack sudo[103171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:55 devstack sudo[103166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d84b5fe-6751-49e5-aa4f-da1792293ad1 Nov 03 07:43:55 devstack sudo[103166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:55 devstack sudo[103166]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5521755e-ea45-43d2-bc1d-3f7c9f1b5c65 tempest-TestStampPattern-389950066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d84b5fe-6751-49e5-aa4f-da1792293ad1" returned: 0 in 0.586s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5521755e-ea45-43d2-bc1d-3f7c9f1b5c65 tempest-TestStampPattern-389950066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d84b5fe-6751-49e5-aa4f-da1792293ad1 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:55 devstack sudo[103190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d84b5fe-6751-49e5-aa4f-da1792293ad1 Nov 03 07:43:55 devstack sudo[103190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:56 devstack sudo[103190]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5521755e-ea45-43d2-bc1d-3f7c9f1b5c65 tempest-TestStampPattern-389950066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d84b5fe-6751-49e5-aa4f-da1792293ad1" returned: 0 in 0.401s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:56 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-5521755e-ea45-43d2-bc1d-3f7c9f1b5c65 tempest-TestStampPattern-389950066 None] Lock "cinder-quobyte-8d84b5fe-6751-49e5-aa4f-da1792293ad1" released by "delete_volume" :: held 1.062s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:43:56 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-5521755e-ea45-43d2-bc1d-3f7c9f1b5c65 tempest-TestStampPattern-389950066 None] Created reservations ['1b292069-41e8-4e51-96ca-a508532d2b3f', '37fe571c-40be-41ba-8761-58393b5edf79', 'b9068457-335f-4fb4-be08-6c3c110db6b5', '6f7569a3-71ef-4afa-a12f-a214e5ad7234'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:43:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-5521755e-ea45-43d2-bc1d-3f7c9f1b5c65 tempest-TestStampPattern-389950066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:43:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-5521755e-ea45-43d2-bc1d-3f7c9f1b5c65 tempest-TestStampPattern-389950066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:43:56 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-5521755e-ea45-43d2-bc1d-3f7c9f1b5c65 tempest-TestStampPattern-389950066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:43:56 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-5521755e-ea45-43d2-bc1d-3f7c9f1b5c65 tempest-TestStampPattern-389950066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:43:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-5521755e-ea45-43d2-bc1d-3f7c9f1b5c65 tempest-TestStampPattern-389950066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:43:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5521755e-ea45-43d2-bc1d-3f7c9f1b5c65 tempest-TestStampPattern-389950066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:56 devstack sudo[103196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:43:56 devstack sudo[103196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:56 devstack sudo[103196]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5521755e-ea45-43d2-bc1d-3f7c9f1b5c65 tempest-TestStampPattern-389950066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.373s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:56 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-5521755e-ea45-43d2-bc1d-3f7c9f1b5c65 tempest-TestStampPattern-389950066 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:43:56 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-5521755e-ea45-43d2-bc1d-3f7c9f1b5c65 tempest-TestStampPattern-389950066 None] Deleted volume successfully. Nov 03 07:43:57 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-5521755e-ea45-43d2-bc1d-3f7c9f1b5c65 tempest-TestStampPattern-389950066 None] Lock "cinder-8d84b5fe-6751-49e5-aa4f-da1792293ad1-delete_volume" released by "delete_volume" :: held 1.819s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:43:58 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-9bf76e5d-2596-492c-9604-9193a57a750b tempest-TestStampPattern-389950066 None] Acquiring lock "cinder-c0a8a75f-a530-446b-9813-62cc8183dafe-delete_snapshot" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:43:58 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-9bf76e5d-2596-492c-9604-9193a57a750b tempest-TestStampPattern-389950066 None] Lock "cinder-c0a8a75f-a530-446b-9813-62cc8183dafe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:43:58 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-9bf76e5d-2596-492c-9604-9193a57a750b tempest-TestStampPattern-389950066 None] Acquiring lock "cinder-quobyte-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:43:58 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-9bf76e5d-2596-492c-9604-9193a57a750b tempest-TestStampPattern-389950066 None] Lock "cinder-quobyte-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:43:58 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-9bf76e5d-2596-492c-9604-9193a57a750b tempest-TestStampPattern-389950066 None] Acquiring lock "cinder-quobyte-c0a8a75f-a530-446b-9813-62cc8183dafe" by "_delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:43:58 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-9bf76e5d-2596-492c-9604-9193a57a750b tempest-TestStampPattern-389950066 None] Lock "cinder-quobyte-c0a8a75f-a530-446b-9813-62cc8183dafe" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:43:58 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-9bf76e5d-2596-492c-9604-9193a57a750b tempest-TestStampPattern-389950066 None] Deleting offline snapshot c0a8a75f-a530-446b-9813-62cc8183dafe of volume 9118d4a4-1e9c-4c31-b4e8-9b48cad4a771 {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:43:58 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-9bf76e5d-2596-492c-9604-9193a57a750b tempest-TestStampPattern-389950066 None] snapshot_file for this snap is: volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771.c0a8a75f-a530-446b-9813-62cc8183dafe {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:43:58 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de4bfec-0b19-4823-8d10-bcb0f760dcdc]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:43:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9bf76e5d-2596-492c-9604-9193a57a750b tempest-TestStampPattern-389950066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771.c0a8a75f-a530-446b-9813-62cc8183dafe {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:58 devstack sudo[103201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771.c0a8a75f-a530-446b-9813-62cc8183dafe Nov 03 07:43:58 devstack sudo[103201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:58 devstack sudo[103201]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9bf76e5d-2596-492c-9604-9193a57a750b tempest-TestStampPattern-389950066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771.c0a8a75f-a530-446b-9813-62cc8183dafe" returned: 0 in 0.587s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:58 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-9bf76e5d-2596-492c-9604-9193a57a750b tempest-TestStampPattern-389950066 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:43:58 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[199eba65-42c8-4ad5-a648-c1a9a48ccef6]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:43:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9bf76e5d-2596-492c-9604-9193a57a750b tempest-TestStampPattern-389950066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:59 devstack sudo[103206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771 Nov 03 07:43:59 devstack sudo[103206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:43:59 devstack sudo[103206]: pam_unix(sudo:session): session closed for user root Nov 03 07:43:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9bf76e5d-2596-492c-9604-9193a57a750b tempest-TestStampPattern-389950066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771" returned: 0 in 0.929s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:43:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9bf76e5d-2596-492c-9604-9193a57a750b tempest-TestStampPattern-389950066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771.c0a8a75f-a530-446b-9813-62cc8183dafe {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:43:59 devstack sudo[103211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771.c0a8a75f-a530-446b-9813-62cc8183dafe Nov 03 07:43:59 devstack sudo[103211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:00 devstack sudo[103171]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:00 devstack sudo[103211]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-89dda154-6fad-4c6e-bf2b-c9a0e18190af tempest-VolumesImageMetadata-111476473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_3ck7csvadevstack@QuobyteHD /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-745905a5-768a-4e8d-ae75-cd8e289c538b" returned: 0 in 5.110s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9bf76e5d-2596-492c-9604-9193a57a750b tempest-TestStampPattern-389950066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771.c0a8a75f-a530-446b-9813-62cc8183dafe" returned: 0 in 0.650s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:00 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-89dda154-6fad-4c6e-bf2b-c9a0e18190af tempest-VolumesImageMetadata-111476473 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_eb68a148-0c9c-4237-9d8d-94a6a7cd87d9_3ck7csvadevstack@QuobyteHD, size 112.00 MB, duration 5.11 sec, destination /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-745905a5-768a-4e8d-ae75-cd8e289c538b {{(pid=86875) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:44:00 devstack cinder-volume[86875]: INFO cinder.image.image_utils [None req-89dda154-6fad-4c6e-bf2b-c9a0e18190af tempest-VolumesImageMetadata-111476473 None] Converted 112.00 MB image at 21.91 MB/s Nov 03 07:44:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-89dda154-6fad-4c6e-bf2b-c9a0e18190af tempest-VolumesImageMetadata-111476473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-745905a5-768a-4e8d-ae75-cd8e289c538b 1G {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9bf76e5d-2596-492c-9604-9193a57a750b tempest-TestStampPattern-389950066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771.c0a8a75f-a530-446b-9813-62cc8183dafe {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:00 devstack sudo[103216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-745905a5-768a-4e8d-ae75-cd8e289c538b 1G Nov 03 07:44:00 devstack sudo[103216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:00 devstack sudo[103217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771.c0a8a75f-a530-446b-9813-62cc8183dafe Nov 03 07:44:00 devstack sudo[103217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:01 devstack sudo[103217]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9bf76e5d-2596-492c-9604-9193a57a750b tempest-TestStampPattern-389950066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771.c0a8a75f-a530-446b-9813-62cc8183dafe" returned: 0 in 0.479s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:01 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-9bf76e5d-2596-492c-9604-9193a57a750b tempest-TestStampPattern-389950066 None] Lock "cinder-quobyte-c0a8a75f-a530-446b-9813-62cc8183dafe" released by "_delete_snapshot" :: held 2.898s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:01 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-9bf76e5d-2596-492c-9604-9193a57a750b tempest-TestStampPattern-389950066 None] Lock "cinder-quobyte-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771" released by "delete_snapshot" :: held 2.937s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:01 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-9bf76e5d-2596-492c-9604-9193a57a750b tempest-TestStampPattern-389950066 None] Created reservations ['e8750715-68a6-4dfb-b71b-dca7e915c159', '6982f455-f430-4019-aa69-05dd34b33aaf', '3136b14a-13b5-407d-9d31-bbd18d98daf6', '8552a9de-ac61-4eed-8095-0c16ab0e2ebf'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:44:01 devstack sudo[103216]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-89dda154-6fad-4c6e-bf2b-c9a0e18190af tempest-VolumesImageMetadata-111476473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-745905a5-768a-4e8d-ae75-cd8e289c538b 1G" returned: 0 in 0.824s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:01 devstack cinder-volume[86875]: DEBUG cinder.volume.volume_utils [None req-89dda154-6fad-4c6e-bf2b-c9a0e18190af tempest-VolumesImageMetadata-111476473 None] Downloaded image eb68a148-0c9c-4237-9d8d-94a6a7cd87d9 ((None, [{'url': 'file:///opt/stack/data/glance/images/eb68a148-0c9c-4237-9d8d-94a6a7cd87d9', 'metadata': {}}])) to volume 745905a5-768a-4e8d-ae75-cd8e289c538b successfully. {{(pid=86875) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 07:44:01 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-89dda154-6fad-4c6e-bf2b-c9a0e18190af tempest-VolumesImageMetadata-111476473 None] Temporary image eb68a148-0c9c-4237-9d8d-94a6a7cd87d9 for user 3ddfc83d336249289723b8b9645f552d is deleted. {{(pid=86875) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 07:44:01 devstack cinder-volume[86875]: DEBUG cinder.volume.volume_utils [None req-89dda154-6fad-4c6e-bf2b-c9a0e18190af tempest-VolumesImageMetadata-111476473 None] Marking volume 745905a5-768a-4e8d-ae75-cd8e289c538b as bootable. {{(pid=86875) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 07:44:01 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-89dda154-6fad-4c6e-bf2b-c9a0e18190af tempest-VolumesImageMetadata-111476473 None] Copying metadata from image eb68a148-0c9c-4237-9d8d-94a6a7cd87d9 to 745905a5-768a-4e8d-ae75-cd8e289c538b. {{(pid=86875) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 07:44:01 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-89dda154-6fad-4c6e-bf2b-c9a0e18190af tempest-VolumesImageMetadata-111476473 None] Creating volume glance metadata for volume 745905a5-768a-4e8d-ae75-cd8e289c538b backed by image eb68a148-0c9c-4237-9d8d-94a6a7cd87d9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'eb68a148-0c9c-4237-9d8d-94a6a7cd87d9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86875) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 07:44:01 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-9bf76e5d-2596-492c-9604-9193a57a750b tempest-TestStampPattern-389950066 None] Delete snapshot completed successfully. Nov 03 07:44:01 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-9bf76e5d-2596-492c-9604-9193a57a750b tempest-TestStampPattern-389950066 None] Lock "cinder-c0a8a75f-a530-446b-9813-62cc8183dafe-delete_snapshot" released by "delete_snapshot" :: held 3.371s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:01 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-89dda154-6fad-4c6e-bf2b-c9a0e18190af tempest-VolumesImageMetadata-111476473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d87e6d6-bb52-49d9-97ab-cb6074c5de8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-745905a5-768a-4e8d-ae75-cd8e289c538b', 'volume_size': 1, 'image_id': 'eb68a148-0c9c-4237-9d8d-94a6a7cd87d9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eb68a148-0c9c-4237-9d8d-94a6a7cd87d9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c9ace38ee46b42979b3d4c79532bd66e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eb68a148-0c9c-4237-9d8d-94a6a7cd87d9', 'created_at': datetime.datetime(2026, 11, 3, 6, 21, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 21, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eb68a148-0c9c-4237-9d8d-94a6a7cd87d9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:01 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-89dda154-6fad-4c6e-bf2b-c9a0e18190af tempest-VolumesImageMetadata-111476473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (028e1d92-56ac-426e-a935-8d559b4017b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:01 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-89dda154-6fad-4c6e-bf2b-c9a0e18190af tempest-VolumesImageMetadata-111476473 None] Volume volume-745905a5-768a-4e8d-ae75-cd8e289c538b (745905a5-768a-4e8d-ae75-cd8e289c538b): created successfully Nov 03 07:44:01 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-89dda154-6fad-4c6e-bf2b-c9a0e18190af tempest-VolumesImageMetadata-111476473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (028e1d92-56ac-426e-a935-8d559b4017b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:01 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-89dda154-6fad-4c6e-bf2b-c9a0e18190af tempest-VolumesImageMetadata-111476473 None] Flow 'volume_create_manager' (a1b2174f-e062-4acc-a869-146443fc42c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:44:01 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-89dda154-6fad-4c6e-bf2b-c9a0e18190af tempest-VolumesImageMetadata-111476473 None] Created volume successfully. Nov 03 07:44:02 devstack sudo[103164]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-dba78f69-0ae6-44a6-9750-41d6efe31782 tempest-SnapshotDependencyTests-1706728912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf95b8a8-5e11-47a4-af49-a892efdd0237 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0e9a7787-ed00-4c8f-82a2-f19d4ebc8bf3" returned: 0 in 7.668s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:02 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-dba78f69-0ae6-44a6-9750-41d6efe31782 tempest-SnapshotDependencyTests-1706728912 None] Image conversion details: src /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf95b8a8-5e11-47a4-af49-a892efdd0237, size 1024.00 MB, duration 7.68 sec, destination /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0e9a7787-ed00-4c8f-82a2-f19d4ebc8bf3 {{(pid=86875) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:44:02 devstack cinder-volume[86875]: INFO cinder.image.image_utils [None req-dba78f69-0ae6-44a6-9750-41d6efe31782 tempest-SnapshotDependencyTests-1706728912 None] Converted 1024.00 MB image at 133.41 MB/s Nov 03 07:44:02 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-dba78f69-0ae6-44a6-9750-41d6efe31782 tempest-SnapshotDependencyTests-1706728912 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0e9a7787-ed00-4c8f-82a2-f19d4ebc8bf3 is being set with open permissions: ugo+rw Nov 03 07:44:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-dba78f69-0ae6-44a6-9750-41d6efe31782 tempest-SnapshotDependencyTests-1706728912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0e9a7787-ed00-4c8f-82a2-f19d4ebc8bf3 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:02 devstack sudo[103224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0e9a7787-ed00-4c8f-82a2-f19d4ebc8bf3 Nov 03 07:44:02 devstack sudo[103224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:03 devstack sudo[103224]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-dba78f69-0ae6-44a6-9750-41d6efe31782 tempest-SnapshotDependencyTests-1706728912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0e9a7787-ed00-4c8f-82a2-f19d4ebc8bf3" returned: 0 in 0.446s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:03 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-dba78f69-0ae6-44a6-9750-41d6efe31782 tempest-SnapshotDependencyTests-1706728912 None] Lock "cinder-quobyte-0e9a7787-ed00-4c8f-82a2-f19d4ebc8bf3" released by "_copy_volume_from_snapshot" :: held 9.308s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:03 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-dba78f69-0ae6-44a6-9750-41d6efe31782 tempest-SnapshotDependencyTests-1706728912 None] Lock "cinder-quobyte-fd213bbf-575a-4c76-952f-73bcff026964-0e9a7787-ed00-4c8f-82a2-f19d4ebc8bf3" released by "_create_volume_from_snapshot" :: held 9.427s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-dba78f69-0ae6-44a6-9750-41d6efe31782 tempest-SnapshotDependencyTests-1706728912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.454s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:03 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-dba78f69-0ae6-44a6-9750-41d6efe31782 tempest-SnapshotDependencyTests-1706728912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c020e6d5-7faa-45ca-b225-3cdf450eab70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e9a7787-ed00-4c8f-82a2-f19d4ebc8bf3', 'volume_size': 1, 'snapshot_id': 'fd213bbf-575a-4c76-952f-73bcff026964'}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:03 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-dba78f69-0ae6-44a6-9750-41d6efe31782 tempest-SnapshotDependencyTests-1706728912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51a77312-5a01-4037-b79c-20bc0b45e9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:03 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-dba78f69-0ae6-44a6-9750-41d6efe31782 tempest-SnapshotDependencyTests-1706728912 None] Volume volume-0e9a7787-ed00-4c8f-82a2-f19d4ebc8bf3 (0e9a7787-ed00-4c8f-82a2-f19d4ebc8bf3): created successfully Nov 03 07:44:03 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-dba78f69-0ae6-44a6-9750-41d6efe31782 tempest-SnapshotDependencyTests-1706728912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51a77312-5a01-4037-b79c-20bc0b45e9da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:03 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-dba78f69-0ae6-44a6-9750-41d6efe31782 tempest-SnapshotDependencyTests-1706728912 None] Flow 'volume_create_manager' (9ec72cc1-2bb3-436b-b08e-e75b8a24ab09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:44:03 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-dba78f69-0ae6-44a6-9750-41d6efe31782 tempest-SnapshotDependencyTests-1706728912 None] Created volume successfully. Nov 03 07:44:03 devstack cinder-volume[86875]: DEBUG oslo_service.periodic_task [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86875) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:44:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:44:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:44:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:03 devstack sudo[103235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:44:03 devstack sudo[103235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:03 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-6af74ae7-8576-414b-9d6d-6720cf4c2ecc tempest-VolumesImageMetadata-111476473 None] Acquiring lock "cinder-745905a5-768a-4e8d-ae75-cd8e289c538b-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:03 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-6af74ae7-8576-414b-9d6d-6720cf4c2ecc tempest-VolumesImageMetadata-111476473 None] Lock "cinder-745905a5-768a-4e8d-ae75-cd8e289c538b-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:04 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-6af74ae7-8576-414b-9d6d-6720cf4c2ecc tempest-VolumesImageMetadata-111476473 None] Acquiring lock "cinder-quobyte-745905a5-768a-4e8d-ae75-cd8e289c538b" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:04 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-6af74ae7-8576-414b-9d6d-6720cf4c2ecc tempest-VolumesImageMetadata-111476473 None] Lock "cinder-quobyte-745905a5-768a-4e8d-ae75-cd8e289c538b" acquired by "delete_volume" :: waited 0.045s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:04 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1a1438-fe1e-4299-883e-573d3fdf7627]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6af74ae7-8576-414b-9d6d-6720cf4c2ecc tempest-VolumesImageMetadata-111476473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-745905a5-768a-4e8d-ae75-cd8e289c538b {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:04 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-410991ab-357b-425b-b49c-db3e2023da3e tempest-SnapshotDependencyTests-1706728912 None] Acquiring lock "cinder-fd213bbf-575a-4c76-952f-73bcff026964-delete_snapshot" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:04 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-410991ab-357b-425b-b49c-db3e2023da3e tempest-SnapshotDependencyTests-1706728912 None] Lock "cinder-fd213bbf-575a-4c76-952f-73bcff026964-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:04 devstack sudo[103235]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:04 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-410991ab-357b-425b-b49c-db3e2023da3e tempest-SnapshotDependencyTests-1706728912 None] Acquiring lock "cinder-quobyte-cf95b8a8-5e11-47a4-af49-a892efdd0237" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.654s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:04 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:44:04 devstack cinder-volume[86875]: DEBUG oslo_service.periodic_task [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running periodic task VolumeManager._thread_info {{(pid=86875) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:44:04 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] thread count: 28 {{(pid=86875) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:44:04 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] thread info: [<_MainThread(MainThread, started 125626325639296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86875) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:44:04 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-410991ab-357b-425b-b49c-db3e2023da3e tempest-SnapshotDependencyTests-1706728912 None] Lock "cinder-quobyte-cf95b8a8-5e11-47a4-af49-a892efdd0237" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:04 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-410991ab-357b-425b-b49c-db3e2023da3e tempest-SnapshotDependencyTests-1706728912 None] Acquiring lock "cinder-quobyte-fd213bbf-575a-4c76-952f-73bcff026964" by "_delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:04 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-410991ab-357b-425b-b49c-db3e2023da3e tempest-SnapshotDependencyTests-1706728912 None] Lock "cinder-quobyte-fd213bbf-575a-4c76-952f-73bcff026964" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:04 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-410991ab-357b-425b-b49c-db3e2023da3e tempest-SnapshotDependencyTests-1706728912 None] Deleting offline snapshot fd213bbf-575a-4c76-952f-73bcff026964 of volume cf95b8a8-5e11-47a4-af49-a892efdd0237 {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:44:04 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-410991ab-357b-425b-b49c-db3e2023da3e tempest-SnapshotDependencyTests-1706728912 None] snapshot_file for this snap is: volume-cf95b8a8-5e11-47a4-af49-a892efdd0237.fd213bbf-575a-4c76-952f-73bcff026964 {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:44:04 devstack sudo[103253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-745905a5-768a-4e8d-ae75-cd8e289c538b Nov 03 07:44:04 devstack sudo[103253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:04 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[2174c99a-4e60-4d52-84df-289ad16a8ee0]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-410991ab-357b-425b-b49c-db3e2023da3e tempest-SnapshotDependencyTests-1706728912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf95b8a8-5e11-47a4-af49-a892efdd0237.fd213bbf-575a-4c76-952f-73bcff026964 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:04 devstack sudo[103256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf95b8a8-5e11-47a4-af49-a892efdd0237.fd213bbf-575a-4c76-952f-73bcff026964 Nov 03 07:44:04 devstack sudo[103256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:04 devstack sudo[103253]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6af74ae7-8576-414b-9d6d-6720cf4c2ecc tempest-VolumesImageMetadata-111476473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-745905a5-768a-4e8d-ae75-cd8e289c538b" returned: 0 in 0.584s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6af74ae7-8576-414b-9d6d-6720cf4c2ecc tempest-VolumesImageMetadata-111476473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-745905a5-768a-4e8d-ae75-cd8e289c538b {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:04 devstack sudo[103264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-745905a5-768a-4e8d-ae75-cd8e289c538b Nov 03 07:44:04 devstack sudo[103264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:04 devstack sudo[103256]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-410991ab-357b-425b-b49c-db3e2023da3e tempest-SnapshotDependencyTests-1706728912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf95b8a8-5e11-47a4-af49-a892efdd0237.fd213bbf-575a-4c76-952f-73bcff026964" returned: 0 in 0.515s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:04 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-410991ab-357b-425b-b49c-db3e2023da3e tempest-SnapshotDependencyTests-1706728912 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf95b8a8-5e11-47a4-af49-a892efdd0237(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:44:04 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[132f0534-4008-4ac8-b40d-f453ad2943c6]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-410991ab-357b-425b-b49c-db3e2023da3e tempest-SnapshotDependencyTests-1706728912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf95b8a8-5e11-47a4-af49-a892efdd0237 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:05 devstack sudo[103268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf95b8a8-5e11-47a4-af49-a892efdd0237 Nov 03 07:44:05 devstack sudo[103268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:05 devstack sudo[103264]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6af74ae7-8576-414b-9d6d-6720cf4c2ecc tempest-VolumesImageMetadata-111476473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-745905a5-768a-4e8d-ae75-cd8e289c538b" returned: 0 in 0.363s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:05 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-6af74ae7-8576-414b-9d6d-6720cf4c2ecc tempest-VolumesImageMetadata-111476473 None] Lock "cinder-quobyte-745905a5-768a-4e8d-ae75-cd8e289c538b" released by "delete_volume" :: held 1.057s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:05 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-6af74ae7-8576-414b-9d6d-6720cf4c2ecc tempest-VolumesImageMetadata-111476473 None] Created reservations ['9fe82c6d-cefa-4594-8d38-329ac8e286f7', 'ad9923a5-3f27-4da4-91d2-9dcc0691b1e9', '17602260-860d-4558-840d-439ec7ef6f54', '94dfcf2f-6286-4654-92fd-cde4f7363a9f'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:44:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-6af74ae7-8576-414b-9d6d-6720cf4c2ecc tempest-VolumesImageMetadata-111476473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-6af74ae7-8576-414b-9d6d-6720cf4c2ecc tempest-VolumesImageMetadata-111476473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:05 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-6af74ae7-8576-414b-9d6d-6720cf4c2ecc tempest-VolumesImageMetadata-111476473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:44:05 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-6af74ae7-8576-414b-9d6d-6720cf4c2ecc tempest-VolumesImageMetadata-111476473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:44:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-6af74ae7-8576-414b-9d6d-6720cf4c2ecc tempest-VolumesImageMetadata-111476473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6af74ae7-8576-414b-9d6d-6720cf4c2ecc tempest-VolumesImageMetadata-111476473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:05 devstack sudo[103274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:44:05 devstack sudo[103274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:05 devstack sudo[103268]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-410991ab-357b-425b-b49c-db3e2023da3e tempest-SnapshotDependencyTests-1706728912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf95b8a8-5e11-47a4-af49-a892efdd0237" returned: 0 in 0.801s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-410991ab-357b-425b-b49c-db3e2023da3e tempest-SnapshotDependencyTests-1706728912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf95b8a8-5e11-47a4-af49-a892efdd0237.fd213bbf-575a-4c76-952f-73bcff026964 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:05 devstack sudo[103277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf95b8a8-5e11-47a4-af49-a892efdd0237.fd213bbf-575a-4c76-952f-73bcff026964 Nov 03 07:44:05 devstack sudo[103277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:05 devstack sudo[103274]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6af74ae7-8576-414b-9d6d-6720cf4c2ecc tempest-VolumesImageMetadata-111476473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.284s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:05 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-6af74ae7-8576-414b-9d6d-6720cf4c2ecc tempest-VolumesImageMetadata-111476473 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:44:05 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-6af74ae7-8576-414b-9d6d-6720cf4c2ecc tempest-VolumesImageMetadata-111476473 None] Deleted volume successfully. Nov 03 07:44:05 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-6af74ae7-8576-414b-9d6d-6720cf4c2ecc tempest-VolumesImageMetadata-111476473 None] Lock "cinder-745905a5-768a-4e8d-ae75-cd8e289c538b-delete_volume" released by "delete_volume" :: held 1.903s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:06 devstack sudo[103277]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-410991ab-357b-425b-b49c-db3e2023da3e tempest-SnapshotDependencyTests-1706728912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf95b8a8-5e11-47a4-af49-a892efdd0237.fd213bbf-575a-4c76-952f-73bcff026964" returned: 0 in 0.472s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-410991ab-357b-425b-b49c-db3e2023da3e tempest-SnapshotDependencyTests-1706728912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf95b8a8-5e11-47a4-af49-a892efdd0237.fd213bbf-575a-4c76-952f-73bcff026964 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:06 devstack sudo[103283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf95b8a8-5e11-47a4-af49-a892efdd0237.fd213bbf-575a-4c76-952f-73bcff026964 Nov 03 07:44:06 devstack sudo[103283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:06 devstack sudo[103283]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-410991ab-357b-425b-b49c-db3e2023da3e tempest-SnapshotDependencyTests-1706728912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf95b8a8-5e11-47a4-af49-a892efdd0237.fd213bbf-575a-4c76-952f-73bcff026964" returned: 0 in 0.317s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:06 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-511af189-c297-4681-84c6-f0ef8b798088 tempest-TestStampPattern-389950066 None] Acquiring lock "cinder-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:06 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-410991ab-357b-425b-b49c-db3e2023da3e tempest-SnapshotDependencyTests-1706728912 None] Lock "cinder-quobyte-fd213bbf-575a-4c76-952f-73bcff026964" released by "_delete_snapshot" :: held 2.274s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:06 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-410991ab-357b-425b-b49c-db3e2023da3e tempest-SnapshotDependencyTests-1706728912 None] Lock "cinder-quobyte-cf95b8a8-5e11-47a4-af49-a892efdd0237" released by "delete_snapshot" :: held 2.313s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:06 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-511af189-c297-4681-84c6-f0ef8b798088 tempest-TestStampPattern-389950066 None] Lock "cinder-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:06 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-511af189-c297-4681-84c6-f0ef8b798088 tempest-TestStampPattern-389950066 None] Acquiring lock "cinder-quobyte-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:06 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-511af189-c297-4681-84c6-f0ef8b798088 tempest-TestStampPattern-389950066 None] Lock "cinder-quobyte-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771" acquired by "delete_volume" :: waited 0.026s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:06 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-410991ab-357b-425b-b49c-db3e2023da3e tempest-SnapshotDependencyTests-1706728912 None] Created reservations ['d44885ee-b2ef-4b47-951a-952b246e376b', 'a379fab9-6aef-46ae-89b9-8b0c460196c9', '23455f4a-5767-4a93-9f96-534d898c97c4', 'b4b8e244-7aa7-4226-b13c-aabbeb98c8ca'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:44:06 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ff2e64-7cb8-46be-b882-dd42e1725ac8]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-511af189-c297-4681-84c6-f0ef8b798088 tempest-TestStampPattern-389950066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:06 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-410991ab-357b-425b-b49c-db3e2023da3e tempest-SnapshotDependencyTests-1706728912 None] Delete snapshot completed successfully. Nov 03 07:44:06 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-410991ab-357b-425b-b49c-db3e2023da3e tempest-SnapshotDependencyTests-1706728912 None] Lock "cinder-fd213bbf-575a-4c76-952f-73bcff026964-delete_snapshot" released by "delete_snapshot" :: held 2.581s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:06 devstack sudo[103286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771 Nov 03 07:44:06 devstack sudo[103286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:07 devstack sudo[103286]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-511af189-c297-4681-84c6-f0ef8b798088 tempest-TestStampPattern-389950066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771" returned: 0 in 0.424s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-511af189-c297-4681-84c6-f0ef8b798088 tempest-TestStampPattern-389950066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:07 devstack sudo[103291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771 Nov 03 07:44:07 devstack sudo[103291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:07 devstack sudo[103291]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-511af189-c297-4681-84c6-f0ef8b798088 tempest-TestStampPattern-389950066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771" returned: 0 in 0.268s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:07 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-511af189-c297-4681-84c6-f0ef8b798088 tempest-TestStampPattern-389950066 None] Lock "cinder-quobyte-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771" released by "delete_volume" :: held 0.811s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:07 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a76ac0d1-67ed-46dc-8885-2acde915970a tempest-SnapshotDependencyTests-1706728912 None] Acquiring lock "cinder-cf95b8a8-5e11-47a4-af49-a892efdd0237-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:07 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a76ac0d1-67ed-46dc-8885-2acde915970a tempest-SnapshotDependencyTests-1706728912 None] Lock "cinder-cf95b8a8-5e11-47a4-af49-a892efdd0237-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:07 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-511af189-c297-4681-84c6-f0ef8b798088 tempest-TestStampPattern-389950066 None] Created reservations ['70b98712-3d40-4b18-bf11-ecdccdf799c9', 'fa5a84f0-8dc6-45f8-a8d6-20150e3c947d', 'ea85299b-467e-4da2-89f0-a1932c31d633', 'af3097fd-ede5-4a69-b3c8-3ebf4f55252f'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:44:07 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a76ac0d1-67ed-46dc-8885-2acde915970a tempest-SnapshotDependencyTests-1706728912 None] Acquiring lock "cinder-quobyte-cf95b8a8-5e11-47a4-af49-a892efdd0237" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:07 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a76ac0d1-67ed-46dc-8885-2acde915970a tempest-SnapshotDependencyTests-1706728912 None] Lock "cinder-quobyte-cf95b8a8-5e11-47a4-af49-a892efdd0237" acquired by "delete_volume" :: waited 0.032s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:07 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0523eb0-6444-48f9-a829-492691371488]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a76ac0d1-67ed-46dc-8885-2acde915970a tempest-SnapshotDependencyTests-1706728912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf95b8a8-5e11-47a4-af49-a892efdd0237 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-511af189-c297-4681-84c6-f0ef8b798088 tempest-TestStampPattern-389950066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-511af189-c297-4681-84c6-f0ef8b798088 tempest-TestStampPattern-389950066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:07 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-511af189-c297-4681-84c6-f0ef8b798088 tempest-TestStampPattern-389950066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:44:07 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-511af189-c297-4681-84c6-f0ef8b798088 tempest-TestStampPattern-389950066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:44:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-511af189-c297-4681-84c6-f0ef8b798088 tempest-TestStampPattern-389950066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-511af189-c297-4681-84c6-f0ef8b798088 tempest-TestStampPattern-389950066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:07 devstack sudo[103294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf95b8a8-5e11-47a4-af49-a892efdd0237 Nov 03 07:44:07 devstack sudo[103294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:07 devstack sudo[103295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:44:07 devstack sudo[103295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:08 devstack sudo[103294]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a76ac0d1-67ed-46dc-8885-2acde915970a tempest-SnapshotDependencyTests-1706728912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf95b8a8-5e11-47a4-af49-a892efdd0237" returned: 0 in 0.549s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:08 devstack sudo[103295]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a76ac0d1-67ed-46dc-8885-2acde915970a tempest-SnapshotDependencyTests-1706728912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf95b8a8-5e11-47a4-af49-a892efdd0237 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-511af189-c297-4681-84c6-f0ef8b798088 tempest-TestStampPattern-389950066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.464s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:08 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-511af189-c297-4681-84c6-f0ef8b798088 tempest-TestStampPattern-389950066 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:44:08 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-511af189-c297-4681-84c6-f0ef8b798088 tempest-TestStampPattern-389950066 None] Deleted volume successfully. Nov 03 07:44:08 devstack sudo[103303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf95b8a8-5e11-47a4-af49-a892efdd0237 Nov 03 07:44:08 devstack sudo[103303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:08 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-511af189-c297-4681-84c6-f0ef8b798088 tempest-TestStampPattern-389950066 None] Lock "cinder-9118d4a4-1e9c-4c31-b4e8-9b48cad4a771-delete_volume" released by "delete_volume" :: held 1.701s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:08 devstack sudo[103303]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a76ac0d1-67ed-46dc-8885-2acde915970a tempest-SnapshotDependencyTests-1706728912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cf95b8a8-5e11-47a4-af49-a892efdd0237" returned: 0 in 0.335s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:08 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a76ac0d1-67ed-46dc-8885-2acde915970a tempest-SnapshotDependencyTests-1706728912 None] Lock "cinder-quobyte-cf95b8a8-5e11-47a4-af49-a892efdd0237" released by "delete_volume" :: held 0.977s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:08 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-a76ac0d1-67ed-46dc-8885-2acde915970a tempest-SnapshotDependencyTests-1706728912 None] Created reservations ['187b6b03-5016-48df-93ab-796c6d85225f', 'f59ad1aa-557d-4497-b390-e77216c78cbc', '8fc7d018-880b-4b1b-a166-a38e2a18899e', 'd49edec1-ad01-42ac-bcc8-b1b19417c568'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:44:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a76ac0d1-67ed-46dc-8885-2acde915970a tempest-SnapshotDependencyTests-1706728912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a76ac0d1-67ed-46dc-8885-2acde915970a tempest-SnapshotDependencyTests-1706728912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:08 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a76ac0d1-67ed-46dc-8885-2acde915970a tempest-SnapshotDependencyTests-1706728912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:44:08 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a76ac0d1-67ed-46dc-8885-2acde915970a tempest-SnapshotDependencyTests-1706728912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:44:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a76ac0d1-67ed-46dc-8885-2acde915970a tempest-SnapshotDependencyTests-1706728912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a76ac0d1-67ed-46dc-8885-2acde915970a tempest-SnapshotDependencyTests-1706728912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:08 devstack sudo[103306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:44:08 devstack sudo[103306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:09 devstack sudo[103306]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a76ac0d1-67ed-46dc-8885-2acde915970a tempest-SnapshotDependencyTests-1706728912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.289s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:09 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-a76ac0d1-67ed-46dc-8885-2acde915970a tempest-SnapshotDependencyTests-1706728912 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:44:09 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-a76ac0d1-67ed-46dc-8885-2acde915970a tempest-SnapshotDependencyTests-1706728912 None] Deleted volume successfully. Nov 03 07:44:09 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a76ac0d1-67ed-46dc-8885-2acde915970a tempest-SnapshotDependencyTests-1706728912 None] Lock "cinder-cf95b8a8-5e11-47a4-af49-a892efdd0237-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:09 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-1667a54d-4a47-4bc4-820c-ed6e58118f85 tempest-SnapshotDependencyTests-1706728912 None] Acquiring lock "cinder-0e9a7787-ed00-4c8f-82a2-f19d4ebc8bf3-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:09 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-1667a54d-4a47-4bc4-820c-ed6e58118f85 tempest-SnapshotDependencyTests-1706728912 None] Lock "cinder-0e9a7787-ed00-4c8f-82a2-f19d4ebc8bf3-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:09 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-1667a54d-4a47-4bc4-820c-ed6e58118f85 tempest-SnapshotDependencyTests-1706728912 None] Acquiring lock "cinder-quobyte-0e9a7787-ed00-4c8f-82a2-f19d4ebc8bf3" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:09 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-1667a54d-4a47-4bc4-820c-ed6e58118f85 tempest-SnapshotDependencyTests-1706728912 None] Lock "cinder-quobyte-0e9a7787-ed00-4c8f-82a2-f19d4ebc8bf3" acquired by "delete_volume" :: waited 0.014s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:09 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ed8e30-6d26-416c-ae7d-ccff41238c4f]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1667a54d-4a47-4bc4-820c-ed6e58118f85 tempest-SnapshotDependencyTests-1706728912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0e9a7787-ed00-4c8f-82a2-f19d4ebc8bf3 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:10 devstack sudo[103310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0e9a7787-ed00-4c8f-82a2-f19d4ebc8bf3 Nov 03 07:44:10 devstack sudo[103310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:10 devstack sudo[103310]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1667a54d-4a47-4bc4-820c-ed6e58118f85 tempest-SnapshotDependencyTests-1706728912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0e9a7787-ed00-4c8f-82a2-f19d4ebc8bf3" returned: 0 in 0.471s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1667a54d-4a47-4bc4-820c-ed6e58118f85 tempest-SnapshotDependencyTests-1706728912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0e9a7787-ed00-4c8f-82a2-f19d4ebc8bf3 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:10 devstack sudo[103316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0e9a7787-ed00-4c8f-82a2-f19d4ebc8bf3 Nov 03 07:44:10 devstack sudo[103316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:10 devstack sudo[103316]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1667a54d-4a47-4bc4-820c-ed6e58118f85 tempest-SnapshotDependencyTests-1706728912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-0e9a7787-ed00-4c8f-82a2-f19d4ebc8bf3" returned: 0 in 0.292s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:10 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-1667a54d-4a47-4bc4-820c-ed6e58118f85 tempest-SnapshotDependencyTests-1706728912 None] Lock "cinder-quobyte-0e9a7787-ed00-4c8f-82a2-f19d4ebc8bf3" released by "delete_volume" :: held 0.816s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:10 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-1667a54d-4a47-4bc4-820c-ed6e58118f85 tempest-SnapshotDependencyTests-1706728912 None] Created reservations ['652ee12e-a566-4093-bb58-64ea132a4115', '430f733e-cdcd-4dfe-8cca-ef66432dd1da', 'c4c909b1-1fe6-4f6e-937e-7cd9c45f939a', '2f94feda-e451-4d9a-a1e5-df93ea31dd52'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:44:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-1667a54d-4a47-4bc4-820c-ed6e58118f85 tempest-SnapshotDependencyTests-1706728912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-1667a54d-4a47-4bc4-820c-ed6e58118f85 tempest-SnapshotDependencyTests-1706728912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:10 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-1667a54d-4a47-4bc4-820c-ed6e58118f85 tempest-SnapshotDependencyTests-1706728912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:44:10 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-1667a54d-4a47-4bc4-820c-ed6e58118f85 tempest-SnapshotDependencyTests-1706728912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:44:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-1667a54d-4a47-4bc4-820c-ed6e58118f85 tempest-SnapshotDependencyTests-1706728912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1667a54d-4a47-4bc4-820c-ed6e58118f85 tempest-SnapshotDependencyTests-1706728912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:10 devstack sudo[103319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:44:10 devstack sudo[103319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:11 devstack sudo[103319]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1667a54d-4a47-4bc4-820c-ed6e58118f85 tempest-SnapshotDependencyTests-1706728912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.334s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:11 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-1667a54d-4a47-4bc4-820c-ed6e58118f85 tempest-SnapshotDependencyTests-1706728912 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:44:11 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-1667a54d-4a47-4bc4-820c-ed6e58118f85 tempest-SnapshotDependencyTests-1706728912 None] Deleted volume successfully. Nov 03 07:44:11 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-1667a54d-4a47-4bc4-820c-ed6e58118f85 tempest-SnapshotDependencyTests-1706728912 None] Lock "cinder-0e9a7787-ed00-4c8f-82a2-f19d4ebc8bf3-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:16 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-afcdce81-c3ee-4f54-987e-17fc4457bfd7 tempest-VolumesDeleteCascade-1749971429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:44:16 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-afcdce81-c3ee-4f54-987e-17fc4457bfd7 tempest-VolumesDeleteCascade-1749971429 None] Flow 'volume_create_manager' (e5d3f88c-14da-4728-b106-eee3775db583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:44:16 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-afcdce81-c3ee-4f54-987e-17fc4457bfd7 tempest-VolumesDeleteCascade-1749971429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6d7155c-8d6c-4aca-af9a-31e422069b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:16 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-afcdce81-c3ee-4f54-987e-17fc4457bfd7 tempest-VolumesDeleteCascade-1749971429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6d7155c-8d6c-4aca-af9a-31e422069b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:44:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1428081919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83f7c08e-2588-40b9-a043-9adbd2b582e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='110f99a92f104579b60e13555a6a9fd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:44:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:44:17Z,use_quota=True,user_id='65bb1d04b38a4c51be24a06b0598c17e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:16 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-afcdce81-c3ee-4f54-987e-17fc4457bfd7 tempest-VolumesDeleteCascade-1749971429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (946733b3-d111-400f-abb0-6ccb5992f2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:16 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-afcdce81-c3ee-4f54-987e-17fc4457bfd7 tempest-VolumesDeleteCascade-1749971429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (946733b3-d111-400f-abb0-6ccb5992f2a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:16 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-afcdce81-c3ee-4f54-987e-17fc4457bfd7 tempest-VolumesDeleteCascade-1749971429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9dd78ad-3544-40eb-b4ee-eed8c0ba87e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:16 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-afcdce81-c3ee-4f54-987e-17fc4457bfd7 tempest-VolumesDeleteCascade-1749971429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9dd78ad-3544-40eb-b4ee-eed8c0ba87e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83f7c08e-2588-40b9-a043-9adbd2b582e7', 'volume_name': 'volume-83f7c08e-2588-40b9-a043-9adbd2b582e7', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:16 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-afcdce81-c3ee-4f54-987e-17fc4457bfd7 tempest-VolumesDeleteCascade-1749971429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06db1c86-228a-40cc-b2da-93fbaf067c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:16 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-afcdce81-c3ee-4f54-987e-17fc4457bfd7 tempest-VolumesDeleteCascade-1749971429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06db1c86-228a-40cc-b2da-93fbaf067c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:16 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-afcdce81-c3ee-4f54-987e-17fc4457bfd7 tempest-VolumesDeleteCascade-1749971429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10e39c12-a977-4688-88b8-061bfec2b823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:16 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-afcdce81-c3ee-4f54-987e-17fc4457bfd7 tempest-VolumesDeleteCascade-1749971429 None] Volume 83f7c08e-2588-40b9-a043-9adbd2b582e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83f7c08e-2588-40b9-a043-9adbd2b582e7', 'volume_size': 1} Nov 03 07:44:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-afcdce81-c3ee-4f54-987e-17fc4457bfd7 tempest-VolumesDeleteCascade-1749971429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-afcdce81-c3ee-4f54-987e-17fc4457bfd7 tempest-VolumesDeleteCascade-1749971429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:16 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-afcdce81-c3ee-4f54-987e-17fc4457bfd7 tempest-VolumesDeleteCascade-1749971429 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:44:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1428081919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83f7c08e-2588-40b9-a043-9adbd2b582e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='110f99a92f104579b60e13555a6a9fd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:44:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:44:17Z,use_quota=True,user_id='65bb1d04b38a4c51be24a06b0598c17e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:44:16 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-afcdce81-c3ee-4f54-987e-17fc4457bfd7 tempest-VolumesDeleteCascade-1749971429 None] Creating volume 83f7c08e-2588-40b9-a043-9adbd2b582e7 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:44:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-afcdce81-c3ee-4f54-987e-17fc4457bfd7 tempest-VolumesDeleteCascade-1749971429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-afcdce81-c3ee-4f54-987e-17fc4457bfd7 tempest-VolumesDeleteCascade-1749971429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:16 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-afcdce81-c3ee-4f54-987e-17fc4457bfd7 tempest-VolumesDeleteCascade-1749971429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:44:16 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-afcdce81-c3ee-4f54-987e-17fc4457bfd7 tempest-VolumesDeleteCascade-1749971429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:44:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-afcdce81-c3ee-4f54-987e-17fc4457bfd7 tempest-VolumesDeleteCascade-1749971429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:16 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-afcdce81-c3ee-4f54-987e-17fc4457bfd7 tempest-VolumesDeleteCascade-1749971429 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:44:16 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-afcdce81-c3ee-4f54-987e-17fc4457bfd7 tempest-VolumesDeleteCascade-1749971429 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:44:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-afcdce81-c3ee-4f54-987e-17fc4457bfd7 tempest-VolumesDeleteCascade-1749971429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:16 devstack sudo[103327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7 1073741824 Nov 03 07:44:16 devstack sudo[103327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:17 devstack sudo[103327]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-afcdce81-c3ee-4f54-987e-17fc4457bfd7 tempest-VolumesDeleteCascade-1749971429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7 1073741824" returned: 0 in 0.579s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-afcdce81-c3ee-4f54-987e-17fc4457bfd7 tempest-VolumesDeleteCascade-1749971429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:17 devstack sudo[103339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7 Nov 03 07:44:17 devstack sudo[103339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:17 devstack sudo[103339]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-afcdce81-c3ee-4f54-987e-17fc4457bfd7 tempest-VolumesDeleteCascade-1749971429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7" returned: 0 in 0.362s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:17 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-afcdce81-c3ee-4f54-987e-17fc4457bfd7 tempest-VolumesDeleteCascade-1749971429 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:44:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-afcdce81-c3ee-4f54-987e-17fc4457bfd7 tempest-VolumesDeleteCascade-1749971429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:17 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-afcdce81-c3ee-4f54-987e-17fc4457bfd7 tempest-VolumesDeleteCascade-1749971429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10e39c12-a977-4688-88b8-061bfec2b823) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83f7c08e-2588-40b9-a043-9adbd2b582e7', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:17 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-afcdce81-c3ee-4f54-987e-17fc4457bfd7 tempest-VolumesDeleteCascade-1749971429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2462899f-589c-4712-adcb-c42897f293fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:17 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-afcdce81-c3ee-4f54-987e-17fc4457bfd7 tempest-VolumesDeleteCascade-1749971429 None] Volume volume-83f7c08e-2588-40b9-a043-9adbd2b582e7 (83f7c08e-2588-40b9-a043-9adbd2b582e7): created successfully Nov 03 07:44:17 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-afcdce81-c3ee-4f54-987e-17fc4457bfd7 tempest-VolumesDeleteCascade-1749971429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2462899f-589c-4712-adcb-c42897f293fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:17 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-afcdce81-c3ee-4f54-987e-17fc4457bfd7 tempest-VolumesDeleteCascade-1749971429 None] Flow 'volume_create_manager' (e5d3f88c-14da-4728-b106-eee3775db583) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:44:17 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-afcdce81-c3ee-4f54-987e-17fc4457bfd7 tempest-VolumesDeleteCascade-1749971429 None] Created volume successfully. Nov 03 07:44:19 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-169070c0-9ba1-4e2a-9de9-140502004c17 tempest-VolumesDeleteCascade-1749971429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:19 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-169070c0-9ba1-4e2a-9de9-140502004c17 tempest-VolumesDeleteCascade-1749971429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:19 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-169070c0-9ba1-4e2a-9de9-140502004c17 tempest-VolumesDeleteCascade-1749971429 None] Creating offline snapshot 77e48194-dd14-4a0d-b009-30b6a2e68ab8 of volume 83f7c08e-2588-40b9-a043-9adbd2b582e7 {{(pid=86875) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:44:19 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[40839d63-cdaa-43e1-8ff9-9f8989253f75]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:19 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-169070c0-9ba1-4e2a-9de9-140502004c17 tempest-VolumesDeleteCascade-1749971429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:19 devstack sudo[103344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7 Nov 03 07:44:19 devstack sudo[103344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:19 devstack sudo[103344]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:19 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-169070c0-9ba1-4e2a-9de9-140502004c17 tempest-VolumesDeleteCascade-1749971429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7" returned: 0 in 0.443s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:19 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-169070c0-9ba1-4e2a-9de9-140502004c17 tempest-VolumesDeleteCascade-1749971429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7.77e48194-dd14-4a0d-b009-30b6a2e68ab8 1G {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:19 devstack sudo[103349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7.77e48194-dd14-4a0d-b009-30b6a2e68ab8 1G Nov 03 07:44:19 devstack sudo[103349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:20 devstack sudo[103349]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-169070c0-9ba1-4e2a-9de9-140502004c17 tempest-VolumesDeleteCascade-1749971429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7.77e48194-dd14-4a0d-b009-30b6a2e68ab8 1G" returned: 0 in 0.551s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-169070c0-9ba1-4e2a-9de9-140502004c17 tempest-VolumesDeleteCascade-1749971429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83f7c08e-2588-40b9-a043-9adbd2b582e7 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7.77e48194-dd14-4a0d-b009-30b6a2e68ab8 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:20 devstack sudo[103356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83f7c08e-2588-40b9-a043-9adbd2b582e7 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7.77e48194-dd14-4a0d-b009-30b6a2e68ab8 Nov 03 07:44:20 devstack sudo[103356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:20 devstack sudo[103356]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-169070c0-9ba1-4e2a-9de9-140502004c17 tempest-VolumesDeleteCascade-1749971429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83f7c08e-2588-40b9-a043-9adbd2b582e7 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7.77e48194-dd14-4a0d-b009-30b6a2e68ab8" returned: 0 in 0.324s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:20 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-169070c0-9ba1-4e2a-9de9-140502004c17 tempest-VolumesDeleteCascade-1749971429 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7.77e48194-dd14-4a0d-b009-30b6a2e68ab8 is being set with open permissions: ugo+rw Nov 03 07:44:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-169070c0-9ba1-4e2a-9de9-140502004c17 tempest-VolumesDeleteCascade-1749971429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7.77e48194-dd14-4a0d-b009-30b6a2e68ab8 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:20 devstack sudo[103362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7.77e48194-dd14-4a0d-b009-30b6a2e68ab8 Nov 03 07:44:20 devstack sudo[103362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:20 devstack sudo[103362]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-169070c0-9ba1-4e2a-9de9-140502004c17 tempest-VolumesDeleteCascade-1749971429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7.77e48194-dd14-4a0d-b009-30b6a2e68ab8" returned: 0 in 0.260s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-169070c0-9ba1-4e2a-9de9-140502004c17 tempest-VolumesDeleteCascade-1749971429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:20 devstack sudo[103365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7.info Nov 03 07:44:20 devstack sudo[103365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:21 devstack sudo[103365]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-169070c0-9ba1-4e2a-9de9-140502004c17 tempest-VolumesDeleteCascade-1749971429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7.info" returned: 0 in 0.438s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:21 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-169070c0-9ba1-4e2a-9de9-140502004c17 tempest-VolumesDeleteCascade-1749971429 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7.info is being set with open permissions: ugo+rw Nov 03 07:44:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-169070c0-9ba1-4e2a-9de9-140502004c17 tempest-VolumesDeleteCascade-1749971429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:21 devstack sudo[103368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7.info Nov 03 07:44:21 devstack sudo[103368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:21 devstack sudo[103368]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-169070c0-9ba1-4e2a-9de9-140502004c17 tempest-VolumesDeleteCascade-1749971429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7.info" returned: 0 in 0.285s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-169070c0-9ba1-4e2a-9de9-140502004c17 tempest-VolumesDeleteCascade-1749971429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.428s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:21 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-169070c0-9ba1-4e2a-9de9-140502004c17 tempest-VolumesDeleteCascade-1749971429 None] Create snapshot completed successfully Nov 03 07:44:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-37d33727-dec4-4e21-b703-854be6168d3b tempest-VolumesDeleteCascade-1749971429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-37d33727-dec4-4e21-b703-854be6168d3b tempest-VolumesDeleteCascade-1749971429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:22 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-37d33727-dec4-4e21-b703-854be6168d3b tempest-VolumesDeleteCascade-1749971429 None] Creating offline snapshot f9cf9a9d-a14d-47e7-933d-78ba37c4ec2c of volume 83f7c08e-2588-40b9-a043-9adbd2b582e7 {{(pid=86875) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:44:22 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecabb1f8-15e3-4df2-9f2d-c3f2e3e4e405]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-37d33727-dec4-4e21-b703-854be6168d3b tempest-VolumesDeleteCascade-1749971429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7.77e48194-dd14-4a0d-b009-30b6a2e68ab8 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:22 devstack sudo[103371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7.77e48194-dd14-4a0d-b009-30b6a2e68ab8 Nov 03 07:44:22 devstack sudo[103371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:23 devstack sudo[103371]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-37d33727-dec4-4e21-b703-854be6168d3b tempest-VolumesDeleteCascade-1749971429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7.77e48194-dd14-4a0d-b009-30b6a2e68ab8" returned: 0 in 0.425s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:23 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-37d33727-dec4-4e21-b703-854be6168d3b tempest-VolumesDeleteCascade-1749971429 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83f7c08e-2588-40b9-a043-9adbd2b582e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:44:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-37d33727-dec4-4e21-b703-854be6168d3b tempest-VolumesDeleteCascade-1749971429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7.77e48194-dd14-4a0d-b009-30b6a2e68ab8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7.f9cf9a9d-a14d-47e7-933d-78ba37c4ec2c 1G {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:23 devstack sudo[103378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7.77e48194-dd14-4a0d-b009-30b6a2e68ab8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7.f9cf9a9d-a14d-47e7-933d-78ba37c4ec2c 1G Nov 03 07:44:23 devstack sudo[103378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:23 devstack sudo[103378]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-37d33727-dec4-4e21-b703-854be6168d3b tempest-VolumesDeleteCascade-1749971429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7.77e48194-dd14-4a0d-b009-30b6a2e68ab8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7.f9cf9a9d-a14d-47e7-933d-78ba37c4ec2c 1G" returned: 0 in 0.624s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-37d33727-dec4-4e21-b703-854be6168d3b tempest-VolumesDeleteCascade-1749971429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83f7c08e-2588-40b9-a043-9adbd2b582e7.77e48194-dd14-4a0d-b009-30b6a2e68ab8 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7.f9cf9a9d-a14d-47e7-933d-78ba37c4ec2c {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:23 devstack sudo[103385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83f7c08e-2588-40b9-a043-9adbd2b582e7.77e48194-dd14-4a0d-b009-30b6a2e68ab8 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7.f9cf9a9d-a14d-47e7-933d-78ba37c4ec2c Nov 03 07:44:23 devstack sudo[103385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:24 devstack sudo[103385]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-37d33727-dec4-4e21-b703-854be6168d3b tempest-VolumesDeleteCascade-1749971429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83f7c08e-2588-40b9-a043-9adbd2b582e7.77e48194-dd14-4a0d-b009-30b6a2e68ab8 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7.f9cf9a9d-a14d-47e7-933d-78ba37c4ec2c" returned: 0 in 0.404s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:24 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-37d33727-dec4-4e21-b703-854be6168d3b tempest-VolumesDeleteCascade-1749971429 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7.f9cf9a9d-a14d-47e7-933d-78ba37c4ec2c is being set with open permissions: ugo+rw Nov 03 07:44:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-37d33727-dec4-4e21-b703-854be6168d3b tempest-VolumesDeleteCascade-1749971429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7.f9cf9a9d-a14d-47e7-933d-78ba37c4ec2c {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:24 devstack sudo[103390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7.f9cf9a9d-a14d-47e7-933d-78ba37c4ec2c Nov 03 07:44:24 devstack sudo[103390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:24 devstack sudo[103390]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-37d33727-dec4-4e21-b703-854be6168d3b tempest-VolumesDeleteCascade-1749971429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7.f9cf9a9d-a14d-47e7-933d-78ba37c4ec2c" returned: 0 in 0.317s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-37d33727-dec4-4e21-b703-854be6168d3b tempest-VolumesDeleteCascade-1749971429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.929s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:24 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-37d33727-dec4-4e21-b703-854be6168d3b tempest-VolumesDeleteCascade-1749971429 None] Create snapshot completed successfully Nov 03 07:44:24 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-3023a657-8298-4469-a6c1-71cb587f3b7f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:44:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3023a657-8298-4469-a6c1-71cb587f3b7f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Flow 'volume_create_manager' (af71c807-56ad-475e-9da9-443f5cb188e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:44:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3023a657-8298-4469-a6c1-71cb587f3b7f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6153f55-b816-45bd-aa3d-b7f37d184743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:24 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] Acquiring lock "cinder-83f7c08e-2588-40b9-a043-9adbd2b582e7-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3023a657-8298-4469-a6c1-71cb587f3b7f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6153f55-b816-45bd-aa3d-b7f37d184743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:44:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-612438196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=325e39cf-4c3c-4808-b317-e2731bd93e54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f01afec99b44489a3e46f78af45a63c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:44:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:44:25Z,use_quota=True,user_id='dd9cf42bbe0d420599e937657441b419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3023a657-8298-4469-a6c1-71cb587f3b7f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afb84b73-c4c7-40e3-ab85-aa9757e139db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3023a657-8298-4469-a6c1-71cb587f3b7f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afb84b73-c4c7-40e3-ab85-aa9757e139db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3023a657-8298-4469-a6c1-71cb587f3b7f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cea28e9-2c62-4385-81e3-926f42548346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3023a657-8298-4469-a6c1-71cb587f3b7f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cea28e9-2c62-4385-81e3-926f42548346) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '325e39cf-4c3c-4808-b317-e2731bd93e54', 'volume_name': 'volume-325e39cf-4c3c-4808-b317-e2731bd93e54', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3023a657-8298-4469-a6c1-71cb587f3b7f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16b20687-3ec4-4bcb-9ea7-485c0b398cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3023a657-8298-4469-a6c1-71cb587f3b7f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16b20687-3ec4-4bcb-9ea7-485c0b398cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3023a657-8298-4469-a6c1-71cb587f3b7f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ae68076-fdf6-487d-a2c4-0d2a5afbf893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:24 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-3023a657-8298-4469-a6c1-71cb587f3b7f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Volume 325e39cf-4c3c-4808-b317-e2731bd93e54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-325e39cf-4c3c-4808-b317-e2731bd93e54', 'volume_size': 1} Nov 03 07:44:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3023a657-8298-4469-a6c1-71cb587f3b7f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3023a657-8298-4469-a6c1-71cb587f3b7f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:24 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-3023a657-8298-4469-a6c1-71cb587f3b7f tempest-CreateVolumesFromSnapshotTest-1654695016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:44:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-612438196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=325e39cf-4c3c-4808-b317-e2731bd93e54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f01afec99b44489a3e46f78af45a63c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:44:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:44:25Z,use_quota=True,user_id='dd9cf42bbe0d420599e937657441b419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:44:24 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-3023a657-8298-4469-a6c1-71cb587f3b7f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Creating volume 325e39cf-4c3c-4808-b317-e2731bd93e54 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:44:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3023a657-8298-4469-a6c1-71cb587f3b7f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3023a657-8298-4469-a6c1-71cb587f3b7f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:24 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-3023a657-8298-4469-a6c1-71cb587f3b7f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:44:24 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-3023a657-8298-4469-a6c1-71cb587f3b7f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:44:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3023a657-8298-4469-a6c1-71cb587f3b7f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:24 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-3023a657-8298-4469-a6c1-71cb587f3b7f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:44:24 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-3023a657-8298-4469-a6c1-71cb587f3b7f tempest-CreateVolumesFromSnapshotTest-1654695016 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:44:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3023a657-8298-4469-a6c1-71cb587f3b7f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-325e39cf-4c3c-4808-b317-e2731bd93e54 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:24 devstack sudo[103393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-325e39cf-4c3c-4808-b317-e2731bd93e54 1073741824 Nov 03 07:44:24 devstack sudo[103393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:24 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] Lock "cinder-83f7c08e-2588-40b9-a043-9adbd2b582e7-delete_volume" acquired by "delete_volume" :: waited 0.106s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] Performing cascade delete. {{(pid=86875) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 03 07:44:24 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] Acquiring lock "cinder-77e48194-dd14-4a0d-b009-30b6a2e68ab8-delete_snapshot" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:24 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] Lock "cinder-77e48194-dd14-4a0d-b009-30b6a2e68ab8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:24 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] Acquiring lock "cinder-quobyte-83f7c08e-2588-40b9-a043-9adbd2b582e7" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:24 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] Lock "cinder-quobyte-83f7c08e-2588-40b9-a043-9adbd2b582e7" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:24 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] Acquiring lock "cinder-quobyte-77e48194-dd14-4a0d-b009-30b6a2e68ab8" by "_delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:24 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] Lock "cinder-quobyte-77e48194-dd14-4a0d-b009-30b6a2e68ab8" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:24 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] Deleting offline snapshot 77e48194-dd14-4a0d-b009-30b6a2e68ab8 of volume 83f7c08e-2588-40b9-a043-9adbd2b582e7 {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:44:25 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] snapshot_file for this snap is: volume-83f7c08e-2588-40b9-a043-9adbd2b582e7.77e48194-dd14-4a0d-b009-30b6a2e68ab8 {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:44:25 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[32351864-bf33-4ae1-bab5-46140c5475e6]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7.77e48194-dd14-4a0d-b009-30b6a2e68ab8 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:25 devstack sudo[103395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7.77e48194-dd14-4a0d-b009-30b6a2e68ab8 Nov 03 07:44:25 devstack sudo[103395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:25 devstack sudo[103393]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3023a657-8298-4469-a6c1-71cb587f3b7f tempest-CreateVolumesFromSnapshotTest-1654695016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-325e39cf-4c3c-4808-b317-e2731bd93e54 1073741824" returned: 0 in 0.526s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3023a657-8298-4469-a6c1-71cb587f3b7f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-325e39cf-4c3c-4808-b317-e2731bd93e54 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:25 devstack sudo[103401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-325e39cf-4c3c-4808-b317-e2731bd93e54 Nov 03 07:44:25 devstack sudo[103401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:25 devstack sudo[103395]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7.77e48194-dd14-4a0d-b009-30b6a2e68ab8" returned: 0 in 0.446s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:25 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83f7c08e-2588-40b9-a043-9adbd2b582e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:44:25 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9fd28e6-782f-4e90-83d4-e8377395d901]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:25 devstack sudo[103401]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3023a657-8298-4469-a6c1-71cb587f3b7f tempest-CreateVolumesFromSnapshotTest-1654695016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-325e39cf-4c3c-4808-b317-e2731bd93e54" returned: 0 in 0.298s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:25 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-3023a657-8298-4469-a6c1-71cb587f3b7f tempest-CreateVolumesFromSnapshotTest-1654695016 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:44:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3023a657-8298-4469-a6c1-71cb587f3b7f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:25 devstack sudo[103406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7 Nov 03 07:44:25 devstack sudo[103406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:25 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3023a657-8298-4469-a6c1-71cb587f3b7f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ae68076-fdf6-487d-a2c4-0d2a5afbf893) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-325e39cf-4c3c-4808-b317-e2731bd93e54', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:25 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3023a657-8298-4469-a6c1-71cb587f3b7f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf3becd7-c473-4441-bd25-e3bc0af01c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:25 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-3023a657-8298-4469-a6c1-71cb587f3b7f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Volume volume-325e39cf-4c3c-4808-b317-e2731bd93e54 (325e39cf-4c3c-4808-b317-e2731bd93e54): created successfully Nov 03 07:44:25 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3023a657-8298-4469-a6c1-71cb587f3b7f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf3becd7-c473-4441-bd25-e3bc0af01c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:25 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3023a657-8298-4469-a6c1-71cb587f3b7f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Flow 'volume_create_manager' (af71c807-56ad-475e-9da9-443f5cb188e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:44:25 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-3023a657-8298-4469-a6c1-71cb587f3b7f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Created volume successfully. Nov 03 07:44:25 devstack sudo[103406]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7" returned: 0 in 0.431s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:25 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[f214a008-05ee-47ab-9ffb-6c8b02dbb179]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7.f9cf9a9d-a14d-47e7-933d-78ba37c4ec2c {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:26 devstack sudo[103448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7.f9cf9a9d-a14d-47e7-933d-78ba37c4ec2c Nov 03 07:44:26 devstack sudo[103448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:26 devstack sudo[103448]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:26 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7.f9cf9a9d-a14d-47e7-933d-78ba37c4ec2c" returned: 0 in 0.358s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:26 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83f7c08e-2588-40b9-a043-9adbd2b582e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:44:26 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb52244-0770-495f-8456-60170531d187]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:26 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7.77e48194-dd14-4a0d-b009-30b6a2e68ab8 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:26 devstack sudo[103453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7.77e48194-dd14-4a0d-b009-30b6a2e68ab8 Nov 03 07:44:26 devstack sudo[103453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:26 devstack sudo[103453]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:26 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7.77e48194-dd14-4a0d-b009-30b6a2e68ab8" returned: 0 in 0.379s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:26 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83f7c08e-2588-40b9-a043-9adbd2b582e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:44:26 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a603e52-5441-45e6-983d-ce1f7139d231]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:26 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:26 devstack sudo[103458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7 Nov 03 07:44:26 devstack sudo[103458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-fcd2b980-1b1b-43e6-a2ed-9b3a3a5a5974 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-fcd2b980-1b1b-43e6-a2ed-9b3a3a5a5974 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:27 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-fcd2b980-1b1b-43e6-a2ed-9b3a3a5a5974 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Creating offline snapshot d1348762-11e1-4449-b9a0-d1c7756b1b64 of volume 325e39cf-4c3c-4808-b317-e2731bd93e54 {{(pid=86875) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:44:27 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[324ce653-64fe-499a-b9af-fb341fcc119a]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fcd2b980-1b1b-43e6-a2ed-9b3a3a5a5974 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-325e39cf-4c3c-4808-b317-e2731bd93e54 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:27 devstack sudo[103460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-325e39cf-4c3c-4808-b317-e2731bd93e54 Nov 03 07:44:27 devstack sudo[103458]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:27 devstack sudo[103460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7" returned: 0 in 0.436s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7.77e48194-dd14-4a0d-b009-30b6a2e68ab8 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:27 devstack sudo[103465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7.77e48194-dd14-4a0d-b009-30b6a2e68ab8 Nov 03 07:44:27 devstack sudo[103465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:27 devstack sudo[103460]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fcd2b980-1b1b-43e6-a2ed-9b3a3a5a5974 tempest-CreateVolumesFromSnapshotTest-1654695016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-325e39cf-4c3c-4808-b317-e2731bd93e54" returned: 0 in 0.362s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fcd2b980-1b1b-43e6-a2ed-9b3a3a5a5974 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-325e39cf-4c3c-4808-b317-e2731bd93e54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-325e39cf-4c3c-4808-b317-e2731bd93e54.d1348762-11e1-4449-b9a0-d1c7756b1b64 1G {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:27 devstack sudo[103473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-325e39cf-4c3c-4808-b317-e2731bd93e54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-325e39cf-4c3c-4808-b317-e2731bd93e54.d1348762-11e1-4449-b9a0-d1c7756b1b64 1G Nov 03 07:44:27 devstack sudo[103473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:27 devstack sudo[103465]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7.77e48194-dd14-4a0d-b009-30b6a2e68ab8" returned: 0 in 0.364s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7.77e48194-dd14-4a0d-b009-30b6a2e68ab8 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:27 devstack sudo[103476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7.77e48194-dd14-4a0d-b009-30b6a2e68ab8 Nov 03 07:44:27 devstack sudo[103476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:27 devstack sudo[103476]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7.77e48194-dd14-4a0d-b009-30b6a2e68ab8" returned: 0 in 0.270s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83f7c08e-2588-40b9-a043-9adbd2b582e7 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7.f9cf9a9d-a14d-47e7-933d-78ba37c4ec2c -F qcow2 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:27 devstack sudo[103473]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fcd2b980-1b1b-43e6-a2ed-9b3a3a5a5974 tempest-CreateVolumesFromSnapshotTest-1654695016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-325e39cf-4c3c-4808-b317-e2731bd93e54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-325e39cf-4c3c-4808-b317-e2731bd93e54.d1348762-11e1-4449-b9a0-d1c7756b1b64 1G" returned: 0 in 0.415s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fcd2b980-1b1b-43e6-a2ed-9b3a3a5a5974 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-325e39cf-4c3c-4808-b317-e2731bd93e54 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-325e39cf-4c3c-4808-b317-e2731bd93e54.d1348762-11e1-4449-b9a0-d1c7756b1b64 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:27 devstack sudo[103482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83f7c08e-2588-40b9-a043-9adbd2b582e7 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7.f9cf9a9d-a14d-47e7-933d-78ba37c4ec2c -F qcow2 Nov 03 07:44:27 devstack sudo[103482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:27 devstack sudo[103485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-325e39cf-4c3c-4808-b317-e2731bd93e54 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-325e39cf-4c3c-4808-b317-e2731bd93e54.d1348762-11e1-4449-b9a0-d1c7756b1b64 Nov 03 07:44:27 devstack sudo[103485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:28 devstack sudo[103482]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83f7c08e-2588-40b9-a043-9adbd2b582e7 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7.f9cf9a9d-a14d-47e7-933d-78ba37c4ec2c -F qcow2" returned: 0 in 0.312s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:28 devstack sudo[103485]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fcd2b980-1b1b-43e6-a2ed-9b3a3a5a5974 tempest-CreateVolumesFromSnapshotTest-1654695016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-325e39cf-4c3c-4808-b317-e2731bd93e54 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-325e39cf-4c3c-4808-b317-e2731bd93e54.d1348762-11e1-4449-b9a0-d1c7756b1b64" returned: 0 in 0.311s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:28 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-fcd2b980-1b1b-43e6-a2ed-9b3a3a5a5974 tempest-CreateVolumesFromSnapshotTest-1654695016 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-325e39cf-4c3c-4808-b317-e2731bd93e54.d1348762-11e1-4449-b9a0-d1c7756b1b64 is being set with open permissions: ugo+rw Nov 03 07:44:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fcd2b980-1b1b-43e6-a2ed-9b3a3a5a5974 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-325e39cf-4c3c-4808-b317-e2731bd93e54.d1348762-11e1-4449-b9a0-d1c7756b1b64 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:28 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] Lock "cinder-quobyte-77e48194-dd14-4a0d-b009-30b6a2e68ab8" released by "_delete_snapshot" :: held 3.198s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:28 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] Lock "cinder-quobyte-83f7c08e-2588-40b9-a043-9adbd2b582e7" released by "delete_snapshot" :: held 3.227s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:28 devstack sudo[103494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-325e39cf-4c3c-4808-b317-e2731bd93e54.d1348762-11e1-4449-b9a0-d1c7756b1b64 Nov 03 07:44:28 devstack sudo[103494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:28 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] Created reservations ['85ff7408-128e-4a65-8fc6-df1b7d1f7b03', '7d69636a-f68e-4e5d-9a32-c9d17d3c21ed', '1bece99f-1815-46a4-90d4-768e68ac328c', 'f8adab2f-2b60-4393-8cf9-cf234e4cef7b'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:44:28 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] Delete snapshot completed successfully. Nov 03 07:44:28 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] Lock "cinder-77e48194-dd14-4a0d-b009-30b6a2e68ab8-delete_snapshot" released by "delete_snapshot" :: held 3.395s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:28 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] Acquiring lock "cinder-f9cf9a9d-a14d-47e7-933d-78ba37c4ec2c-delete_snapshot" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:28 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] Lock "cinder-f9cf9a9d-a14d-47e7-933d-78ba37c4ec2c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:28 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] Acquiring lock "cinder-quobyte-83f7c08e-2588-40b9-a043-9adbd2b582e7" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:28 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] Lock "cinder-quobyte-83f7c08e-2588-40b9-a043-9adbd2b582e7" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:28 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] Acquiring lock "cinder-quobyte-f9cf9a9d-a14d-47e7-933d-78ba37c4ec2c" by "_delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:28 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] Lock "cinder-quobyte-f9cf9a9d-a14d-47e7-933d-78ba37c4ec2c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:28 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] Deleting offline snapshot f9cf9a9d-a14d-47e7-933d-78ba37c4ec2c of volume 83f7c08e-2588-40b9-a043-9adbd2b582e7 {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:44:28 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] snapshot_file for this snap is: volume-83f7c08e-2588-40b9-a043-9adbd2b582e7.f9cf9a9d-a14d-47e7-933d-78ba37c4ec2c {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:44:28 devstack sudo[103494]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fcd2b980-1b1b-43e6-a2ed-9b3a3a5a5974 tempest-CreateVolumesFromSnapshotTest-1654695016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-325e39cf-4c3c-4808-b317-e2731bd93e54.d1348762-11e1-4449-b9a0-d1c7756b1b64" returned: 0 in 0.256s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:28 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e765374-0d97-4a7b-b8c9-f99b8f2a3ace]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7.f9cf9a9d-a14d-47e7-933d-78ba37c4ec2c {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fcd2b980-1b1b-43e6-a2ed-9b3a3a5a5974 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-325e39cf-4c3c-4808-b317-e2731bd93e54.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:28 devstack sudo[103498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-325e39cf-4c3c-4808-b317-e2731bd93e54.info Nov 03 07:44:28 devstack sudo[103498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:28 devstack sudo[103497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7.f9cf9a9d-a14d-47e7-933d-78ba37c4ec2c Nov 03 07:44:28 devstack sudo[103497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:28 devstack sudo[103498]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fcd2b980-1b1b-43e6-a2ed-9b3a3a5a5974 tempest-CreateVolumesFromSnapshotTest-1654695016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-325e39cf-4c3c-4808-b317-e2731bd93e54.info" returned: 0 in 0.326s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:28 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-fcd2b980-1b1b-43e6-a2ed-9b3a3a5a5974 tempest-CreateVolumesFromSnapshotTest-1654695016 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-325e39cf-4c3c-4808-b317-e2731bd93e54.info is being set with open permissions: ugo+rw Nov 03 07:44:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fcd2b980-1b1b-43e6-a2ed-9b3a3a5a5974 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-325e39cf-4c3c-4808-b317-e2731bd93e54.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:28 devstack sudo[103505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-325e39cf-4c3c-4808-b317-e2731bd93e54.info Nov 03 07:44:28 devstack sudo[103497]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:28 devstack sudo[103505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7.f9cf9a9d-a14d-47e7-933d-78ba37c4ec2c" returned: 0 in 0.387s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:28 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83f7c08e-2588-40b9-a043-9adbd2b582e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:44:28 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bbf6118-2fa8-435f-b399-415cd8200104]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:28 devstack sudo[103507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7 Nov 03 07:44:28 devstack sudo[103507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:29 devstack sudo[103505]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:29 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fcd2b980-1b1b-43e6-a2ed-9b3a3a5a5974 tempest-CreateVolumesFromSnapshotTest-1654695016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-325e39cf-4c3c-4808-b317-e2731bd93e54.info" returned: 0 in 0.341s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:29 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-fcd2b980-1b1b-43e6-a2ed-9b3a3a5a5974 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.130s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:29 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-fcd2b980-1b1b-43e6-a2ed-9b3a3a5a5974 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Create snapshot completed successfully Nov 03 07:44:29 devstack sudo[103507]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:29 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7" returned: 0 in 0.388s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:29 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7.f9cf9a9d-a14d-47e7-933d-78ba37c4ec2c {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:29 devstack sudo[103513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7.f9cf9a9d-a14d-47e7-933d-78ba37c4ec2c Nov 03 07:44:29 devstack sudo[103513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:29 devstack sudo[103513]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:29 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7.f9cf9a9d-a14d-47e7-933d-78ba37c4ec2c" returned: 0 in 0.351s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:29 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7.f9cf9a9d-a14d-47e7-933d-78ba37c4ec2c {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:29 devstack sudo[103519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7.f9cf9a9d-a14d-47e7-933d-78ba37c4ec2c Nov 03 07:44:29 devstack sudo[103519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:29 devstack sudo[103519]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:29 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7.f9cf9a9d-a14d-47e7-933d-78ba37c4ec2c" returned: 0 in 0.266s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:29 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] Lock "cinder-quobyte-f9cf9a9d-a14d-47e7-933d-78ba37c4ec2c" released by "_delete_snapshot" :: held 1.515s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:29 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] Lock "cinder-quobyte-83f7c08e-2588-40b9-a043-9adbd2b582e7" released by "delete_snapshot" :: held 1.540s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:29 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] Created reservations ['3779144f-8ea3-469c-9268-fe02b54c6bb3', 'db578c08-80d4-44f7-8a89-a5ea5a3b32bc', '186915b3-3c58-4c83-a311-c2225583b382', 'caed9a7d-d920-4c9f-82f1-30b52a5740e1'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:44:30 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] Delete snapshot completed successfully. Nov 03 07:44:30 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] Lock "cinder-f9cf9a9d-a14d-47e7-933d-78ba37c4ec2c-delete_snapshot" released by "delete_snapshot" :: held 1.695s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:30 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] Snapshots deleted, issuing volume delete {{(pid=86875) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 03 07:44:30 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] Acquiring lock "cinder-quobyte-83f7c08e-2588-40b9-a043-9adbd2b582e7" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:30 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] Lock "cinder-quobyte-83f7c08e-2588-40b9-a043-9adbd2b582e7" acquired by "delete_volume" :: waited 0.016s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:30 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcec3bf5-6b0b-481b-8d01-efb1c612c008]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:30 devstack sudo[103522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7 Nov 03 07:44:30 devstack sudo[103522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:30 devstack sudo[103522]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7" returned: 0 in 0.422s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:30 devstack sudo[103527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7 Nov 03 07:44:30 devstack sudo[103527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:30 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ac1f119-5117-4f58-8e29-9d2468e2b372 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:44:30 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-8ac1f119-5117-4f58-8e29-9d2468e2b372 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Flow 'volume_create_manager' (c322081e-285e-4298-b13c-52e22f67c88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:44:30 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-8ac1f119-5117-4f58-8e29-9d2468e2b372 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cb7b43d-870c-4362-8d93-715cf4f0c7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:30 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-8ac1f119-5117-4f58-8e29-9d2468e2b372 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cb7b43d-870c-4362-8d93-715cf4f0c7c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:44:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-271360975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83c2ccd1-3339-476b-b910-fd9dc73b6c69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f01afec99b44489a3e46f78af45a63c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:44:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:44:31Z,use_quota=True,user_id='dd9cf42bbe0d420599e937657441b419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:30 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-8ac1f119-5117-4f58-8e29-9d2468e2b372 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2185d69-5a56-4500-b008-1b5c3186fcfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:30 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-8ac1f119-5117-4f58-8e29-9d2468e2b372 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2185d69-5a56-4500-b008-1b5c3186fcfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:30 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-8ac1f119-5117-4f58-8e29-9d2468e2b372 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3e987b0-ec49-44fb-bfdd-5c55415085c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:30 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-8ac1f119-5117-4f58-8e29-9d2468e2b372 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3e987b0-ec49-44fb-bfdd-5c55415085c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83c2ccd1-3339-476b-b910-fd9dc73b6c69', 'volume_name': 'volume-83c2ccd1-3339-476b-b910-fd9dc73b6c69', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:30 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-8ac1f119-5117-4f58-8e29-9d2468e2b372 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e0c5291-d036-4590-a4b4-1783bc81b335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:30 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-8ac1f119-5117-4f58-8e29-9d2468e2b372 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e0c5291-d036-4590-a4b4-1783bc81b335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:30 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-8ac1f119-5117-4f58-8e29-9d2468e2b372 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee28ecc4-e8ba-4243-8a49-1c3ec73622e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:30 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-8ac1f119-5117-4f58-8e29-9d2468e2b372 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Volume 83c2ccd1-3339-476b-b910-fd9dc73b6c69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83c2ccd1-3339-476b-b910-fd9dc73b6c69', 'volume_size': 1} Nov 03 07:44:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-8ac1f119-5117-4f58-8e29-9d2468e2b372 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-8ac1f119-5117-4f58-8e29-9d2468e2b372 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:30 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-8ac1f119-5117-4f58-8e29-9d2468e2b372 tempest-CreateVolumesFromSnapshotTest-1654695016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:44:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-271360975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83c2ccd1-3339-476b-b910-fd9dc73b6c69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f01afec99b44489a3e46f78af45a63c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:44:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:44:31Z,use_quota=True,user_id='dd9cf42bbe0d420599e937657441b419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:44:30 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-8ac1f119-5117-4f58-8e29-9d2468e2b372 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Creating volume 83c2ccd1-3339-476b-b910-fd9dc73b6c69 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:44:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-8ac1f119-5117-4f58-8e29-9d2468e2b372 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-8ac1f119-5117-4f58-8e29-9d2468e2b372 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:30 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-8ac1f119-5117-4f58-8e29-9d2468e2b372 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:44:30 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-8ac1f119-5117-4f58-8e29-9d2468e2b372 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:44:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-8ac1f119-5117-4f58-8e29-9d2468e2b372 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:30 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-8ac1f119-5117-4f58-8e29-9d2468e2b372 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:44:30 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-8ac1f119-5117-4f58-8e29-9d2468e2b372 tempest-CreateVolumesFromSnapshotTest-1654695016 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:44:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8ac1f119-5117-4f58-8e29-9d2468e2b372 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83c2ccd1-3339-476b-b910-fd9dc73b6c69 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:30 devstack sudo[103527]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83f7c08e-2588-40b9-a043-9adbd2b582e7" returned: 0 in 0.308s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:30 devstack sudo[103530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83c2ccd1-3339-476b-b910-fd9dc73b6c69 1073741824 Nov 03 07:44:30 devstack sudo[103530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:30 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] Lock "cinder-quobyte-83f7c08e-2588-40b9-a043-9adbd2b582e7" released by "delete_volume" :: held 0.831s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:30 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] Created reservations ['70d15525-8054-482d-a147-a26a493adc70', '5e848465-1a2f-4eb0-a756-cbff2f96f097', '469e6963-9996-4ce0-bb62-7999d324524d', '2f2cf7d3-6ca6-4676-a791-2e38faab1309'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:44:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:31 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:44:31 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:44:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:31 devstack sudo[103534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:44:31 devstack sudo[103534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:31 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-e415a2f9-5788-42d4-8679-ec94661f8765 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:44:31 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e415a2f9-5788-42d4-8679-ec94661f8765 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Flow 'volume_create_manager' (30de2e3d-2a54-43fd-b13f-093fd88d53f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:44:31 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e415a2f9-5788-42d4-8679-ec94661f8765 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e94fbe9e-3514-42c2-b89a-f053be2434f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:31 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e415a2f9-5788-42d4-8679-ec94661f8765 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e94fbe9e-3514-42c2-b89a-f053be2434f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:44:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2132475627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a01d32a8-1885-45a0-a1c0-787a207fb5f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f01afec99b44489a3e46f78af45a63c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:44:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:44:31Z,use_quota=True,user_id='dd9cf42bbe0d420599e937657441b419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:31 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e415a2f9-5788-42d4-8679-ec94661f8765 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a02cf60-0f8a-4df6-b0a6-49adad9d9786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:31 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e415a2f9-5788-42d4-8679-ec94661f8765 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a02cf60-0f8a-4df6-b0a6-49adad9d9786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:31 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e415a2f9-5788-42d4-8679-ec94661f8765 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04f127bf-736a-4b08-9a41-fee28eb8c491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:31 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e415a2f9-5788-42d4-8679-ec94661f8765 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04f127bf-736a-4b08-9a41-fee28eb8c491) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a01d32a8-1885-45a0-a1c0-787a207fb5f4', 'volume_name': 'volume-a01d32a8-1885-45a0-a1c0-787a207fb5f4', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:31 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e415a2f9-5788-42d4-8679-ec94661f8765 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fda7c46c-2192-4047-9c7e-7ee9c65f73fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:31 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e415a2f9-5788-42d4-8679-ec94661f8765 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fda7c46c-2192-4047-9c7e-7ee9c65f73fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:31 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e415a2f9-5788-42d4-8679-ec94661f8765 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a96c539-3ce6-4276-91d6-431a4eeeeab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:31 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-e415a2f9-5788-42d4-8679-ec94661f8765 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Volume a01d32a8-1885-45a0-a1c0-787a207fb5f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a01d32a8-1885-45a0-a1c0-787a207fb5f4', 'volume_size': 1} Nov 03 07:44:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e415a2f9-5788-42d4-8679-ec94661f8765 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:31 devstack sudo[103530]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8ac1f119-5117-4f58-8e29-9d2468e2b372 tempest-CreateVolumesFromSnapshotTest-1654695016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83c2ccd1-3339-476b-b910-fd9dc73b6c69 1073741824" returned: 0 in 0.647s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:31 devstack sudo[103534]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8ac1f119-5117-4f58-8e29-9d2468e2b372 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83c2ccd1-3339-476b-b910-fd9dc73b6c69 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.457s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:31 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:44:31 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] Deleted volume successfully. Nov 03 07:44:31 devstack sudo[103539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83c2ccd1-3339-476b-b910-fd9dc73b6c69 Nov 03 07:44:31 devstack sudo[103539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:31 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-aaecf725-0702-455c-a272-59c34d95d99b tempest-VolumesDeleteCascade-1749971429 None] Lock "cinder-83f7c08e-2588-40b9-a043-9adbd2b582e7-delete_volume" released by "delete_volume" :: held 6.792s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:31 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-58e2a738-c90c-4e45-aa11-30e7665aac8b tempest-CreateVolumesFromSnapshotTest-1654695016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:44:31 devstack sudo[103539]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:31 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-58e2a738-c90c-4e45-aa11-30e7665aac8b tempest-CreateVolumesFromSnapshotTest-1654695016 None] Flow 'volume_create_manager' (340a1f42-3792-4caf-9f30-a8199a9e9499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:44:31 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-58e2a738-c90c-4e45-aa11-30e7665aac8b tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f95e55d-83f0-49da-bb71-aca39fef5948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8ac1f119-5117-4f58-8e29-9d2468e2b372 tempest-CreateVolumesFromSnapshotTest-1654695016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83c2ccd1-3339-476b-b910-fd9dc73b6c69" returned: 0 in 0.400s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:31 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-8ac1f119-5117-4f58-8e29-9d2468e2b372 tempest-CreateVolumesFromSnapshotTest-1654695016 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:44:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-8ac1f119-5117-4f58-8e29-9d2468e2b372 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e415a2f9-5788-42d4-8679-ec94661f8765 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.566s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:31 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-e415a2f9-5788-42d4-8679-ec94661f8765 tempest-CreateVolumesFromSnapshotTest-1654695016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:44:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2132475627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a01d32a8-1885-45a0-a1c0-787a207fb5f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f01afec99b44489a3e46f78af45a63c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:44:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:44:31Z,use_quota=True,user_id='dd9cf42bbe0d420599e937657441b419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:44:31 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-e415a2f9-5788-42d4-8679-ec94661f8765 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Creating volume a01d32a8-1885-45a0-a1c0-787a207fb5f4 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:44:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e415a2f9-5788-42d4-8679-ec94661f8765 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e415a2f9-5788-42d4-8679-ec94661f8765 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:31 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-e415a2f9-5788-42d4-8679-ec94661f8765 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:44:31 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-e415a2f9-5788-42d4-8679-ec94661f8765 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:44:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e415a2f9-5788-42d4-8679-ec94661f8765 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:31 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-e415a2f9-5788-42d4-8679-ec94661f8765 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:44:31 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-e415a2f9-5788-42d4-8679-ec94661f8765 tempest-CreateVolumesFromSnapshotTest-1654695016 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:44:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e415a2f9-5788-42d4-8679-ec94661f8765 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a01d32a8-1885-45a0-a1c0-787a207fb5f4 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-58e2a738-c90c-4e45-aa11-30e7665aac8b tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f95e55d-83f0-49da-bb71-aca39fef5948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:44:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1044556013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=769d4579-e505-414d-8395-355716d91d43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f01afec99b44489a3e46f78af45a63c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:44:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:44:32Z,use_quota=True,user_id='dd9cf42bbe0d420599e937657441b419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-58e2a738-c90c-4e45-aa11-30e7665aac8b tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53788cb6-dcb2-4000-941b-5cc3ad489b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-58e2a738-c90c-4e45-aa11-30e7665aac8b tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53788cb6-dcb2-4000-941b-5cc3ad489b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:32 devstack sudo[103542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a01d32a8-1885-45a0-a1c0-787a207fb5f4 1073741824 Nov 03 07:44:32 devstack sudo[103542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-58e2a738-c90c-4e45-aa11-30e7665aac8b tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7eabb0c-4f02-43ae-be3b-fdf84b015b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-58e2a738-c90c-4e45-aa11-30e7665aac8b tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7eabb0c-4f02-43ae-be3b-fdf84b015b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '769d4579-e505-414d-8395-355716d91d43', 'volume_name': 'volume-769d4579-e505-414d-8395-355716d91d43', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-58e2a738-c90c-4e45-aa11-30e7665aac8b tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87e30080-9a46-43a8-8b30-f94232d8df89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-58e2a738-c90c-4e45-aa11-30e7665aac8b tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87e30080-9a46-43a8-8b30-f94232d8df89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-58e2a738-c90c-4e45-aa11-30e7665aac8b tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81692ff1-f0c4-45d2-b125-bd2420aa9fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:32 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-58e2a738-c90c-4e45-aa11-30e7665aac8b tempest-CreateVolumesFromSnapshotTest-1654695016 None] Volume 769d4579-e505-414d-8395-355716d91d43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-769d4579-e505-414d-8395-355716d91d43', 'volume_size': 1} Nov 03 07:44:32 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-58e2a738-c90c-4e45-aa11-30e7665aac8b tempest-CreateVolumesFromSnapshotTest-1654695016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-8ac1f119-5117-4f58-8e29-9d2468e2b372 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee28ecc4-e8ba-4243-8a49-1c3ec73622e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83c2ccd1-3339-476b-b910-fd9dc73b6c69', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-8ac1f119-5117-4f58-8e29-9d2468e2b372 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b204236-978b-45c0-8532-30e4c4aff1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:32 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-8ac1f119-5117-4f58-8e29-9d2468e2b372 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Volume volume-83c2ccd1-3339-476b-b910-fd9dc73b6c69 (83c2ccd1-3339-476b-b910-fd9dc73b6c69): created successfully Nov 03 07:44:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-8ac1f119-5117-4f58-8e29-9d2468e2b372 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b204236-978b-45c0-8532-30e4c4aff1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-8ac1f119-5117-4f58-8e29-9d2468e2b372 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Flow 'volume_create_manager' (c322081e-285e-4298-b13c-52e22f67c88b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:44:32 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-8ac1f119-5117-4f58-8e29-9d2468e2b372 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Created volume successfully. Nov 03 07:44:32 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-0569eedf-9bd0-4b56-ab5a-cf56113d899a tempest-CreateVolumesFromSnapshotTest-1654695016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:44:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0569eedf-9bd0-4b56-ab5a-cf56113d899a tempest-CreateVolumesFromSnapshotTest-1654695016 None] Flow 'volume_create_manager' (f99c71d3-b274-4019-a0e8-539f580ce679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:44:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0569eedf-9bd0-4b56-ab5a-cf56113d899a tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (158e1544-62c1-4d17-bbc6-679f38f33b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0569eedf-9bd0-4b56-ab5a-cf56113d899a tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (158e1544-62c1-4d17-bbc6-679f38f33b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:44:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1489909453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=740f15ee-dbc9-4aa4-9401-f894f237a6ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f01afec99b44489a3e46f78af45a63c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:44:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:44:32Z,use_quota=True,user_id='dd9cf42bbe0d420599e937657441b419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0569eedf-9bd0-4b56-ab5a-cf56113d899a tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bb0265f-f009-4064-b570-56f20c6f1232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0569eedf-9bd0-4b56-ab5a-cf56113d899a tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bb0265f-f009-4064-b570-56f20c6f1232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0569eedf-9bd0-4b56-ab5a-cf56113d899a tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be6ec33f-873b-445c-bcc9-f1e9c414646e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0569eedf-9bd0-4b56-ab5a-cf56113d899a tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be6ec33f-873b-445c-bcc9-f1e9c414646e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '740f15ee-dbc9-4aa4-9401-f894f237a6ef', 'volume_name': 'volume-740f15ee-dbc9-4aa4-9401-f894f237a6ef', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0569eedf-9bd0-4b56-ab5a-cf56113d899a tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e09c3bf7-1a7c-4716-a6a9-b39ddf3182fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0569eedf-9bd0-4b56-ab5a-cf56113d899a tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e09c3bf7-1a7c-4716-a6a9-b39ddf3182fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0569eedf-9bd0-4b56-ab5a-cf56113d899a tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0e09f6a-c02d-4587-9c28-174b731ddf03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:32 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-0569eedf-9bd0-4b56-ab5a-cf56113d899a tempest-CreateVolumesFromSnapshotTest-1654695016 None] Volume 740f15ee-dbc9-4aa4-9401-f894f237a6ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-740f15ee-dbc9-4aa4-9401-f894f237a6ef', 'volume_size': 1} Nov 03 07:44:32 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0569eedf-9bd0-4b56-ab5a-cf56113d899a tempest-CreateVolumesFromSnapshotTest-1654695016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:32 devstack sudo[103542]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:32 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e415a2f9-5788-42d4-8679-ec94661f8765 tempest-CreateVolumesFromSnapshotTest-1654695016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a01d32a8-1885-45a0-a1c0-787a207fb5f4 1073741824" returned: 0 in 0.766s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:32 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e415a2f9-5788-42d4-8679-ec94661f8765 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a01d32a8-1885-45a0-a1c0-787a207fb5f4 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:32 devstack sudo[103549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a01d32a8-1885-45a0-a1c0-787a207fb5f4 Nov 03 07:44:32 devstack sudo[103549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:32 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c60fe60-7feb-4ae9-a3f6-59a108380b48 tempest-VolumesDeleteCascade-1749971429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:44:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4c60fe60-7feb-4ae9-a3f6-59a108380b48 tempest-VolumesDeleteCascade-1749971429 None] Flow 'volume_create_manager' (2cc8ae5e-84c1-49f5-8eae-831a3210c327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:44:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4c60fe60-7feb-4ae9-a3f6-59a108380b48 tempest-VolumesDeleteCascade-1749971429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (008310a7-1589-4ece-9047-e0b54b277636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4c60fe60-7feb-4ae9-a3f6-59a108380b48 tempest-VolumesDeleteCascade-1749971429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (008310a7-1589-4ece-9047-e0b54b277636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:44:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1902565258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc84479a-ea43-49cb-b916-600129bcf692,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='110f99a92f104579b60e13555a6a9fd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:44:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:44:33Z,use_quota=True,user_id='65bb1d04b38a4c51be24a06b0598c17e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4c60fe60-7feb-4ae9-a3f6-59a108380b48 tempest-VolumesDeleteCascade-1749971429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29f449be-6f8b-47f5-8d5f-1b2bf467b7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4c60fe60-7feb-4ae9-a3f6-59a108380b48 tempest-VolumesDeleteCascade-1749971429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29f449be-6f8b-47f5-8d5f-1b2bf467b7ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4c60fe60-7feb-4ae9-a3f6-59a108380b48 tempest-VolumesDeleteCascade-1749971429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4449b44-2354-453c-8e6c-617719509196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4c60fe60-7feb-4ae9-a3f6-59a108380b48 tempest-VolumesDeleteCascade-1749971429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4449b44-2354-453c-8e6c-617719509196) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc84479a-ea43-49cb-b916-600129bcf692', 'volume_name': 'volume-bc84479a-ea43-49cb-b916-600129bcf692', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4c60fe60-7feb-4ae9-a3f6-59a108380b48 tempest-VolumesDeleteCascade-1749971429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2176b01-fda0-4939-a859-ea1d8fe1120f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4c60fe60-7feb-4ae9-a3f6-59a108380b48 tempest-VolumesDeleteCascade-1749971429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2176b01-fda0-4939-a859-ea1d8fe1120f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4c60fe60-7feb-4ae9-a3f6-59a108380b48 tempest-VolumesDeleteCascade-1749971429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bce1f9a8-375a-44c8-b87e-4f5aff51e422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:32 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-4c60fe60-7feb-4ae9-a3f6-59a108380b48 tempest-VolumesDeleteCascade-1749971429 None] Volume bc84479a-ea43-49cb-b916-600129bcf692: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc84479a-ea43-49cb-b916-600129bcf692', 'volume_size': 1} Nov 03 07:44:32 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-4c60fe60-7feb-4ae9-a3f6-59a108380b48 tempest-VolumesDeleteCascade-1749971429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:33 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-3933e963-5e23-46e2-acea-b0eb24e1d308 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:44:33 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3933e963-5e23-46e2-acea-b0eb24e1d308 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Flow 'volume_create_manager' (0a4bf2fd-5a0e-4d2f-af73-c331cdb932c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:44:33 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3933e963-5e23-46e2-acea-b0eb24e1d308 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f290a370-dc5c-4bfe-b1d7-503a2537f3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:33 devstack sudo[103549]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e415a2f9-5788-42d4-8679-ec94661f8765 tempest-CreateVolumesFromSnapshotTest-1654695016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a01d32a8-1885-45a0-a1c0-787a207fb5f4" returned: 0 in 0.346s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:33 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-e415a2f9-5788-42d4-8679-ec94661f8765 tempest-CreateVolumesFromSnapshotTest-1654695016 None] <== create_volume: return (1175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:44:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e415a2f9-5788-42d4-8679-ec94661f8765 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-58e2a738-c90c-4e45-aa11-30e7665aac8b tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.074s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:33 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-58e2a738-c90c-4e45-aa11-30e7665aac8b tempest-CreateVolumesFromSnapshotTest-1654695016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:44:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1044556013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=769d4579-e505-414d-8395-355716d91d43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f01afec99b44489a3e46f78af45a63c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:44:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:44:32Z,use_quota=True,user_id='dd9cf42bbe0d420599e937657441b419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:44:33 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-58e2a738-c90c-4e45-aa11-30e7665aac8b tempest-CreateVolumesFromSnapshotTest-1654695016 None] Creating volume 769d4579-e505-414d-8395-355716d91d43 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:44:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-58e2a738-c90c-4e45-aa11-30e7665aac8b tempest-CreateVolumesFromSnapshotTest-1654695016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-58e2a738-c90c-4e45-aa11-30e7665aac8b tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:33 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-58e2a738-c90c-4e45-aa11-30e7665aac8b tempest-CreateVolumesFromSnapshotTest-1654695016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:44:33 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-58e2a738-c90c-4e45-aa11-30e7665aac8b tempest-CreateVolumesFromSnapshotTest-1654695016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:44:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-58e2a738-c90c-4e45-aa11-30e7665aac8b tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:33 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-58e2a738-c90c-4e45-aa11-30e7665aac8b tempest-CreateVolumesFromSnapshotTest-1654695016 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:44:33 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-58e2a738-c90c-4e45-aa11-30e7665aac8b tempest-CreateVolumesFromSnapshotTest-1654695016 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:44:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-58e2a738-c90c-4e45-aa11-30e7665aac8b tempest-CreateVolumesFromSnapshotTest-1654695016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-769d4579-e505-414d-8395-355716d91d43 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:33 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3933e963-5e23-46e2-acea-b0eb24e1d308 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f290a370-dc5c-4bfe-b1d7-503a2537f3b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:44:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-398787245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d298445-7421-4985-9ca7-2a2befb75f30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f01afec99b44489a3e46f78af45a63c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:44:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:44:33Z,use_quota=True,user_id='dd9cf42bbe0d420599e937657441b419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:33 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3933e963-5e23-46e2-acea-b0eb24e1d308 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bda6778-17ed-46ec-8671-1732859579b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:33 devstack sudo[103552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-769d4579-e505-414d-8395-355716d91d43 1073741824 Nov 03 07:44:33 devstack sudo[103552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:33 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3933e963-5e23-46e2-acea-b0eb24e1d308 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bda6778-17ed-46ec-8671-1732859579b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:33 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3933e963-5e23-46e2-acea-b0eb24e1d308 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bda4b2e4-9c51-42a2-a36f-7905fdb7d4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:33 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3933e963-5e23-46e2-acea-b0eb24e1d308 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bda4b2e4-9c51-42a2-a36f-7905fdb7d4dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d298445-7421-4985-9ca7-2a2befb75f30', 'volume_name': 'volume-2d298445-7421-4985-9ca7-2a2befb75f30', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:33 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3933e963-5e23-46e2-acea-b0eb24e1d308 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07f5cdda-f063-4a6e-a33e-16b05ca08d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:33 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3933e963-5e23-46e2-acea-b0eb24e1d308 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07f5cdda-f063-4a6e-a33e-16b05ca08d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:33 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3933e963-5e23-46e2-acea-b0eb24e1d308 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (203f3dd9-4399-4dec-800b-c501bd8dcd32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:33 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-3933e963-5e23-46e2-acea-b0eb24e1d308 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Volume 2d298445-7421-4985-9ca7-2a2befb75f30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d298445-7421-4985-9ca7-2a2befb75f30', 'volume_size': 1} Nov 03 07:44:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3933e963-5e23-46e2-acea-b0eb24e1d308 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:33 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e415a2f9-5788-42d4-8679-ec94661f8765 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a96c539-3ce6-4276-91d6-431a4eeeeab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a01d32a8-1885-45a0-a1c0-787a207fb5f4', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:33 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e415a2f9-5788-42d4-8679-ec94661f8765 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f283c2da-43e7-4597-a24e-06b68fd77363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:33 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-e415a2f9-5788-42d4-8679-ec94661f8765 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Volume volume-a01d32a8-1885-45a0-a1c0-787a207fb5f4 (a01d32a8-1885-45a0-a1c0-787a207fb5f4): created successfully Nov 03 07:44:33 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e415a2f9-5788-42d4-8679-ec94661f8765 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f283c2da-43e7-4597-a24e-06b68fd77363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:33 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e415a2f9-5788-42d4-8679-ec94661f8765 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Flow 'volume_create_manager' (30de2e3d-2a54-43fd-b13f-093fd88d53f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:44:33 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-e415a2f9-5788-42d4-8679-ec94661f8765 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Created volume successfully. Nov 03 07:44:33 devstack sudo[103552]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-58e2a738-c90c-4e45-aa11-30e7665aac8b tempest-CreateVolumesFromSnapshotTest-1654695016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-769d4579-e505-414d-8395-355716d91d43 1073741824" returned: 0 in 0.461s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-58e2a738-c90c-4e45-aa11-30e7665aac8b tempest-CreateVolumesFromSnapshotTest-1654695016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-769d4579-e505-414d-8395-355716d91d43 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:33 devstack sudo[103558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-769d4579-e505-414d-8395-355716d91d43 Nov 03 07:44:33 devstack sudo[103558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:33 devstack sudo[103558]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-58e2a738-c90c-4e45-aa11-30e7665aac8b tempest-CreateVolumesFromSnapshotTest-1654695016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-769d4579-e505-414d-8395-355716d91d43" returned: 0 in 0.296s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:33 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-58e2a738-c90c-4e45-aa11-30e7665aac8b tempest-CreateVolumesFromSnapshotTest-1654695016 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:44:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-58e2a738-c90c-4e45-aa11-30e7665aac8b tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0569eedf-9bd0-4b56-ab5a-cf56113d899a tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.360s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:33 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-0569eedf-9bd0-4b56-ab5a-cf56113d899a tempest-CreateVolumesFromSnapshotTest-1654695016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:44:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1489909453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=740f15ee-dbc9-4aa4-9401-f894f237a6ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f01afec99b44489a3e46f78af45a63c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:44:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:44:32Z,use_quota=True,user_id='dd9cf42bbe0d420599e937657441b419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:44:33 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-0569eedf-9bd0-4b56-ab5a-cf56113d899a tempest-CreateVolumesFromSnapshotTest-1654695016 None] Creating volume 740f15ee-dbc9-4aa4-9401-f894f237a6ef {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:44:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0569eedf-9bd0-4b56-ab5a-cf56113d899a tempest-CreateVolumesFromSnapshotTest-1654695016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0569eedf-9bd0-4b56-ab5a-cf56113d899a tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:33 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-0569eedf-9bd0-4b56-ab5a-cf56113d899a tempest-CreateVolumesFromSnapshotTest-1654695016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:44:33 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-0569eedf-9bd0-4b56-ab5a-cf56113d899a tempest-CreateVolumesFromSnapshotTest-1654695016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:44:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0569eedf-9bd0-4b56-ab5a-cf56113d899a tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:33 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-0569eedf-9bd0-4b56-ab5a-cf56113d899a tempest-CreateVolumesFromSnapshotTest-1654695016 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:44:33 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-0569eedf-9bd0-4b56-ab5a-cf56113d899a tempest-CreateVolumesFromSnapshotTest-1654695016 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:44:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0569eedf-9bd0-4b56-ab5a-cf56113d899a tempest-CreateVolumesFromSnapshotTest-1654695016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-740f15ee-dbc9-4aa4-9401-f894f237a6ef 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:33 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-58e2a738-c90c-4e45-aa11-30e7665aac8b tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81692ff1-f0c4-45d2-b125-bd2420aa9fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-769d4579-e505-414d-8395-355716d91d43', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:33 devstack sudo[103561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-740f15ee-dbc9-4aa4-9401-f894f237a6ef 1073741824 Nov 03 07:44:33 devstack sudo[103561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:33 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-58e2a738-c90c-4e45-aa11-30e7665aac8b tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e95954ec-edaf-460d-af2a-4626f240947b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:33 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-58e2a738-c90c-4e45-aa11-30e7665aac8b tempest-CreateVolumesFromSnapshotTest-1654695016 None] Volume volume-769d4579-e505-414d-8395-355716d91d43 (769d4579-e505-414d-8395-355716d91d43): created successfully Nov 03 07:44:34 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-58e2a738-c90c-4e45-aa11-30e7665aac8b tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e95954ec-edaf-460d-af2a-4626f240947b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:34 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-58e2a738-c90c-4e45-aa11-30e7665aac8b tempest-CreateVolumesFromSnapshotTest-1654695016 None] Flow 'volume_create_manager' (340a1f42-3792-4caf-9f30-a8199a9e9499) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:44:34 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-58e2a738-c90c-4e45-aa11-30e7665aac8b tempest-CreateVolumesFromSnapshotTest-1654695016 None] Created volume successfully. Nov 03 07:44:34 devstack sudo[103561]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0569eedf-9bd0-4b56-ab5a-cf56113d899a tempest-CreateVolumesFromSnapshotTest-1654695016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-740f15ee-dbc9-4aa4-9401-f894f237a6ef 1073741824" returned: 0 in 0.441s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0569eedf-9bd0-4b56-ab5a-cf56113d899a tempest-CreateVolumesFromSnapshotTest-1654695016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-740f15ee-dbc9-4aa4-9401-f894f237a6ef {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:34 devstack sudo[103567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-740f15ee-dbc9-4aa4-9401-f894f237a6ef Nov 03 07:44:34 devstack sudo[103567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:34 devstack sudo[103567]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0569eedf-9bd0-4b56-ab5a-cf56113d899a tempest-CreateVolumesFromSnapshotTest-1654695016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-740f15ee-dbc9-4aa4-9401-f894f237a6ef" returned: 0 in 0.248s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:34 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-0569eedf-9bd0-4b56-ab5a-cf56113d899a tempest-CreateVolumesFromSnapshotTest-1654695016 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:44:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0569eedf-9bd0-4b56-ab5a-cf56113d899a tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-4c60fe60-7feb-4ae9-a3f6-59a108380b48 tempest-VolumesDeleteCascade-1749971429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.716s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:34 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-4c60fe60-7feb-4ae9-a3f6-59a108380b48 tempest-VolumesDeleteCascade-1749971429 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:44:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1902565258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc84479a-ea43-49cb-b916-600129bcf692,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='110f99a92f104579b60e13555a6a9fd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:44:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:44:33Z,use_quota=True,user_id='65bb1d04b38a4c51be24a06b0598c17e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:44:34 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-4c60fe60-7feb-4ae9-a3f6-59a108380b48 tempest-VolumesDeleteCascade-1749971429 None] Creating volume bc84479a-ea43-49cb-b916-600129bcf692 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:44:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-4c60fe60-7feb-4ae9-a3f6-59a108380b48 tempest-VolumesDeleteCascade-1749971429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-4c60fe60-7feb-4ae9-a3f6-59a108380b48 tempest-VolumesDeleteCascade-1749971429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:34 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-4c60fe60-7feb-4ae9-a3f6-59a108380b48 tempest-VolumesDeleteCascade-1749971429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:44:34 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-4c60fe60-7feb-4ae9-a3f6-59a108380b48 tempest-VolumesDeleteCascade-1749971429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:44:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-4c60fe60-7feb-4ae9-a3f6-59a108380b48 tempest-VolumesDeleteCascade-1749971429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:34 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-4c60fe60-7feb-4ae9-a3f6-59a108380b48 tempest-VolumesDeleteCascade-1749971429 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:44:34 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-4c60fe60-7feb-4ae9-a3f6-59a108380b48 tempest-VolumesDeleteCascade-1749971429 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:44:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4c60fe60-7feb-4ae9-a3f6-59a108380b48 tempest-VolumesDeleteCascade-1749971429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bc84479a-ea43-49cb-b916-600129bcf692 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:34 devstack sudo[103570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bc84479a-ea43-49cb-b916-600129bcf692 1073741824 Nov 03 07:44:34 devstack sudo[103570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:34 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0569eedf-9bd0-4b56-ab5a-cf56113d899a tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0e09f6a-c02d-4587-9c28-174b731ddf03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-740f15ee-dbc9-4aa4-9401-f894f237a6ef', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:34 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0569eedf-9bd0-4b56-ab5a-cf56113d899a tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4d771d7-b75e-4ca0-8256-f5d2476434c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:34 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-0569eedf-9bd0-4b56-ab5a-cf56113d899a tempest-CreateVolumesFromSnapshotTest-1654695016 None] Volume volume-740f15ee-dbc9-4aa4-9401-f894f237a6ef (740f15ee-dbc9-4aa4-9401-f894f237a6ef): created successfully Nov 03 07:44:34 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0569eedf-9bd0-4b56-ab5a-cf56113d899a tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4d771d7-b75e-4ca0-8256-f5d2476434c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:34 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0569eedf-9bd0-4b56-ab5a-cf56113d899a tempest-CreateVolumesFromSnapshotTest-1654695016 None] Flow 'volume_create_manager' (f99c71d3-b274-4019-a0e8-539f580ce679) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:44:34 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-0569eedf-9bd0-4b56-ab5a-cf56113d899a tempest-CreateVolumesFromSnapshotTest-1654695016 None] Created volume successfully. Nov 03 07:44:35 devstack sudo[103570]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4c60fe60-7feb-4ae9-a3f6-59a108380b48 tempest-VolumesDeleteCascade-1749971429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bc84479a-ea43-49cb-b916-600129bcf692 1073741824" returned: 0 in 0.470s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4c60fe60-7feb-4ae9-a3f6-59a108380b48 tempest-VolumesDeleteCascade-1749971429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bc84479a-ea43-49cb-b916-600129bcf692 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:35 devstack sudo[103576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bc84479a-ea43-49cb-b916-600129bcf692 Nov 03 07:44:35 devstack sudo[103576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:35 devstack sudo[103576]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4c60fe60-7feb-4ae9-a3f6-59a108380b48 tempest-VolumesDeleteCascade-1749971429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bc84479a-ea43-49cb-b916-600129bcf692" returned: 0 in 0.241s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:35 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-4c60fe60-7feb-4ae9-a3f6-59a108380b48 tempest-VolumesDeleteCascade-1749971429 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:44:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-4c60fe60-7feb-4ae9-a3f6-59a108380b48 tempest-VolumesDeleteCascade-1749971429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3933e963-5e23-46e2-acea-b0eb24e1d308 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.223s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:35 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-3933e963-5e23-46e2-acea-b0eb24e1d308 tempest-CreateVolumesFromSnapshotTest-1654695016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:44:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-398787245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d298445-7421-4985-9ca7-2a2befb75f30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f01afec99b44489a3e46f78af45a63c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:44:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:44:33Z,use_quota=True,user_id='dd9cf42bbe0d420599e937657441b419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:44:35 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-3933e963-5e23-46e2-acea-b0eb24e1d308 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Creating volume 2d298445-7421-4985-9ca7-2a2befb75f30 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:44:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3933e963-5e23-46e2-acea-b0eb24e1d308 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3933e963-5e23-46e2-acea-b0eb24e1d308 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:35 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-3933e963-5e23-46e2-acea-b0eb24e1d308 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:44:35 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-3933e963-5e23-46e2-acea-b0eb24e1d308 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:44:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3933e963-5e23-46e2-acea-b0eb24e1d308 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:35 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-3933e963-5e23-46e2-acea-b0eb24e1d308 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:44:35 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-3933e963-5e23-46e2-acea-b0eb24e1d308 tempest-CreateVolumesFromSnapshotTest-1654695016 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:44:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3933e963-5e23-46e2-acea-b0eb24e1d308 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2d298445-7421-4985-9ca7-2a2befb75f30 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:35 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4c60fe60-7feb-4ae9-a3f6-59a108380b48 tempest-VolumesDeleteCascade-1749971429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bce1f9a8-375a-44c8-b87e-4f5aff51e422) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc84479a-ea43-49cb-b916-600129bcf692', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:35 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4c60fe60-7feb-4ae9-a3f6-59a108380b48 tempest-VolumesDeleteCascade-1749971429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd0dd89b-c8f1-4f60-bd24-cc692e1c31d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:35 devstack sudo[103579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2d298445-7421-4985-9ca7-2a2befb75f30 1073741824 Nov 03 07:44:35 devstack sudo[103579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:35 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-4c60fe60-7feb-4ae9-a3f6-59a108380b48 tempest-VolumesDeleteCascade-1749971429 None] Volume volume-bc84479a-ea43-49cb-b916-600129bcf692 (bc84479a-ea43-49cb-b916-600129bcf692): created successfully Nov 03 07:44:35 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4c60fe60-7feb-4ae9-a3f6-59a108380b48 tempest-VolumesDeleteCascade-1749971429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd0dd89b-c8f1-4f60-bd24-cc692e1c31d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:35 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4c60fe60-7feb-4ae9-a3f6-59a108380b48 tempest-VolumesDeleteCascade-1749971429 None] Flow 'volume_create_manager' (2cc8ae5e-84c1-49f5-8eae-831a3210c327) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:44:35 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-4c60fe60-7feb-4ae9-a3f6-59a108380b48 tempest-VolumesDeleteCascade-1749971429 None] Created volume successfully. Nov 03 07:44:35 devstack sudo[103579]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3933e963-5e23-46e2-acea-b0eb24e1d308 tempest-CreateVolumesFromSnapshotTest-1654695016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2d298445-7421-4985-9ca7-2a2befb75f30 1073741824" returned: 0 in 0.502s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3933e963-5e23-46e2-acea-b0eb24e1d308 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2d298445-7421-4985-9ca7-2a2befb75f30 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:36 devstack sudo[103585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2d298445-7421-4985-9ca7-2a2befb75f30 Nov 03 07:44:36 devstack sudo[103585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:36 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-089cc290-01f8-499e-8d38-9de9fd664fcc tempest-VolumesDeleteCascade-1749971429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:36 devstack sudo[103585]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:36 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3933e963-5e23-46e2-acea-b0eb24e1d308 tempest-CreateVolumesFromSnapshotTest-1654695016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2d298445-7421-4985-9ca7-2a2befb75f30" returned: 0 in 0.300s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:36 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-3933e963-5e23-46e2-acea-b0eb24e1d308 tempest-CreateVolumesFromSnapshotTest-1654695016 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:44:36 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3933e963-5e23-46e2-acea-b0eb24e1d308 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:36 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-089cc290-01f8-499e-8d38-9de9fd664fcc tempest-VolumesDeleteCascade-1749971429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.103s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:36 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3933e963-5e23-46e2-acea-b0eb24e1d308 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (203f3dd9-4399-4dec-800b-c501bd8dcd32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d298445-7421-4985-9ca7-2a2befb75f30', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:36 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3933e963-5e23-46e2-acea-b0eb24e1d308 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86ad3d95-2c62-4263-8adc-2deec545f175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:36 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-089cc290-01f8-499e-8d38-9de9fd664fcc tempest-VolumesDeleteCascade-1749971429 None] Creating offline snapshot a2e4c8a0-d24d-48db-8db8-c453c72835e6 of volume bc84479a-ea43-49cb-b916-600129bcf692 {{(pid=86875) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:44:36 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-3933e963-5e23-46e2-acea-b0eb24e1d308 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Volume volume-2d298445-7421-4985-9ca7-2a2befb75f30 (2d298445-7421-4985-9ca7-2a2befb75f30): created successfully Nov 03 07:44:36 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3933e963-5e23-46e2-acea-b0eb24e1d308 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86ad3d95-2c62-4263-8adc-2deec545f175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:36 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3933e963-5e23-46e2-acea-b0eb24e1d308 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Flow 'volume_create_manager' (0a4bf2fd-5a0e-4d2f-af73-c331cdb932c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:44:36 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d407dd-12a5-4541-8a1c-e09898c7c6b4]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:36 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-089cc290-01f8-499e-8d38-9de9fd664fcc tempest-VolumesDeleteCascade-1749971429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bc84479a-ea43-49cb-b916-600129bcf692 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:36 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-3933e963-5e23-46e2-acea-b0eb24e1d308 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Created volume successfully. Nov 03 07:44:36 devstack sudo[103590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bc84479a-ea43-49cb-b916-600129bcf692 Nov 03 07:44:36 devstack sudo[103590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:36 devstack sudo[103590]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:36 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-089cc290-01f8-499e-8d38-9de9fd664fcc tempest-VolumesDeleteCascade-1749971429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bc84479a-ea43-49cb-b916-600129bcf692" returned: 0 in 0.390s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:36 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-089cc290-01f8-499e-8d38-9de9fd664fcc tempest-VolumesDeleteCascade-1749971429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bc84479a-ea43-49cb-b916-600129bcf692,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bc84479a-ea43-49cb-b916-600129bcf692.a2e4c8a0-d24d-48db-8db8-c453c72835e6 1G {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:36 devstack sudo[103595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bc84479a-ea43-49cb-b916-600129bcf692,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bc84479a-ea43-49cb-b916-600129bcf692.a2e4c8a0-d24d-48db-8db8-c453c72835e6 1G Nov 03 07:44:36 devstack sudo[103595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:37 devstack sudo[103595]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-089cc290-01f8-499e-8d38-9de9fd664fcc tempest-VolumesDeleteCascade-1749971429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bc84479a-ea43-49cb-b916-600129bcf692,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bc84479a-ea43-49cb-b916-600129bcf692.a2e4c8a0-d24d-48db-8db8-c453c72835e6 1G" returned: 0 in 0.409s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-089cc290-01f8-499e-8d38-9de9fd664fcc tempest-VolumesDeleteCascade-1749971429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc84479a-ea43-49cb-b916-600129bcf692 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bc84479a-ea43-49cb-b916-600129bcf692.a2e4c8a0-d24d-48db-8db8-c453c72835e6 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:37 devstack sudo[103602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc84479a-ea43-49cb-b916-600129bcf692 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bc84479a-ea43-49cb-b916-600129bcf692.a2e4c8a0-d24d-48db-8db8-c453c72835e6 Nov 03 07:44:37 devstack sudo[103602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:37 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-7b557f72-ff96-4a3a-a092-1b9c75178d7f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Acquiring lock "cinder-2d298445-7421-4985-9ca7-2a2befb75f30-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:37 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-7b557f72-ff96-4a3a-a092-1b9c75178d7f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "cinder-2d298445-7421-4985-9ca7-2a2befb75f30-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:37 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-7b557f72-ff96-4a3a-a092-1b9c75178d7f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Acquiring lock "cinder-quobyte-2d298445-7421-4985-9ca7-2a2befb75f30" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:37 devstack sudo[103602]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-089cc290-01f8-499e-8d38-9de9fd664fcc tempest-VolumesDeleteCascade-1749971429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc84479a-ea43-49cb-b916-600129bcf692 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bc84479a-ea43-49cb-b916-600129bcf692.a2e4c8a0-d24d-48db-8db8-c453c72835e6" returned: 0 in 0.331s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:37 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-089cc290-01f8-499e-8d38-9de9fd664fcc tempest-VolumesDeleteCascade-1749971429 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bc84479a-ea43-49cb-b916-600129bcf692.a2e4c8a0-d24d-48db-8db8-c453c72835e6 is being set with open permissions: ugo+rw Nov 03 07:44:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-089cc290-01f8-499e-8d38-9de9fd664fcc tempest-VolumesDeleteCascade-1749971429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bc84479a-ea43-49cb-b916-600129bcf692.a2e4c8a0-d24d-48db-8db8-c453c72835e6 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:37 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-7b557f72-ff96-4a3a-a092-1b9c75178d7f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "cinder-quobyte-2d298445-7421-4985-9ca7-2a2befb75f30" acquired by "delete_volume" :: waited 0.024s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:37 devstack sudo[103607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bc84479a-ea43-49cb-b916-600129bcf692.a2e4c8a0-d24d-48db-8db8-c453c72835e6 Nov 03 07:44:37 devstack sudo[103607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:37 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfab76ba-313a-4978-8f41-90f5a056269e]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7b557f72-ff96-4a3a-a092-1b9c75178d7f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2d298445-7421-4985-9ca7-2a2befb75f30 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:37 devstack sudo[103609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2d298445-7421-4985-9ca7-2a2befb75f30 Nov 03 07:44:37 devstack sudo[103609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:37 devstack sudo[103607]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-089cc290-01f8-499e-8d38-9de9fd664fcc tempest-VolumesDeleteCascade-1749971429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bc84479a-ea43-49cb-b916-600129bcf692.a2e4c8a0-d24d-48db-8db8-c453c72835e6" returned: 0 in 0.256s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-089cc290-01f8-499e-8d38-9de9fd664fcc tempest-VolumesDeleteCascade-1749971429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bc84479a-ea43-49cb-b916-600129bcf692.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:37 devstack sudo[103612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bc84479a-ea43-49cb-b916-600129bcf692.info Nov 03 07:44:37 devstack sudo[103612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:37 devstack sudo[103609]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7b557f72-ff96-4a3a-a092-1b9c75178d7f tempest-CreateVolumesFromSnapshotTest-1654695016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2d298445-7421-4985-9ca7-2a2befb75f30" returned: 0 in 0.366s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7b557f72-ff96-4a3a-a092-1b9c75178d7f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2d298445-7421-4985-9ca7-2a2befb75f30 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:37 devstack sudo[103618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2d298445-7421-4985-9ca7-2a2befb75f30 Nov 03 07:44:37 devstack sudo[103618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:38 devstack sudo[103612]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-089cc290-01f8-499e-8d38-9de9fd664fcc tempest-VolumesDeleteCascade-1749971429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bc84479a-ea43-49cb-b916-600129bcf692.info" returned: 0 in 0.277s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:38 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-089cc290-01f8-499e-8d38-9de9fd664fcc tempest-VolumesDeleteCascade-1749971429 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bc84479a-ea43-49cb-b916-600129bcf692.info is being set with open permissions: ugo+rw Nov 03 07:44:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-089cc290-01f8-499e-8d38-9de9fd664fcc tempest-VolumesDeleteCascade-1749971429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bc84479a-ea43-49cb-b916-600129bcf692.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:38 devstack sudo[103621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bc84479a-ea43-49cb-b916-600129bcf692.info Nov 03 07:44:38 devstack sudo[103621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:38 devstack sudo[103618]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7b557f72-ff96-4a3a-a092-1b9c75178d7f tempest-CreateVolumesFromSnapshotTest-1654695016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2d298445-7421-4985-9ca7-2a2befb75f30" returned: 0 in 0.258s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:38 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-7b557f72-ff96-4a3a-a092-1b9c75178d7f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "cinder-quobyte-2d298445-7421-4985-9ca7-2a2befb75f30" released by "delete_volume" :: held 0.680s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:38 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-7b557f72-ff96-4a3a-a092-1b9c75178d7f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Created reservations ['bf3b91a1-d56f-439e-a0fa-fd7dfe7aba2e', 'c3b17205-47df-4bd1-86c6-810334da703e', '6d19a614-5b11-4e0a-bd34-295f80bd745c', '9072c81d-92f2-4ced-9f6a-9153e91e1849'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:44:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7b557f72-ff96-4a3a-a092-1b9c75178d7f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7b557f72-ff96-4a3a-a092-1b9c75178d7f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:38 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-7b557f72-ff96-4a3a-a092-1b9c75178d7f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:44:38 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-7b557f72-ff96-4a3a-a092-1b9c75178d7f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:44:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7b557f72-ff96-4a3a-a092-1b9c75178d7f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7b557f72-ff96-4a3a-a092-1b9c75178d7f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:38 devstack sudo[103621]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-089cc290-01f8-499e-8d38-9de9fd664fcc tempest-VolumesDeleteCascade-1749971429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bc84479a-ea43-49cb-b916-600129bcf692.info" returned: 0 in 0.288s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:38 devstack sudo[103625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:44:38 devstack sudo[103625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-089cc290-01f8-499e-8d38-9de9fd664fcc tempest-VolumesDeleteCascade-1749971429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.075s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:38 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-089cc290-01f8-499e-8d38-9de9fd664fcc tempest-VolumesDeleteCascade-1749971429 None] Create snapshot completed successfully Nov 03 07:44:38 devstack sudo[103625]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7b557f72-ff96-4a3a-a092-1b9c75178d7f tempest-CreateVolumesFromSnapshotTest-1654695016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.269s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:38 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-7b557f72-ff96-4a3a-a092-1b9c75178d7f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:44:38 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-7b557f72-ff96-4a3a-a092-1b9c75178d7f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Deleted volume successfully. Nov 03 07:44:38 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-36a314fb-d0c7-451a-a57d-fbc9f546d3df tempest-CreateVolumesFromSnapshotTest-1654695016 None] Acquiring lock "cinder-740f15ee-dbc9-4aa4-9401-f894f237a6ef-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:38 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-7b557f72-ff96-4a3a-a092-1b9c75178d7f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "cinder-2d298445-7421-4985-9ca7-2a2befb75f30-delete_volume" released by "delete_volume" :: held 1.193s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:38 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-36a314fb-d0c7-451a-a57d-fbc9f546d3df tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "cinder-740f15ee-dbc9-4aa4-9401-f894f237a6ef-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:38 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-36a314fb-d0c7-451a-a57d-fbc9f546d3df tempest-CreateVolumesFromSnapshotTest-1654695016 None] Acquiring lock "cinder-quobyte-740f15ee-dbc9-4aa4-9401-f894f237a6ef" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:38 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-36a314fb-d0c7-451a-a57d-fbc9f546d3df tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "cinder-quobyte-740f15ee-dbc9-4aa4-9401-f894f237a6ef" acquired by "delete_volume" :: waited 0.019s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:38 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[9958343a-6899-4317-9915-e4a37b917e0f]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-36a314fb-d0c7-451a-a57d-fbc9f546d3df tempest-CreateVolumesFromSnapshotTest-1654695016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-740f15ee-dbc9-4aa4-9401-f894f237a6ef {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:38 devstack sudo[103628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-740f15ee-dbc9-4aa4-9401-f894f237a6ef Nov 03 07:44:38 devstack sudo[103628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:39 devstack sudo[103628]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-36a314fb-d0c7-451a-a57d-fbc9f546d3df tempest-CreateVolumesFromSnapshotTest-1654695016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-740f15ee-dbc9-4aa4-9401-f894f237a6ef" returned: 0 in 0.405s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-36a314fb-d0c7-451a-a57d-fbc9f546d3df tempest-CreateVolumesFromSnapshotTest-1654695016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-740f15ee-dbc9-4aa4-9401-f894f237a6ef {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:39 devstack sudo[103633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-740f15ee-dbc9-4aa4-9401-f894f237a6ef Nov 03 07:44:39 devstack sudo[103633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:39 devstack sudo[103633]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-36a314fb-d0c7-451a-a57d-fbc9f546d3df tempest-CreateVolumesFromSnapshotTest-1654695016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-740f15ee-dbc9-4aa4-9401-f894f237a6ef" returned: 0 in 0.265s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:39 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-36a314fb-d0c7-451a-a57d-fbc9f546d3df tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "cinder-quobyte-740f15ee-dbc9-4aa4-9401-f894f237a6ef" released by "delete_volume" :: held 0.716s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:39 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-36a314fb-d0c7-451a-a57d-fbc9f546d3df tempest-CreateVolumesFromSnapshotTest-1654695016 None] Created reservations ['c3a82b81-efff-4569-84c4-0a66c4148ec3', '6a9ecb9c-97cd-4fcb-beeb-5741229557bf', 'f41ff823-b1d2-4d7b-afb4-c9aa0244f4ad', '4751da2d-7207-42c2-b5a0-1a35cc760b91'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:44:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-36a314fb-d0c7-451a-a57d-fbc9f546d3df tempest-CreateVolumesFromSnapshotTest-1654695016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-36a314fb-d0c7-451a-a57d-fbc9f546d3df tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:39 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-36a314fb-d0c7-451a-a57d-fbc9f546d3df tempest-CreateVolumesFromSnapshotTest-1654695016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:44:39 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-36a314fb-d0c7-451a-a57d-fbc9f546d3df tempest-CreateVolumesFromSnapshotTest-1654695016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:44:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-36a314fb-d0c7-451a-a57d-fbc9f546d3df tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-36a314fb-d0c7-451a-a57d-fbc9f546d3df tempest-CreateVolumesFromSnapshotTest-1654695016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:39 devstack sudo[103636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:44:39 devstack sudo[103636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:39 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-5fd1ef75-b551-46b2-8e99-d76a4681294f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Acquiring lock "cinder-769d4579-e505-414d-8395-355716d91d43-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:39 devstack sudo[103636]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:39 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-5fd1ef75-b551-46b2-8e99-d76a4681294f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "cinder-769d4579-e505-414d-8395-355716d91d43-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-36a314fb-d0c7-451a-a57d-fbc9f546d3df tempest-CreateVolumesFromSnapshotTest-1654695016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.312s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:39 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-36a314fb-d0c7-451a-a57d-fbc9f546d3df tempest-CreateVolumesFromSnapshotTest-1654695016 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:44:39 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-36a314fb-d0c7-451a-a57d-fbc9f546d3df tempest-CreateVolumesFromSnapshotTest-1654695016 None] Deleted volume successfully. Nov 03 07:44:39 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0943717-7c28-4592-8c9f-03352959a12f tempest-VolumesDeleteCascade-1749971429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:44:39 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-5fd1ef75-b551-46b2-8e99-d76a4681294f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Acquiring lock "cinder-quobyte-769d4579-e505-414d-8395-355716d91d43" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:39 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-36a314fb-d0c7-451a-a57d-fbc9f546d3df tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "cinder-740f15ee-dbc9-4aa4-9401-f894f237a6ef-delete_volume" released by "delete_volume" :: held 1.288s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:39 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-5fd1ef75-b551-46b2-8e99-d76a4681294f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "cinder-quobyte-769d4579-e505-414d-8395-355716d91d43" acquired by "delete_volume" :: waited 0.019s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:39 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c0943717-7c28-4592-8c9f-03352959a12f tempest-VolumesDeleteCascade-1749971429 None] Flow 'volume_create_manager' (373b5572-4a09-4bae-8d3a-790b9db15515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:44:39 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c0943717-7c28-4592-8c9f-03352959a12f tempest-VolumesDeleteCascade-1749971429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c828be1-fb95-4780-9b15-1d15ddeb9b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:40 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca337dd-02af-40d1-a9d5-067c4a16f426]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5fd1ef75-b551-46b2-8e99-d76a4681294f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-769d4579-e505-414d-8395-355716d91d43 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:40 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c0943717-7c28-4592-8c9f-03352959a12f tempest-VolumesDeleteCascade-1749971429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c828be1-fb95-4780-9b15-1d15ddeb9b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:44:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-16770442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f6a9fbf-194e-42c8-82e7-db1dcf778870,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='110f99a92f104579b60e13555a6a9fd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:44:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a2e4c8a0-d24d-48db-8db8-c453c72835e6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:44:40Z,use_quota=True,user_id='65bb1d04b38a4c51be24a06b0598c17e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:40 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c0943717-7c28-4592-8c9f-03352959a12f tempest-VolumesDeleteCascade-1749971429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80abc441-bdb4-41ee-807d-2c01a36317ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:40 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c0943717-7c28-4592-8c9f-03352959a12f tempest-VolumesDeleteCascade-1749971429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80abc441-bdb4-41ee-807d-2c01a36317ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:40 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c0943717-7c28-4592-8c9f-03352959a12f tempest-VolumesDeleteCascade-1749971429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93788084-d684-4246-8bb9-807c743c195a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:40 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c0943717-7c28-4592-8c9f-03352959a12f tempest-VolumesDeleteCascade-1749971429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93788084-d684-4246-8bb9-807c743c195a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6f6a9fbf-194e-42c8-82e7-db1dcf778870', 'volume_name': 'volume-6f6a9fbf-194e-42c8-82e7-db1dcf778870', 'volume_size': 1, 'snapshot_id': 'a2e4c8a0-d24d-48db-8db8-c453c72835e6'}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:40 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c0943717-7c28-4592-8c9f-03352959a12f tempest-VolumesDeleteCascade-1749971429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a45d3ae1-f92b-474e-9233-71b002710038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:40 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c0943717-7c28-4592-8c9f-03352959a12f tempest-VolumesDeleteCascade-1749971429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a45d3ae1-f92b-474e-9233-71b002710038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:40 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c0943717-7c28-4592-8c9f-03352959a12f tempest-VolumesDeleteCascade-1749971429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42ac418e-9c6a-4d72-87be-9d6454d92bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:40 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-c0943717-7c28-4592-8c9f-03352959a12f tempest-VolumesDeleteCascade-1749971429 None] Volume 6f6a9fbf-194e-42c8-82e7-db1dcf778870: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6f6a9fbf-194e-42c8-82e7-db1dcf778870', 'volume_size': 1, 'snapshot_id': 'a2e4c8a0-d24d-48db-8db8-c453c72835e6'} Nov 03 07:44:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-c0943717-7c28-4592-8c9f-03352959a12f tempest-VolumesDeleteCascade-1749971429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-c0943717-7c28-4592-8c9f-03352959a12f tempest-VolumesDeleteCascade-1749971429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:40 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-c0943717-7c28-4592-8c9f-03352959a12f tempest-VolumesDeleteCascade-1749971429 None] Acquiring lock "cinder-quobyte-a2e4c8a0-d24d-48db-8db8-c453c72835e6-6f6a9fbf-194e-42c8-82e7-db1dcf778870" by "_create_volume_from_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:40 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-c0943717-7c28-4592-8c9f-03352959a12f tempest-VolumesDeleteCascade-1749971429 None] Lock "cinder-quobyte-a2e4c8a0-d24d-48db-8db8-c453c72835e6-6f6a9fbf-194e-42c8-82e7-db1dcf778870" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:40 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-c0943717-7c28-4592-8c9f-03352959a12f tempest-VolumesDeleteCascade-1749971429 None] Creating volume 6f6a9fbf-194e-42c8-82e7-db1dcf778870 from snapshot a2e4c8a0-d24d-48db-8db8-c453c72835e6 {{(pid=86875) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 07:44:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-c0943717-7c28-4592-8c9f-03352959a12f tempest-VolumesDeleteCascade-1749971429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-c0943717-7c28-4592-8c9f-03352959a12f tempest-VolumesDeleteCascade-1749971429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:40 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-c0943717-7c28-4592-8c9f-03352959a12f tempest-VolumesDeleteCascade-1749971429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:44:40 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-c0943717-7c28-4592-8c9f-03352959a12f tempest-VolumesDeleteCascade-1749971429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:44:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-c0943717-7c28-4592-8c9f-03352959a12f tempest-VolumesDeleteCascade-1749971429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:40 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-c0943717-7c28-4592-8c9f-03352959a12f tempest-VolumesDeleteCascade-1749971429 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:44:40 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-c0943717-7c28-4592-8c9f-03352959a12f tempest-VolumesDeleteCascade-1749971429 None] Acquiring lock "cinder-quobyte-6f6a9fbf-194e-42c8-82e7-db1dcf778870" by "_copy_volume_from_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:40 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-c0943717-7c28-4592-8c9f-03352959a12f tempest-VolumesDeleteCascade-1749971429 None] Lock "cinder-quobyte-6f6a9fbf-194e-42c8-82e7-db1dcf778870" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:40 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-c0943717-7c28-4592-8c9f-03352959a12f tempest-VolumesDeleteCascade-1749971429 None] snapshot: a2e4c8a0-d24d-48db-8db8-c453c72835e6, volume: 6f6a9fbf-194e-42c8-82e7-db1dcf778870, {{(pid=86875) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 07:44:40 devstack sudo[103639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-769d4579-e505-414d-8395-355716d91d43 Nov 03 07:44:40 devstack sudo[103639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-c0943717-7c28-4592-8c9f-03352959a12f tempest-VolumesDeleteCascade-1749971429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-c0943717-7c28-4592-8c9f-03352959a12f tempest-VolumesDeleteCascade-1749971429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:40 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-c0943717-7c28-4592-8c9f-03352959a12f tempest-VolumesDeleteCascade-1749971429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:44:40 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-c0943717-7c28-4592-8c9f-03352959a12f tempest-VolumesDeleteCascade-1749971429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:44:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-c0943717-7c28-4592-8c9f-03352959a12f tempest-VolumesDeleteCascade-1749971429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:40 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[224ce6da-72f3-4e1d-942d-fd391155e1a9]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c0943717-7c28-4592-8c9f-03352959a12f tempest-VolumesDeleteCascade-1749971429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bc84479a-ea43-49cb-b916-600129bcf692.a2e4c8a0-d24d-48db-8db8-c453c72835e6 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:40 devstack sudo[103641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bc84479a-ea43-49cb-b916-600129bcf692.a2e4c8a0-d24d-48db-8db8-c453c72835e6 Nov 03 07:44:40 devstack sudo[103641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:40 devstack sudo[103639]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5fd1ef75-b551-46b2-8e99-d76a4681294f tempest-CreateVolumesFromSnapshotTest-1654695016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-769d4579-e505-414d-8395-355716d91d43" returned: 0 in 0.439s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5fd1ef75-b551-46b2-8e99-d76a4681294f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-769d4579-e505-414d-8395-355716d91d43 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:40 devstack sudo[103646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-769d4579-e505-414d-8395-355716d91d43 Nov 03 07:44:40 devstack sudo[103646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:40 devstack sudo[103641]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c0943717-7c28-4592-8c9f-03352959a12f tempest-VolumesDeleteCascade-1749971429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bc84479a-ea43-49cb-b916-600129bcf692.a2e4c8a0-d24d-48db-8db8-c453c72835e6" returned: 0 in 0.417s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:40 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-c0943717-7c28-4592-8c9f-03352959a12f tempest-VolumesDeleteCascade-1749971429 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc84479a-ea43-49cb-b916-600129bcf692(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:44:40 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d0c8b4-dbbd-425a-ba70-f88f19b2945c]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c0943717-7c28-4592-8c9f-03352959a12f tempest-VolumesDeleteCascade-1749971429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bc84479a-ea43-49cb-b916-600129bcf692 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:40 devstack sudo[103646]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5fd1ef75-b551-46b2-8e99-d76a4681294f tempest-CreateVolumesFromSnapshotTest-1654695016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-769d4579-e505-414d-8395-355716d91d43" returned: 0 in 0.286s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:40 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-5fd1ef75-b551-46b2-8e99-d76a4681294f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "cinder-quobyte-769d4579-e505-414d-8395-355716d91d43" released by "delete_volume" :: held 0.792s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:40 devstack sudo[103651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bc84479a-ea43-49cb-b916-600129bcf692 Nov 03 07:44:40 devstack sudo[103651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:40 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-5fd1ef75-b551-46b2-8e99-d76a4681294f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Created reservations ['eae20600-934e-409e-a08c-b9bd588241c1', 'b6de3ddd-ca3b-497f-ad9c-685e194b7187', '0f6db809-c32f-4db5-b48e-befe79c2f414', 'e4c4c15f-f1c1-4598-a70b-2cb4864c069a'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:44:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-5fd1ef75-b551-46b2-8e99-d76a4681294f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-5fd1ef75-b551-46b2-8e99-d76a4681294f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:40 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-5fd1ef75-b551-46b2-8e99-d76a4681294f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:44:40 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-5fd1ef75-b551-46b2-8e99-d76a4681294f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:44:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-5fd1ef75-b551-46b2-8e99-d76a4681294f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5fd1ef75-b551-46b2-8e99-d76a4681294f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:40 devstack sudo[103654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:44:40 devstack sudo[103654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:41 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-08481c95-b19e-4541-a6e9-7ef2e6538fc2 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Acquiring lock "cinder-a01d32a8-1885-45a0-a1c0-787a207fb5f4-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:41 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-08481c95-b19e-4541-a6e9-7ef2e6538fc2 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "cinder-a01d32a8-1885-45a0-a1c0-787a207fb5f4-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:41 devstack sudo[103651]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c0943717-7c28-4592-8c9f-03352959a12f tempest-VolumesDeleteCascade-1749971429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bc84479a-ea43-49cb-b916-600129bcf692" returned: 0 in 0.486s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:41 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-c0943717-7c28-4592-8c9f-03352959a12f tempest-VolumesDeleteCascade-1749971429 None] will copy from snapshot at /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bc84479a-ea43-49cb-b916-600129bcf692 {{(pid=86875) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 07:44:41 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-c0943717-7c28-4592-8c9f-03352959a12f tempest-VolumesDeleteCascade-1749971429 None] Creating direct copy from snapshot {{(pid=86875) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 07:44:41 devstack cinder-volume[86875]: DEBUG cinder.utils [None req-c0943717-7c28-4592-8c9f-03352959a12f tempest-VolumesDeleteCascade-1749971429 None] Path /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6f6a9fbf-194e-42c8-82e7-db1dcf778870 not found in is_blk_device check {{(pid=86875) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 07:44:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c0943717-7c28-4592-8c9f-03352959a12f tempest-VolumesDeleteCascade-1749971429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bc84479a-ea43-49cb-b916-600129bcf692 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6f6a9fbf-194e-42c8-82e7-db1dcf778870 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:41 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-08481c95-b19e-4541-a6e9-7ef2e6538fc2 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Acquiring lock "cinder-quobyte-a01d32a8-1885-45a0-a1c0-787a207fb5f4" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:41 devstack sudo[103660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bc84479a-ea43-49cb-b916-600129bcf692 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6f6a9fbf-194e-42c8-82e7-db1dcf778870 Nov 03 07:44:41 devstack sudo[103660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:41 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-08481c95-b19e-4541-a6e9-7ef2e6538fc2 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "cinder-quobyte-a01d32a8-1885-45a0-a1c0-787a207fb5f4" acquired by "delete_volume" :: waited 0.025s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:41 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[63719055-5995-48e0-8dbb-e0b48cf6d4de]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-08481c95-b19e-4541-a6e9-7ef2e6538fc2 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a01d32a8-1885-45a0-a1c0-787a207fb5f4 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:41 devstack sudo[103654]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5fd1ef75-b551-46b2-8e99-d76a4681294f tempest-CreateVolumesFromSnapshotTest-1654695016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.365s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:41 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-5fd1ef75-b551-46b2-8e99-d76a4681294f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:44:41 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-5fd1ef75-b551-46b2-8e99-d76a4681294f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Deleted volume successfully. Nov 03 07:44:41 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-5fd1ef75-b551-46b2-8e99-d76a4681294f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "cinder-769d4579-e505-414d-8395-355716d91d43-delete_volume" released by "delete_volume" :: held 1.444s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:41 devstack sudo[103663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a01d32a8-1885-45a0-a1c0-787a207fb5f4 Nov 03 07:44:41 devstack sudo[103663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:41 devstack sudo[103663]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-08481c95-b19e-4541-a6e9-7ef2e6538fc2 tempest-CreateVolumesFromSnapshotTest-1654695016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a01d32a8-1885-45a0-a1c0-787a207fb5f4" returned: 0 in 0.450s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-08481c95-b19e-4541-a6e9-7ef2e6538fc2 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a01d32a8-1885-45a0-a1c0-787a207fb5f4 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:41 devstack sudo[103680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a01d32a8-1885-45a0-a1c0-787a207fb5f4 Nov 03 07:44:41 devstack sudo[103680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:42 devstack sudo[103680]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-08481c95-b19e-4541-a6e9-7ef2e6538fc2 tempest-CreateVolumesFromSnapshotTest-1654695016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a01d32a8-1885-45a0-a1c0-787a207fb5f4" returned: 0 in 0.398s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:42 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-08481c95-b19e-4541-a6e9-7ef2e6538fc2 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "cinder-quobyte-a01d32a8-1885-45a0-a1c0-787a207fb5f4" released by "delete_volume" :: held 0.906s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:42 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:SELECT=131,cinder:UPDATE=142,cinder:DELETE=12,cinder:INSERT=42 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:44:42 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:SELECT=121,cinder:UPDATE=135,cinder:INSERT=38,cinder:DELETE=13 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:44:42 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-08481c95-b19e-4541-a6e9-7ef2e6538fc2 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Created reservations ['fa1c1297-24b9-4c63-9772-a61ed02b8762', '6cd7a2dd-b609-48e6-b0f3-ac8526a2ecbc', '2535430d-10ee-4eef-8e61-a65307a83597', 'e0e4d8ab-2837-47fe-86c3-64cff836239d'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:44:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-08481c95-b19e-4541-a6e9-7ef2e6538fc2 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-08481c95-b19e-4541-a6e9-7ef2e6538fc2 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:42 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-08481c95-b19e-4541-a6e9-7ef2e6538fc2 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:44:42 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-08481c95-b19e-4541-a6e9-7ef2e6538fc2 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:44:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-08481c95-b19e-4541-a6e9-7ef2e6538fc2 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-08481c95-b19e-4541-a6e9-7ef2e6538fc2 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:42 devstack sudo[103683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:44:42 devstack sudo[103683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:42 devstack sudo[103683]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-08481c95-b19e-4541-a6e9-7ef2e6538fc2 tempest-CreateVolumesFromSnapshotTest-1654695016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.382s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:42 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-08481c95-b19e-4541-a6e9-7ef2e6538fc2 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:44:42 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-08481c95-b19e-4541-a6e9-7ef2e6538fc2 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Deleted volume successfully. Nov 03 07:44:42 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-08481c95-b19e-4541-a6e9-7ef2e6538fc2 tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "cinder-a01d32a8-1885-45a0-a1c0-787a207fb5f4-delete_volume" released by "delete_volume" :: held 1.743s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:43 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-3a5b35bd-e3be-4cdf-a120-b5fcbb0f306f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Acquiring lock "cinder-83c2ccd1-3339-476b-b910-fd9dc73b6c69-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:43 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-3a5b35bd-e3be-4cdf-a120-b5fcbb0f306f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "cinder-83c2ccd1-3339-476b-b910-fd9dc73b6c69-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:43 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-3a5b35bd-e3be-4cdf-a120-b5fcbb0f306f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Acquiring lock "cinder-quobyte-83c2ccd1-3339-476b-b910-fd9dc73b6c69" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:43 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-3a5b35bd-e3be-4cdf-a120-b5fcbb0f306f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "cinder-quobyte-83c2ccd1-3339-476b-b910-fd9dc73b6c69" acquired by "delete_volume" :: waited 0.032s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:43 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf0d945-b444-4df8-a84a-688a270b0e6e]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:43 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3a5b35bd-e3be-4cdf-a120-b5fcbb0f306f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83c2ccd1-3339-476b-b910-fd9dc73b6c69 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:43 devstack sudo[103686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83c2ccd1-3339-476b-b910-fd9dc73b6c69 Nov 03 07:44:43 devstack sudo[103686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:44 devstack sudo[103686]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3a5b35bd-e3be-4cdf-a120-b5fcbb0f306f tempest-CreateVolumesFromSnapshotTest-1654695016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83c2ccd1-3339-476b-b910-fd9dc73b6c69" returned: 0 in 0.691s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3a5b35bd-e3be-4cdf-a120-b5fcbb0f306f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83c2ccd1-3339-476b-b910-fd9dc73b6c69 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:44 devstack sudo[103692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83c2ccd1-3339-476b-b910-fd9dc73b6c69 Nov 03 07:44:44 devstack sudo[103692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:44 devstack sudo[103692]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3a5b35bd-e3be-4cdf-a120-b5fcbb0f306f tempest-CreateVolumesFromSnapshotTest-1654695016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-83c2ccd1-3339-476b-b910-fd9dc73b6c69" returned: 0 in 0.318s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:44 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-3a5b35bd-e3be-4cdf-a120-b5fcbb0f306f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "cinder-quobyte-83c2ccd1-3339-476b-b910-fd9dc73b6c69" released by "delete_volume" :: held 1.122s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:44 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-3a5b35bd-e3be-4cdf-a120-b5fcbb0f306f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Created reservations ['57db9d33-c7ca-4717-bc26-afec6c752ea6', 'da788bc1-4971-4850-a696-c3f3dfeee18a', '1b262121-352f-4f55-aab3-7fe02cf6a545', '4daa2fbb-ba44-43e0-8621-80512185e567'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:44:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3a5b35bd-e3be-4cdf-a120-b5fcbb0f306f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3a5b35bd-e3be-4cdf-a120-b5fcbb0f306f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:45 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-3a5b35bd-e3be-4cdf-a120-b5fcbb0f306f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:44:45 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-3a5b35bd-e3be-4cdf-a120-b5fcbb0f306f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:44:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3a5b35bd-e3be-4cdf-a120-b5fcbb0f306f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3a5b35bd-e3be-4cdf-a120-b5fcbb0f306f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:45 devstack sudo[103695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:44:45 devstack sudo[103695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:45 devstack sudo[103695]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3a5b35bd-e3be-4cdf-a120-b5fcbb0f306f tempest-CreateVolumesFromSnapshotTest-1654695016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.400s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:45 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-3a5b35bd-e3be-4cdf-a120-b5fcbb0f306f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:44:45 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-3a5b35bd-e3be-4cdf-a120-b5fcbb0f306f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Deleted volume successfully. Nov 03 07:44:45 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-3a5b35bd-e3be-4cdf-a120-b5fcbb0f306f tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "cinder-83c2ccd1-3339-476b-b910-fd9dc73b6c69-delete_volume" released by "delete_volume" :: held 1.922s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:46 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a3738830-0979-446c-8843-aae3932a7e6d tempest-CreateVolumesFromSnapshotTest-1654695016 None] Acquiring lock "cinder-d1348762-11e1-4449-b9a0-d1c7756b1b64-delete_snapshot" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:46 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a3738830-0979-446c-8843-aae3932a7e6d tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "cinder-d1348762-11e1-4449-b9a0-d1c7756b1b64-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:46 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a3738830-0979-446c-8843-aae3932a7e6d tempest-CreateVolumesFromSnapshotTest-1654695016 None] Acquiring lock "cinder-quobyte-325e39cf-4c3c-4808-b317-e2731bd93e54" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:46 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a3738830-0979-446c-8843-aae3932a7e6d tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "cinder-quobyte-325e39cf-4c3c-4808-b317-e2731bd93e54" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:46 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a3738830-0979-446c-8843-aae3932a7e6d tempest-CreateVolumesFromSnapshotTest-1654695016 None] Acquiring lock "cinder-quobyte-d1348762-11e1-4449-b9a0-d1c7756b1b64" by "_delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:46 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a3738830-0979-446c-8843-aae3932a7e6d tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "cinder-quobyte-d1348762-11e1-4449-b9a0-d1c7756b1b64" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:46 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-a3738830-0979-446c-8843-aae3932a7e6d tempest-CreateVolumesFromSnapshotTest-1654695016 None] Deleting offline snapshot d1348762-11e1-4449-b9a0-d1c7756b1b64 of volume 325e39cf-4c3c-4808-b317-e2731bd93e54 {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:44:46 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-a3738830-0979-446c-8843-aae3932a7e6d tempest-CreateVolumesFromSnapshotTest-1654695016 None] snapshot_file for this snap is: volume-325e39cf-4c3c-4808-b317-e2731bd93e54.d1348762-11e1-4449-b9a0-d1c7756b1b64 {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:44:46 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[995f309c-6d32-4e2d-9d6d-aa53fd7cfef4]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a3738830-0979-446c-8843-aae3932a7e6d tempest-CreateVolumesFromSnapshotTest-1654695016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-325e39cf-4c3c-4808-b317-e2731bd93e54.d1348762-11e1-4449-b9a0-d1c7756b1b64 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:46 devstack sudo[103698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-325e39cf-4c3c-4808-b317-e2731bd93e54.d1348762-11e1-4449-b9a0-d1c7756b1b64 Nov 03 07:44:46 devstack sudo[103698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:46 devstack sudo[103698]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a3738830-0979-446c-8843-aae3932a7e6d tempest-CreateVolumesFromSnapshotTest-1654695016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-325e39cf-4c3c-4808-b317-e2731bd93e54.d1348762-11e1-4449-b9a0-d1c7756b1b64" returned: 0 in 0.573s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:46 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-a3738830-0979-446c-8843-aae3932a7e6d tempest-CreateVolumesFromSnapshotTest-1654695016 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-325e39cf-4c3c-4808-b317-e2731bd93e54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:44:46 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73eabda-9213-4f8f-8de3-c16465e58021]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a3738830-0979-446c-8843-aae3932a7e6d tempest-CreateVolumesFromSnapshotTest-1654695016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-325e39cf-4c3c-4808-b317-e2731bd93e54 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:47 devstack sudo[103703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-325e39cf-4c3c-4808-b317-e2731bd93e54 Nov 03 07:44:47 devstack sudo[103703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:47 devstack sudo[103703]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:47 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a3738830-0979-446c-8843-aae3932a7e6d tempest-CreateVolumesFromSnapshotTest-1654695016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-325e39cf-4c3c-4808-b317-e2731bd93e54" returned: 0 in 0.707s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:47 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a3738830-0979-446c-8843-aae3932a7e6d tempest-CreateVolumesFromSnapshotTest-1654695016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-325e39cf-4c3c-4808-b317-e2731bd93e54.d1348762-11e1-4449-b9a0-d1c7756b1b64 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:47 devstack sudo[103708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-325e39cf-4c3c-4808-b317-e2731bd93e54.d1348762-11e1-4449-b9a0-d1c7756b1b64 Nov 03 07:44:47 devstack sudo[103708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:48 devstack sudo[103660]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c0943717-7c28-4592-8c9f-03352959a12f tempest-VolumesDeleteCascade-1749971429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bc84479a-ea43-49cb-b916-600129bcf692 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6f6a9fbf-194e-42c8-82e7-db1dcf778870" returned: 0 in 6.986s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:48 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-c0943717-7c28-4592-8c9f-03352959a12f tempest-VolumesDeleteCascade-1749971429 None] Image conversion details: src /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bc84479a-ea43-49cb-b916-600129bcf692, size 1024.00 MB, duration 6.99 sec, destination /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6f6a9fbf-194e-42c8-82e7-db1dcf778870 {{(pid=86875) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:44:48 devstack cinder-volume[86875]: INFO cinder.image.image_utils [None req-c0943717-7c28-4592-8c9f-03352959a12f tempest-VolumesDeleteCascade-1749971429 None] Converted 1024.00 MB image at 146.48 MB/s Nov 03 07:44:48 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-c0943717-7c28-4592-8c9f-03352959a12f tempest-VolumesDeleteCascade-1749971429 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6f6a9fbf-194e-42c8-82e7-db1dcf778870 is being set with open permissions: ugo+rw Nov 03 07:44:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c0943717-7c28-4592-8c9f-03352959a12f tempest-VolumesDeleteCascade-1749971429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6f6a9fbf-194e-42c8-82e7-db1dcf778870 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:48 devstack sudo[103715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6f6a9fbf-194e-42c8-82e7-db1dcf778870 Nov 03 07:44:48 devstack sudo[103715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:48 devstack sudo[103708]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a3738830-0979-446c-8843-aae3932a7e6d tempest-CreateVolumesFromSnapshotTest-1654695016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-325e39cf-4c3c-4808-b317-e2731bd93e54.d1348762-11e1-4449-b9a0-d1c7756b1b64" returned: 0 in 0.582s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a3738830-0979-446c-8843-aae3932a7e6d tempest-CreateVolumesFromSnapshotTest-1654695016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-325e39cf-4c3c-4808-b317-e2731bd93e54.d1348762-11e1-4449-b9a0-d1c7756b1b64 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:48 devstack sudo[103717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-325e39cf-4c3c-4808-b317-e2731bd93e54.d1348762-11e1-4449-b9a0-d1c7756b1b64 Nov 03 07:44:48 devstack sudo[103717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:48 devstack sudo[103715]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c0943717-7c28-4592-8c9f-03352959a12f tempest-VolumesDeleteCascade-1749971429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6f6a9fbf-194e-42c8-82e7-db1dcf778870" returned: 0 in 0.255s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:48 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-c0943717-7c28-4592-8c9f-03352959a12f tempest-VolumesDeleteCascade-1749971429 None] Lock "cinder-quobyte-6f6a9fbf-194e-42c8-82e7-db1dcf778870" released by "_copy_volume_from_snapshot" :: held 8.248s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:48 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-c0943717-7c28-4592-8c9f-03352959a12f tempest-VolumesDeleteCascade-1749971429 None] Lock "cinder-quobyte-a2e4c8a0-d24d-48db-8db8-c453c72835e6-6f6a9fbf-194e-42c8-82e7-db1dcf778870" released by "_create_volume_from_snapshot" :: held 8.334s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-c0943717-7c28-4592-8c9f-03352959a12f tempest-VolumesDeleteCascade-1749971429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.360s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:48 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c0943717-7c28-4592-8c9f-03352959a12f tempest-VolumesDeleteCascade-1749971429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42ac418e-9c6a-4d72-87be-9d6454d92bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f6a9fbf-194e-42c8-82e7-db1dcf778870', 'volume_size': 1, 'snapshot_id': 'a2e4c8a0-d24d-48db-8db8-c453c72835e6'}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:48 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c0943717-7c28-4592-8c9f-03352959a12f tempest-VolumesDeleteCascade-1749971429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a13dd47b-ce76-4453-82fb-bcfd8e7fd966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:44:48 devstack sudo[103717]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a3738830-0979-446c-8843-aae3932a7e6d tempest-CreateVolumesFromSnapshotTest-1654695016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-325e39cf-4c3c-4808-b317-e2731bd93e54.d1348762-11e1-4449-b9a0-d1c7756b1b64" returned: 0 in 0.279s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:48 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-c0943717-7c28-4592-8c9f-03352959a12f tempest-VolumesDeleteCascade-1749971429 None] Volume volume-6f6a9fbf-194e-42c8-82e7-db1dcf778870 (6f6a9fbf-194e-42c8-82e7-db1dcf778870): created successfully Nov 03 07:44:48 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c0943717-7c28-4592-8c9f-03352959a12f tempest-VolumesDeleteCascade-1749971429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a13dd47b-ce76-4453-82fb-bcfd8e7fd966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:44:48 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c0943717-7c28-4592-8c9f-03352959a12f tempest-VolumesDeleteCascade-1749971429 None] Flow 'volume_create_manager' (373b5572-4a09-4bae-8d3a-790b9db15515) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:44:48 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a3738830-0979-446c-8843-aae3932a7e6d tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "cinder-quobyte-d1348762-11e1-4449-b9a0-d1c7756b1b64" released by "_delete_snapshot" :: held 2.345s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:48 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a3738830-0979-446c-8843-aae3932a7e6d tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "cinder-quobyte-325e39cf-4c3c-4808-b317-e2731bd93e54" released by "delete_snapshot" :: held 2.383s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:48 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-c0943717-7c28-4592-8c9f-03352959a12f tempest-VolumesDeleteCascade-1749971429 None] Created volume successfully. Nov 03 07:44:48 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-a3738830-0979-446c-8843-aae3932a7e6d tempest-CreateVolumesFromSnapshotTest-1654695016 None] Created reservations ['1def4c48-141e-4238-8bcf-980436af2ad2', '6e8fb865-23ef-466c-97d3-06c8098b5c1c', '914cef8e-7582-4278-ba64-bf019de353cf', '295bbeee-95b1-45ec-9dab-8c6be1178ffc'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:44:48 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-a3738830-0979-446c-8843-aae3932a7e6d tempest-CreateVolumesFromSnapshotTest-1654695016 None] Delete snapshot completed successfully. Nov 03 07:44:48 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a3738830-0979-446c-8843-aae3932a7e6d tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "cinder-d1348762-11e1-4449-b9a0-d1c7756b1b64-delete_snapshot" released by "delete_snapshot" :: held 2.540s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:48 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-1c657b03-0ec2-4e23-8126-2847b1798424 tempest-VolumesDeleteCascade-1749971429 None] Acquiring lock "cinder-bc84479a-ea43-49cb-b916-600129bcf692-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:48 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-1c657b03-0ec2-4e23-8126-2847b1798424 tempest-VolumesDeleteCascade-1749971429 None] Lock "cinder-bc84479a-ea43-49cb-b916-600129bcf692-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:48 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-1c657b03-0ec2-4e23-8126-2847b1798424 tempest-VolumesDeleteCascade-1749971429 None] Performing cascade delete. {{(pid=86875) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 03 07:44:48 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-1c657b03-0ec2-4e23-8126-2847b1798424 tempest-VolumesDeleteCascade-1749971429 None] Acquiring lock "cinder-a2e4c8a0-d24d-48db-8db8-c453c72835e6-delete_snapshot" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:48 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-1c657b03-0ec2-4e23-8126-2847b1798424 tempest-VolumesDeleteCascade-1749971429 None] Lock "cinder-a2e4c8a0-d24d-48db-8db8-c453c72835e6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:48 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-1c657b03-0ec2-4e23-8126-2847b1798424 tempest-VolumesDeleteCascade-1749971429 None] Acquiring lock "cinder-quobyte-bc84479a-ea43-49cb-b916-600129bcf692" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:49 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-1c657b03-0ec2-4e23-8126-2847b1798424 tempest-VolumesDeleteCascade-1749971429 None] Lock "cinder-quobyte-bc84479a-ea43-49cb-b916-600129bcf692" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:49 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-1c657b03-0ec2-4e23-8126-2847b1798424 tempest-VolumesDeleteCascade-1749971429 None] Acquiring lock "cinder-quobyte-a2e4c8a0-d24d-48db-8db8-c453c72835e6" by "_delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:49 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-1c657b03-0ec2-4e23-8126-2847b1798424 tempest-VolumesDeleteCascade-1749971429 None] Lock "cinder-quobyte-a2e4c8a0-d24d-48db-8db8-c453c72835e6" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:49 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-1c657b03-0ec2-4e23-8126-2847b1798424 tempest-VolumesDeleteCascade-1749971429 None] Deleting offline snapshot a2e4c8a0-d24d-48db-8db8-c453c72835e6 of volume bc84479a-ea43-49cb-b916-600129bcf692 {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:44:49 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-1c657b03-0ec2-4e23-8126-2847b1798424 tempest-VolumesDeleteCascade-1749971429 None] snapshot_file for this snap is: volume-bc84479a-ea43-49cb-b916-600129bcf692.a2e4c8a0-d24d-48db-8db8-c453c72835e6 {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:44:49 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa0f4f5-f5e4-40f2-9936-73cd4aad1ab9]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1c657b03-0ec2-4e23-8126-2847b1798424 tempest-VolumesDeleteCascade-1749971429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bc84479a-ea43-49cb-b916-600129bcf692.a2e4c8a0-d24d-48db-8db8-c453c72835e6 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:49 devstack sudo[103721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bc84479a-ea43-49cb-b916-600129bcf692.a2e4c8a0-d24d-48db-8db8-c453c72835e6 Nov 03 07:44:49 devstack sudo[103721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:49 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-78d2dce8-a2e1-4452-87c8-68152263487b tempest-CreateVolumesFromSnapshotTest-1654695016 None] Acquiring lock "cinder-325e39cf-4c3c-4808-b317-e2731bd93e54-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:49 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-78d2dce8-a2e1-4452-87c8-68152263487b tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "cinder-325e39cf-4c3c-4808-b317-e2731bd93e54-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:49 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-78d2dce8-a2e1-4452-87c8-68152263487b tempest-CreateVolumesFromSnapshotTest-1654695016 None] Acquiring lock "cinder-quobyte-325e39cf-4c3c-4808-b317-e2731bd93e54" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:49 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-78d2dce8-a2e1-4452-87c8-68152263487b tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "cinder-quobyte-325e39cf-4c3c-4808-b317-e2731bd93e54" acquired by "delete_volume" :: waited 0.016s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:49 devstack sudo[103721]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1c657b03-0ec2-4e23-8126-2847b1798424 tempest-VolumesDeleteCascade-1749971429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bc84479a-ea43-49cb-b916-600129bcf692.a2e4c8a0-d24d-48db-8db8-c453c72835e6" returned: 0 in 0.423s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:49 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-1c657b03-0ec2-4e23-8126-2847b1798424 tempest-VolumesDeleteCascade-1749971429 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc84479a-ea43-49cb-b916-600129bcf692(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:44:49 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f3d939-48bd-4de2-9c9f-431a49d3ecc6]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-78d2dce8-a2e1-4452-87c8-68152263487b tempest-CreateVolumesFromSnapshotTest-1654695016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-325e39cf-4c3c-4808-b317-e2731bd93e54 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:49 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d37a7a-5f60-414f-971d-0489cfa901de]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1c657b03-0ec2-4e23-8126-2847b1798424 tempest-VolumesDeleteCascade-1749971429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bc84479a-ea43-49cb-b916-600129bcf692 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:49 devstack sudo[103726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-325e39cf-4c3c-4808-b317-e2731bd93e54 Nov 03 07:44:49 devstack sudo[103726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:49 devstack sudo[103727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bc84479a-ea43-49cb-b916-600129bcf692 Nov 03 07:44:49 devstack sudo[103727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:49 devstack sudo[103726]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-78d2dce8-a2e1-4452-87c8-68152263487b tempest-CreateVolumesFromSnapshotTest-1654695016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-325e39cf-4c3c-4808-b317-e2731bd93e54" returned: 0 in 0.417s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-78d2dce8-a2e1-4452-87c8-68152263487b tempest-CreateVolumesFromSnapshotTest-1654695016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-325e39cf-4c3c-4808-b317-e2731bd93e54 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:49 devstack sudo[103735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-325e39cf-4c3c-4808-b317-e2731bd93e54 Nov 03 07:44:49 devstack sudo[103735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:50 devstack sudo[103727]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1c657b03-0ec2-4e23-8126-2847b1798424 tempest-VolumesDeleteCascade-1749971429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bc84479a-ea43-49cb-b916-600129bcf692" returned: 0 in 0.599s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1c657b03-0ec2-4e23-8126-2847b1798424 tempest-VolumesDeleteCascade-1749971429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bc84479a-ea43-49cb-b916-600129bcf692.a2e4c8a0-d24d-48db-8db8-c453c72835e6 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:50 devstack sudo[103738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bc84479a-ea43-49cb-b916-600129bcf692.a2e4c8a0-d24d-48db-8db8-c453c72835e6 Nov 03 07:44:50 devstack sudo[103738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:50 devstack sudo[103735]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-78d2dce8-a2e1-4452-87c8-68152263487b tempest-CreateVolumesFromSnapshotTest-1654695016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-325e39cf-4c3c-4808-b317-e2731bd93e54" returned: 0 in 0.293s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:50 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-78d2dce8-a2e1-4452-87c8-68152263487b tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "cinder-quobyte-325e39cf-4c3c-4808-b317-e2731bd93e54" released by "delete_volume" :: held 0.792s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:50 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-78d2dce8-a2e1-4452-87c8-68152263487b tempest-CreateVolumesFromSnapshotTest-1654695016 None] Created reservations ['9feb898f-b666-48af-af6e-7470fda21ce9', 'aa005531-d328-4bb9-87fc-4d306f2a7972', '1e52a7db-2b10-4f22-a81b-12de0c7e1253', 'e17f8b54-1fda-4216-98e3-a46039f63034'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:44:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-78d2dce8-a2e1-4452-87c8-68152263487b tempest-CreateVolumesFromSnapshotTest-1654695016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-78d2dce8-a2e1-4452-87c8-68152263487b tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:50 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-78d2dce8-a2e1-4452-87c8-68152263487b tempest-CreateVolumesFromSnapshotTest-1654695016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:44:50 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-78d2dce8-a2e1-4452-87c8-68152263487b tempest-CreateVolumesFromSnapshotTest-1654695016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:44:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-78d2dce8-a2e1-4452-87c8-68152263487b tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-78d2dce8-a2e1-4452-87c8-68152263487b tempest-CreateVolumesFromSnapshotTest-1654695016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:50 devstack sudo[103744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:44:50 devstack sudo[103744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:50 devstack sudo[103738]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1c657b03-0ec2-4e23-8126-2847b1798424 tempest-VolumesDeleteCascade-1749971429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bc84479a-ea43-49cb-b916-600129bcf692.a2e4c8a0-d24d-48db-8db8-c453c72835e6" returned: 0 in 0.402s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1c657b03-0ec2-4e23-8126-2847b1798424 tempest-VolumesDeleteCascade-1749971429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bc84479a-ea43-49cb-b916-600129bcf692.a2e4c8a0-d24d-48db-8db8-c453c72835e6 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:50 devstack sudo[103748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bc84479a-ea43-49cb-b916-600129bcf692.a2e4c8a0-d24d-48db-8db8-c453c72835e6 Nov 03 07:44:50 devstack sudo[103748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:50 devstack sudo[103744]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-78d2dce8-a2e1-4452-87c8-68152263487b tempest-CreateVolumesFromSnapshotTest-1654695016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.265s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:50 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-78d2dce8-a2e1-4452-87c8-68152263487b tempest-CreateVolumesFromSnapshotTest-1654695016 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:44:50 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-78d2dce8-a2e1-4452-87c8-68152263487b tempest-CreateVolumesFromSnapshotTest-1654695016 None] Deleted volume successfully. Nov 03 07:44:50 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-78d2dce8-a2e1-4452-87c8-68152263487b tempest-CreateVolumesFromSnapshotTest-1654695016 None] Lock "cinder-325e39cf-4c3c-4808-b317-e2731bd93e54-delete_volume" released by "delete_volume" :: held 1.281s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:50 devstack sudo[103748]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1c657b03-0ec2-4e23-8126-2847b1798424 tempest-VolumesDeleteCascade-1749971429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bc84479a-ea43-49cb-b916-600129bcf692.a2e4c8a0-d24d-48db-8db8-c453c72835e6" returned: 0 in 0.281s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:50 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-1c657b03-0ec2-4e23-8126-2847b1798424 tempest-VolumesDeleteCascade-1749971429 None] Lock "cinder-quobyte-a2e4c8a0-d24d-48db-8db8-c453c72835e6" released by "_delete_snapshot" :: held 1.803s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:50 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-1c657b03-0ec2-4e23-8126-2847b1798424 tempest-VolumesDeleteCascade-1749971429 None] Lock "cinder-quobyte-bc84479a-ea43-49cb-b916-600129bcf692" released by "delete_snapshot" :: held 1.826s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:50 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-1c657b03-0ec2-4e23-8126-2847b1798424 tempest-VolumesDeleteCascade-1749971429 None] Created reservations ['4228ad3c-b064-4731-b941-e7cd3ba3c9fd', '61634563-b7cf-45c5-9815-79bc2ec4e60e', '2c910f09-23b4-44c7-b5a8-0759cc038d8e', '69062ee8-9e17-44fd-988b-23b1ce18673a'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:44:50 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-1c657b03-0ec2-4e23-8126-2847b1798424 tempest-VolumesDeleteCascade-1749971429 None] Delete snapshot completed successfully. Nov 03 07:44:50 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-1c657b03-0ec2-4e23-8126-2847b1798424 tempest-VolumesDeleteCascade-1749971429 None] Lock "cinder-a2e4c8a0-d24d-48db-8db8-c453c72835e6-delete_snapshot" released by "delete_snapshot" :: held 1.984s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:50 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-1c657b03-0ec2-4e23-8126-2847b1798424 tempest-VolumesDeleteCascade-1749971429 None] Snapshots deleted, issuing volume delete {{(pid=86875) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 03 07:44:50 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-1c657b03-0ec2-4e23-8126-2847b1798424 tempest-VolumesDeleteCascade-1749971429 None] Acquiring lock "cinder-quobyte-bc84479a-ea43-49cb-b916-600129bcf692" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:50 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-1c657b03-0ec2-4e23-8126-2847b1798424 tempest-VolumesDeleteCascade-1749971429 None] Lock "cinder-quobyte-bc84479a-ea43-49cb-b916-600129bcf692" acquired by "delete_volume" :: waited 0.016s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:51 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1685c5-1305-4593-8ff8-191f92147094]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1c657b03-0ec2-4e23-8126-2847b1798424 tempest-VolumesDeleteCascade-1749971429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bc84479a-ea43-49cb-b916-600129bcf692 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:51 devstack sudo[103752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bc84479a-ea43-49cb-b916-600129bcf692 Nov 03 07:44:51 devstack sudo[103752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:51 devstack sudo[103752]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1c657b03-0ec2-4e23-8126-2847b1798424 tempest-VolumesDeleteCascade-1749971429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bc84479a-ea43-49cb-b916-600129bcf692" returned: 0 in 0.413s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1c657b03-0ec2-4e23-8126-2847b1798424 tempest-VolumesDeleteCascade-1749971429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bc84479a-ea43-49cb-b916-600129bcf692 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:51 devstack sudo[103757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bc84479a-ea43-49cb-b916-600129bcf692 Nov 03 07:44:51 devstack sudo[103757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:51 devstack sudo[103757]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1c657b03-0ec2-4e23-8126-2847b1798424 tempest-VolumesDeleteCascade-1749971429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bc84479a-ea43-49cb-b916-600129bcf692" returned: 0 in 0.293s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:51 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-1c657b03-0ec2-4e23-8126-2847b1798424 tempest-VolumesDeleteCascade-1749971429 None] Lock "cinder-quobyte-bc84479a-ea43-49cb-b916-600129bcf692" released by "delete_volume" :: held 0.782s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:51 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-1c657b03-0ec2-4e23-8126-2847b1798424 tempest-VolumesDeleteCascade-1749971429 None] Created reservations ['8ff0cea3-efe7-4fc1-8051-092873c7e71b', 'f767fe2d-1a93-4be4-b82a-52f4e8cd5170', '142fcb11-d87b-45ee-87d4-e2c958a5ae34', '66c89bab-fb32-4759-9d98-8b12ca360cce'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:44:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-1c657b03-0ec2-4e23-8126-2847b1798424 tempest-VolumesDeleteCascade-1749971429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-1c657b03-0ec2-4e23-8126-2847b1798424 tempest-VolumesDeleteCascade-1749971429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:51 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-1c657b03-0ec2-4e23-8126-2847b1798424 tempest-VolumesDeleteCascade-1749971429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:44:51 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-1c657b03-0ec2-4e23-8126-2847b1798424 tempest-VolumesDeleteCascade-1749971429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:44:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-1c657b03-0ec2-4e23-8126-2847b1798424 tempest-VolumesDeleteCascade-1749971429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1c657b03-0ec2-4e23-8126-2847b1798424 tempest-VolumesDeleteCascade-1749971429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:51 devstack sudo[103761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:44:51 devstack sudo[103761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:52 devstack sudo[103761]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1c657b03-0ec2-4e23-8126-2847b1798424 tempest-VolumesDeleteCascade-1749971429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.301s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:52 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-1c657b03-0ec2-4e23-8126-2847b1798424 tempest-VolumesDeleteCascade-1749971429 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:44:52 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-1c657b03-0ec2-4e23-8126-2847b1798424 tempest-VolumesDeleteCascade-1749971429 None] Deleted volume successfully. Nov 03 07:44:52 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-1c657b03-0ec2-4e23-8126-2847b1798424 tempest-VolumesDeleteCascade-1749971429 None] Lock "cinder-bc84479a-ea43-49cb-b916-600129bcf692-delete_volume" released by "delete_volume" :: held 3.343s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:52 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-e2674199-831c-41e2-bb3b-9710b3a8a91b tempest-VolumesDeleteCascade-1749971429 None] Acquiring lock "cinder-6f6a9fbf-194e-42c8-82e7-db1dcf778870-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:52 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-e2674199-831c-41e2-bb3b-9710b3a8a91b tempest-VolumesDeleteCascade-1749971429 None] Lock "cinder-6f6a9fbf-194e-42c8-82e7-db1dcf778870-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:52 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-e2674199-831c-41e2-bb3b-9710b3a8a91b tempest-VolumesDeleteCascade-1749971429 None] Acquiring lock "cinder-quobyte-6f6a9fbf-194e-42c8-82e7-db1dcf778870" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:44:52 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-e2674199-831c-41e2-bb3b-9710b3a8a91b tempest-VolumesDeleteCascade-1749971429 None] Lock "cinder-quobyte-6f6a9fbf-194e-42c8-82e7-db1dcf778870" acquired by "delete_volume" :: waited 0.017s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:44:52 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[348e7fc6-8611-4e99-afef-6c75a7e6124b]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:44:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e2674199-831c-41e2-bb3b-9710b3a8a91b tempest-VolumesDeleteCascade-1749971429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6f6a9fbf-194e-42c8-82e7-db1dcf778870 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:52 devstack sudo[103764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6f6a9fbf-194e-42c8-82e7-db1dcf778870 Nov 03 07:44:52 devstack sudo[103764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:52 devstack sudo[103764]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e2674199-831c-41e2-bb3b-9710b3a8a91b tempest-VolumesDeleteCascade-1749971429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6f6a9fbf-194e-42c8-82e7-db1dcf778870" returned: 0 in 0.402s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e2674199-831c-41e2-bb3b-9710b3a8a91b tempest-VolumesDeleteCascade-1749971429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6f6a9fbf-194e-42c8-82e7-db1dcf778870 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:52 devstack sudo[103769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6f6a9fbf-194e-42c8-82e7-db1dcf778870 Nov 03 07:44:52 devstack sudo[103769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:53 devstack sudo[103769]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e2674199-831c-41e2-bb3b-9710b3a8a91b tempest-VolumesDeleteCascade-1749971429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6f6a9fbf-194e-42c8-82e7-db1dcf778870" returned: 0 in 0.250s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:53 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-e2674199-831c-41e2-bb3b-9710b3a8a91b tempest-VolumesDeleteCascade-1749971429 None] Lock "cinder-quobyte-6f6a9fbf-194e-42c8-82e7-db1dcf778870" released by "delete_volume" :: held 0.703s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:44:53 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-e2674199-831c-41e2-bb3b-9710b3a8a91b tempest-VolumesDeleteCascade-1749971429 None] Created reservations ['bec6ab5e-2184-41a9-b86a-5c615c12c4a3', 'd99ed8b6-2a80-4df7-8514-4bde15f21609', '8b6ff982-08a2-46f0-8b98-0954b1946ad9', '8ce9718d-73f6-4653-bcd6-3021a6cddef8'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:44:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e2674199-831c-41e2-bb3b-9710b3a8a91b tempest-VolumesDeleteCascade-1749971429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:44:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e2674199-831c-41e2-bb3b-9710b3a8a91b tempest-VolumesDeleteCascade-1749971429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:44:53 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-e2674199-831c-41e2-bb3b-9710b3a8a91b tempest-VolumesDeleteCascade-1749971429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:44:53 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-e2674199-831c-41e2-bb3b-9710b3a8a91b tempest-VolumesDeleteCascade-1749971429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:44:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e2674199-831c-41e2-bb3b-9710b3a8a91b tempest-VolumesDeleteCascade-1749971429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:44:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e2674199-831c-41e2-bb3b-9710b3a8a91b tempest-VolumesDeleteCascade-1749971429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:44:53 devstack sudo[103772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:44:53 devstack sudo[103772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:44:53 devstack sudo[103772]: pam_unix(sudo:session): session closed for user root Nov 03 07:44:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e2674199-831c-41e2-bb3b-9710b3a8a91b tempest-VolumesDeleteCascade-1749971429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.247s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:44:53 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-e2674199-831c-41e2-bb3b-9710b3a8a91b tempest-VolumesDeleteCascade-1749971429 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:44:53 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-e2674199-831c-41e2-bb3b-9710b3a8a91b tempest-VolumesDeleteCascade-1749971429 None] Deleted volume successfully. Nov 03 07:44:53 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-e2674199-831c-41e2-bb3b-9710b3a8a91b tempest-VolumesDeleteCascade-1749971429 None] Lock "cinder-6f6a9fbf-194e-42c8-82e7-db1dcf778870-delete_volume" released by "delete_volume" :: held 1.154s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:03 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:INSERT=10,cinder:UPDATE=59,cinder:SELECT=32,cinder:DELETE=3 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:45:03 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:SELECT=39,cinder:INSERT=19,cinder:UPDATE=47,cinder:DELETE=3 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:45:03 devstack cinder-volume[86875]: DEBUG oslo_service.periodic_task [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86875) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:45:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:45:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:45:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:03 devstack sudo[103779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:45:03 devstack sudo[103779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:03 devstack sudo[103779]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.269s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:03 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:45:03 devstack cinder-volume[86875]: DEBUG oslo_service.periodic_task [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running periodic task VolumeManager._thread_info {{(pid=86875) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:45:03 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] thread count: 28 {{(pid=86875) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:45:03 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] thread info: [<_MainThread(MainThread, started 125626325639296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86875) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:45:07 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a2b009c-dbcd-4480-9fdf-79669dfbd886 tempest-VolumesActionsTest-1342507824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:45:07 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7a2b009c-dbcd-4480-9fdf-79669dfbd886 tempest-VolumesActionsTest-1342507824 None] Flow 'volume_create_manager' (ddd2c872-d248-4c93-b4c9-084d2d27d7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:45:07 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7a2b009c-dbcd-4480-9fdf-79669dfbd886 tempest-VolumesActionsTest-1342507824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2888f5e2-c93b-4c48-a99f-8952986c53fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:07 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7a2b009c-dbcd-4480-9fdf-79669dfbd886 tempest-VolumesActionsTest-1342507824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2888f5e2-c93b-4c48-a99f-8952986c53fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:45:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-8303385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2237adf3-3cc6-4016-86ae-7bf3839092d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34ab4b091a604d1c876dd089868ce9dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:45:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:45:07Z,use_quota=True,user_id='1ffc868d64dc497ea4cfec04496a63ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:07 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7a2b009c-dbcd-4480-9fdf-79669dfbd886 tempest-VolumesActionsTest-1342507824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7f6db70-bc5e-473c-9243-38ff7ce5b879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:07 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7a2b009c-dbcd-4480-9fdf-79669dfbd886 tempest-VolumesActionsTest-1342507824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7f6db70-bc5e-473c-9243-38ff7ce5b879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:07 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7a2b009c-dbcd-4480-9fdf-79669dfbd886 tempest-VolumesActionsTest-1342507824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dedbfc08-4528-40c3-a967-54dee5203227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:07 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7a2b009c-dbcd-4480-9fdf-79669dfbd886 tempest-VolumesActionsTest-1342507824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dedbfc08-4528-40c3-a967-54dee5203227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2237adf3-3cc6-4016-86ae-7bf3839092d6', 'volume_name': 'volume-2237adf3-3cc6-4016-86ae-7bf3839092d6', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:07 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7a2b009c-dbcd-4480-9fdf-79669dfbd886 tempest-VolumesActionsTest-1342507824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02198fa4-f3bc-4c94-92c2-8392d22e48ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:07 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7a2b009c-dbcd-4480-9fdf-79669dfbd886 tempest-VolumesActionsTest-1342507824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02198fa4-f3bc-4c94-92c2-8392d22e48ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:07 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7a2b009c-dbcd-4480-9fdf-79669dfbd886 tempest-VolumesActionsTest-1342507824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9784165-7783-4a2c-867b-d0646092d3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:07 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-7a2b009c-dbcd-4480-9fdf-79669dfbd886 tempest-VolumesActionsTest-1342507824 None] Volume 2237adf3-3cc6-4016-86ae-7bf3839092d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2237adf3-3cc6-4016-86ae-7bf3839092d6', 'volume_size': 1} Nov 03 07:45:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7a2b009c-dbcd-4480-9fdf-79669dfbd886 tempest-VolumesActionsTest-1342507824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7a2b009c-dbcd-4480-9fdf-79669dfbd886 tempest-VolumesActionsTest-1342507824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:07 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-7a2b009c-dbcd-4480-9fdf-79669dfbd886 tempest-VolumesActionsTest-1342507824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:45:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-8303385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2237adf3-3cc6-4016-86ae-7bf3839092d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34ab4b091a604d1c876dd089868ce9dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:45:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:45:07Z,use_quota=True,user_id='1ffc868d64dc497ea4cfec04496a63ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:45:07 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-7a2b009c-dbcd-4480-9fdf-79669dfbd886 tempest-VolumesActionsTest-1342507824 None] Creating volume 2237adf3-3cc6-4016-86ae-7bf3839092d6 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:45:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7a2b009c-dbcd-4480-9fdf-79669dfbd886 tempest-VolumesActionsTest-1342507824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7a2b009c-dbcd-4480-9fdf-79669dfbd886 tempest-VolumesActionsTest-1342507824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:07 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-7a2b009c-dbcd-4480-9fdf-79669dfbd886 tempest-VolumesActionsTest-1342507824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:45:07 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-7a2b009c-dbcd-4480-9fdf-79669dfbd886 tempest-VolumesActionsTest-1342507824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:45:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7a2b009c-dbcd-4480-9fdf-79669dfbd886 tempest-VolumesActionsTest-1342507824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:07 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-7a2b009c-dbcd-4480-9fdf-79669dfbd886 tempest-VolumesActionsTest-1342507824 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:45:07 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-7a2b009c-dbcd-4480-9fdf-79669dfbd886 tempest-VolumesActionsTest-1342507824 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:45:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7a2b009c-dbcd-4480-9fdf-79669dfbd886 tempest-VolumesActionsTest-1342507824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2237adf3-3cc6-4016-86ae-7bf3839092d6 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:07 devstack sudo[103782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2237adf3-3cc6-4016-86ae-7bf3839092d6 1073741824 Nov 03 07:45:07 devstack sudo[103782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:07 devstack sudo[103782]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7a2b009c-dbcd-4480-9fdf-79669dfbd886 tempest-VolumesActionsTest-1342507824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2237adf3-3cc6-4016-86ae-7bf3839092d6 1073741824" returned: 0 in 0.426s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7a2b009c-dbcd-4480-9fdf-79669dfbd886 tempest-VolumesActionsTest-1342507824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2237adf3-3cc6-4016-86ae-7bf3839092d6 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:08 devstack sudo[103789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2237adf3-3cc6-4016-86ae-7bf3839092d6 Nov 03 07:45:08 devstack sudo[103789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:08 devstack sudo[103789]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7a2b009c-dbcd-4480-9fdf-79669dfbd886 tempest-VolumesActionsTest-1342507824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2237adf3-3cc6-4016-86ae-7bf3839092d6" returned: 0 in 0.246s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:08 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-7a2b009c-dbcd-4480-9fdf-79669dfbd886 tempest-VolumesActionsTest-1342507824 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:45:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7a2b009c-dbcd-4480-9fdf-79669dfbd886 tempest-VolumesActionsTest-1342507824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:08 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7a2b009c-dbcd-4480-9fdf-79669dfbd886 tempest-VolumesActionsTest-1342507824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9784165-7783-4a2c-867b-d0646092d3f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2237adf3-3cc6-4016-86ae-7bf3839092d6', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:08 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7a2b009c-dbcd-4480-9fdf-79669dfbd886 tempest-VolumesActionsTest-1342507824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f40d4b2-c31e-4f7a-b9c8-0453c00e965a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:45:08 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-7a2b009c-dbcd-4480-9fdf-79669dfbd886 tempest-VolumesActionsTest-1342507824 None] Volume volume-2237adf3-3cc6-4016-86ae-7bf3839092d6 (2237adf3-3cc6-4016-86ae-7bf3839092d6): created successfully Nov 03 07:45:08 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7a2b009c-dbcd-4480-9fdf-79669dfbd886 tempest-VolumesActionsTest-1342507824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f40d4b2-c31e-4f7a-b9c8-0453c00e965a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:45:08 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7a2b009c-dbcd-4480-9fdf-79669dfbd886 tempest-VolumesActionsTest-1342507824 None] Flow 'volume_create_manager' (ddd2c872-d248-4c93-b4c9-084d2d27d7fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:45:08 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-7a2b009c-dbcd-4480-9fdf-79669dfbd886 tempest-VolumesActionsTest-1342507824 None] Created volume successfully. Nov 03 07:45:15 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-9095bf75-7bb4-490b-a193-293b0fc55e1e tempest-VolumesActionsTest-1342507824 None] Acquiring lock "cinder-2237adf3-3cc6-4016-86ae-7bf3839092d6" by "attach_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:15 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-9095bf75-7bb4-490b-a193-293b0fc55e1e tempest-VolumesActionsTest-1342507824 None] Lock "cinder-2237adf3-3cc6-4016-86ae-7bf3839092d6" acquired by "attach_volume" :: waited 0.020s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:15 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-9095bf75-7bb4-490b-a193-293b0fc55e1e tempest-VolumesActionsTest-1342507824 None] Attaching volume 2237adf3-3cc6-4016-86ae-7bf3839092d6 to instance bff7b05e-bcee-4787-b9b5-90822b48b89e at mountpoint /dev/vdb on host None. Nov 03 07:45:15 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-9095bf75-7bb4-490b-a193-293b0fc55e1e tempest-VolumesActionsTest-1342507824 None] Attach volume completed successfully. Nov 03 07:45:15 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-9095bf75-7bb4-490b-a193-293b0fc55e1e tempest-VolumesActionsTest-1342507824 None] Lock "cinder-2237adf3-3cc6-4016-86ae-7bf3839092d6" released by "attach_volume" :: held 0.129s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:15 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-1e69a717-797e-4503-a73c-909978c115ee tempest-VolumesActionsTest-1342507824 None] Acquiring lock "cinder-2237adf3-3cc6-4016-86ae-7bf3839092d6-detach_volume" by "detach_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:15 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-1e69a717-797e-4503-a73c-909978c115ee tempest-VolumesActionsTest-1342507824 None] Lock "cinder-2237adf3-3cc6-4016-86ae-7bf3839092d6-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:15 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-1e69a717-797e-4503-a73c-909978c115ee tempest-VolumesActionsTest-1342507824 None] Detaching volume 2237adf3-3cc6-4016-86ae-7bf3839092d6 from instance bff7b05e-bcee-4787-b9b5-90822b48b89e. Nov 03 07:45:15 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-1e69a717-797e-4503-a73c-909978c115ee tempest-VolumesActionsTest-1342507824 None] Detach volume completed successfully. Nov 03 07:45:15 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-1e69a717-797e-4503-a73c-909978c115ee tempest-VolumesActionsTest-1342507824 None] Lock "cinder-2237adf3-3cc6-4016-86ae-7bf3839092d6-detach_volume" released by "detach_volume" :: held 0.069s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:25 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:SELECT=8,cinder:UPDATE=6,cinder:INSERT=1 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:45:25 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:SELECT=9,cinder:UPDATE=6,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:45:25 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-8237e8ac-1102-42c8-ba97-24611068e72a tempest-VolumesActionsTest-1342507824 None] Acquiring lock "cinder-2237adf3-3cc6-4016-86ae-7bf3839092d6" by "attach_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:25 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-8237e8ac-1102-42c8-ba97-24611068e72a tempest-VolumesActionsTest-1342507824 None] Lock "cinder-2237adf3-3cc6-4016-86ae-7bf3839092d6" acquired by "attach_volume" :: waited 0.019s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:26 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-8237e8ac-1102-42c8-ba97-24611068e72a tempest-VolumesActionsTest-1342507824 None] Attaching volume 2237adf3-3cc6-4016-86ae-7bf3839092d6 to instance 25ff6c3b-7e48-44a1-848c-29dd7dc28fc7 at mountpoint /dev/vdb on host None. Nov 03 07:45:26 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-8237e8ac-1102-42c8-ba97-24611068e72a tempest-VolumesActionsTest-1342507824 None] Attach volume completed successfully. Nov 03 07:45:26 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-8237e8ac-1102-42c8-ba97-24611068e72a tempest-VolumesActionsTest-1342507824 None] Lock "cinder-2237adf3-3cc6-4016-86ae-7bf3839092d6" released by "attach_volume" :: held 0.108s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:26 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-8cd56604-0235-439a-864c-7f9fd7a88e29 tempest-VolumesActionsTest-1342507824 None] Acquiring lock "cinder-2237adf3-3cc6-4016-86ae-7bf3839092d6-detach_volume" by "detach_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:45:26 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-8cd56604-0235-439a-864c-7f9fd7a88e29 tempest-VolumesActionsTest-1342507824 None] Lock "cinder-2237adf3-3cc6-4016-86ae-7bf3839092d6-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:45:26 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-8cd56604-0235-439a-864c-7f9fd7a88e29 tempest-VolumesActionsTest-1342507824 None] Detaching volume 2237adf3-3cc6-4016-86ae-7bf3839092d6 from instance 25ff6c3b-7e48-44a1-848c-29dd7dc28fc7. Nov 03 07:45:26 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-8cd56604-0235-439a-864c-7f9fd7a88e29 tempest-VolumesActionsTest-1342507824 None] Detach volume completed successfully. Nov 03 07:45:26 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-8cd56604-0235-439a-864c-7f9fd7a88e29 tempest-VolumesActionsTest-1342507824 None] Lock "cinder-2237adf3-3cc6-4016-86ae-7bf3839092d6-detach_volume" released by "detach_volume" :: held 0.084s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:45:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-cf57ef47-7ff4-4148-87d8-a1ceff431a04 tempest-VolumesActionsTest-1342507824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-cf57ef47-7ff4-4148-87d8-a1ceff431a04 tempest-VolumesActionsTest-1342507824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:31 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa769c68-c167-4f4a-88c6-73a8818e7eb3]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-cf57ef47-7ff4-4148-87d8-a1ceff431a04 tempest-VolumesActionsTest-1342507824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2237adf3-3cc6-4016-86ae-7bf3839092d6 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:31 devstack sudo[104064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2237adf3-3cc6-4016-86ae-7bf3839092d6 Nov 03 07:45:31 devstack sudo[104064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:31 devstack sudo[104064]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-cf57ef47-7ff4-4148-87d8-a1ceff431a04 tempest-VolumesActionsTest-1342507824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2237adf3-3cc6-4016-86ae-7bf3839092d6" returned: 0 in 0.367s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:31 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[de00b98d-1552-4c31-ba36-c41d348801a0]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-cf57ef47-7ff4-4148-87d8-a1ceff431a04 tempest-VolumesActionsTest-1342507824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2237adf3-3cc6-4016-86ae-7bf3839092d6 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:31 devstack sudo[104069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2237adf3-3cc6-4016-86ae-7bf3839092d6 Nov 03 07:45:31 devstack sudo[104069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:31 devstack sudo[104069]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-cf57ef47-7ff4-4148-87d8-a1ceff431a04 tempest-VolumesActionsTest-1342507824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2237adf3-3cc6-4016-86ae-7bf3839092d6" returned: 0 in 0.406s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-cf57ef47-7ff4-4148-87d8-a1ceff431a04 tempest-VolumesActionsTest-1342507824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2237adf3-3cc6-4016-86ae-7bf3839092d6 /opt/stack/data/cinder/conversion/2237adf3-3cc6-4016-86ae-7bf3839092d6.temp_image.97407d2b-84e8-43e4-8ea1-19f049308c07nk23afg0.img {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:31 devstack sudo[104074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2237adf3-3cc6-4016-86ae-7bf3839092d6 /opt/stack/data/cinder/conversion/2237adf3-3cc6-4016-86ae-7bf3839092d6.temp_image.97407d2b-84e8-43e4-8ea1-19f049308c07nk23afg0.img Nov 03 07:45:31 devstack sudo[104074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:36 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:SELECT=7,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:45:37 devstack sudo[104074]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-cf57ef47-7ff4-4148-87d8-a1ceff431a04 tempest-VolumesActionsTest-1342507824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2237adf3-3cc6-4016-86ae-7bf3839092d6 /opt/stack/data/cinder/conversion/2237adf3-3cc6-4016-86ae-7bf3839092d6.temp_image.97407d2b-84e8-43e4-8ea1-19f049308c07nk23afg0.img" returned: 0 in 5.339s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:37 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef1b2d3-ab3f-48de-a29a-78b20c56803b]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-cf57ef47-7ff4-4148-87d8-a1ceff431a04 tempest-VolumesActionsTest-1342507824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2237adf3-3cc6-4016-86ae-7bf3839092d6 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:37 devstack sudo[104090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2237adf3-3cc6-4016-86ae-7bf3839092d6 Nov 03 07:45:37 devstack sudo[104090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:37 devstack sudo[104090]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-cf57ef47-7ff4-4148-87d8-a1ceff431a04 tempest-VolumesActionsTest-1342507824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2237adf3-3cc6-4016-86ae-7bf3839092d6" returned: 0 in 0.514s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:37 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-cf57ef47-7ff4-4148-87d8-a1ceff431a04 tempest-VolumesActionsTest-1342507824 None] Image conversion details: src /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2237adf3-3cc6-4016-86ae-7bf3839092d6, size 1024.00 MB, duration 5.34 sec, destination /opt/stack/data/cinder/conversion/2237adf3-3cc6-4016-86ae-7bf3839092d6.temp_image.97407d2b-84e8-43e4-8ea1-19f049308c07nk23afg0.img {{(pid=86875) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:45:37 devstack cinder-volume[86875]: INFO cinder.image.image_utils [None req-cf57ef47-7ff4-4148-87d8-a1ceff431a04 tempest-VolumesActionsTest-1342507824 None] Converted 1024.00 MB image at 191.77 MB/s Nov 03 07:45:37 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-cf57ef47-7ff4-4148-87d8-a1ceff431a04 tempest-VolumesActionsTest-1342507824 None] 97407d2b-84e8-43e4-8ea1-19f049308c07 was raw, no need to convert to raw {{(pid=86875) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 03 07:45:41 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:45:47 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:SELECT=2 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:45:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-cf57ef47-7ff4-4148-87d8-a1ceff431a04 tempest-VolumesActionsTest-1342507824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.445s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:45:56 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-cf57ef47-7ff4-4148-87d8-a1ceff431a04 tempest-VolumesActionsTest-1342507824 None] Uploaded volume to glance image-id: 97407d2b-84e8-43e4-8ea1-19f049308c07. {{(pid=86875) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 03 07:45:56 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-cf57ef47-7ff4-4148-87d8-a1ceff431a04 tempest-VolumesActionsTest-1342507824 None] Copy volume to image completed successfully. Nov 03 07:45:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-027ccf11-6308-4fd9-b1e3-5c985d230dbf tempest-VolumesActionsTest-1342507824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:45:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-027ccf11-6308-4fd9-b1e3-5c985d230dbf tempest-VolumesActionsTest-1342507824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:45:57 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[6139ea3e-2079-4814-9c81-698ff7311f35]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-027ccf11-6308-4fd9-b1e3-5c985d230dbf tempest-VolumesActionsTest-1342507824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2237adf3-3cc6-4016-86ae-7bf3839092d6 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:57 devstack sudo[104100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2237adf3-3cc6-4016-86ae-7bf3839092d6 Nov 03 07:45:57 devstack sudo[104100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:58 devstack sudo[104100]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-027ccf11-6308-4fd9-b1e3-5c985d230dbf tempest-VolumesActionsTest-1342507824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2237adf3-3cc6-4016-86ae-7bf3839092d6" returned: 0 in 0.357s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:58 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[799fd931-7b78-49e3-b702-39d4ab171924]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:45:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-027ccf11-6308-4fd9-b1e3-5c985d230dbf tempest-VolumesActionsTest-1342507824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2237adf3-3cc6-4016-86ae-7bf3839092d6 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:58 devstack sudo[104106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2237adf3-3cc6-4016-86ae-7bf3839092d6 Nov 03 07:45:58 devstack sudo[104106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:45:58 devstack sudo[104106]: pam_unix(sudo:session): session closed for user root Nov 03 07:45:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-027ccf11-6308-4fd9-b1e3-5c985d230dbf tempest-VolumesActionsTest-1342507824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2237adf3-3cc6-4016-86ae-7bf3839092d6" returned: 0 in 0.350s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:45:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-027ccf11-6308-4fd9-b1e3-5c985d230dbf tempest-VolumesActionsTest-1342507824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2237adf3-3cc6-4016-86ae-7bf3839092d6 /opt/stack/data/cinder/conversion/2237adf3-3cc6-4016-86ae-7bf3839092d6.temp_image.6ce34253-34a5-49c5-ad4a-b41fa959aa5apag3lq8n.img {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:45:58 devstack sudo[104111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2237adf3-3cc6-4016-86ae-7bf3839092d6 /opt/stack/data/cinder/conversion/2237adf3-3cc6-4016-86ae-7bf3839092d6.temp_image.6ce34253-34a5-49c5-ad4a-b41fa959aa5apag3lq8n.img Nov 03 07:45:58 devstack sudo[104111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:03 devstack cinder-volume[86875]: DEBUG oslo_service.periodic_task [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86875) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:46:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:46:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:46:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:03 devstack sudo[104124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:46:03 devstack sudo[104124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:03 devstack sudo[104124]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.334s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:03 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:46:03 devstack cinder-volume[86875]: DEBUG oslo_service.periodic_task [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running periodic task VolumeManager._thread_info {{(pid=86875) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:46:03 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] thread count: 28 {{(pid=86875) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:46:03 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] thread info: [<_MainThread(MainThread, started 125626325639296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86875) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:46:03 devstack sudo[104111]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-027ccf11-6308-4fd9-b1e3-5c985d230dbf tempest-VolumesActionsTest-1342507824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2237adf3-3cc6-4016-86ae-7bf3839092d6 /opt/stack/data/cinder/conversion/2237adf3-3cc6-4016-86ae-7bf3839092d6.temp_image.6ce34253-34a5-49c5-ad4a-b41fa959aa5apag3lq8n.img" returned: 0 in 5.399s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:04 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf2757e-7a6d-4a45-9d0b-c8c695464062]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-027ccf11-6308-4fd9-b1e3-5c985d230dbf tempest-VolumesActionsTest-1342507824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2237adf3-3cc6-4016-86ae-7bf3839092d6 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:04 devstack sudo[104127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2237adf3-3cc6-4016-86ae-7bf3839092d6 Nov 03 07:46:04 devstack sudo[104127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:04 devstack sudo[104127]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-027ccf11-6308-4fd9-b1e3-5c985d230dbf tempest-VolumesActionsTest-1342507824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2237adf3-3cc6-4016-86ae-7bf3839092d6" returned: 0 in 0.536s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:04 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-027ccf11-6308-4fd9-b1e3-5c985d230dbf tempest-VolumesActionsTest-1342507824 None] Image conversion details: src /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2237adf3-3cc6-4016-86ae-7bf3839092d6, size 1024.00 MB, duration 5.40 sec, destination /opt/stack/data/cinder/conversion/2237adf3-3cc6-4016-86ae-7bf3839092d6.temp_image.6ce34253-34a5-49c5-ad4a-b41fa959aa5apag3lq8n.img {{(pid=86875) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:46:04 devstack cinder-volume[86875]: INFO cinder.image.image_utils [None req-027ccf11-6308-4fd9-b1e3-5c985d230dbf tempest-VolumesActionsTest-1342507824 None] Converted 1024.00 MB image at 189.63 MB/s Nov 03 07:46:04 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-027ccf11-6308-4fd9-b1e3-5c985d230dbf tempest-VolumesActionsTest-1342507824 None] 6ce34253-34a5-49c5-ad4a-b41fa959aa5a was raw, converting to qcow2 {{(pid=86875) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Nov 03 07:46:04 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a20c3ed-a3c4-40e2-bf73-ad706b423bbe]: (4, 'raw') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-027ccf11-6308-4fd9-b1e3-5c985d230dbf tempest-VolumesActionsTest-1342507824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/2237adf3-3cc6-4016-86ae-7bf3839092d6.temp_image.6ce34253-34a5-49c5-ad4a-b41fa959aa5apag3lq8n.img {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:04 devstack sudo[104132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/2237adf3-3cc6-4016-86ae-7bf3839092d6.temp_image.6ce34253-34a5-49c5-ad4a-b41fa959aa5apag3lq8n.img Nov 03 07:46:04 devstack sudo[104132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:04 devstack sudo[104132]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-027ccf11-6308-4fd9-b1e3-5c985d230dbf tempest-VolumesActionsTest-1342507824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/2237adf3-3cc6-4016-86ae-7bf3839092d6.temp_image.6ce34253-34a5-49c5-ad4a-b41fa959aa5apag3lq8n.img" returned: 0 in 0.345s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-027ccf11-6308-4fd9-b1e3-5c985d230dbf tempest-VolumesActionsTest-1342507824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/2237adf3-3cc6-4016-86ae-7bf3839092d6.temp_image.6ce34253-34a5-49c5-ad4a-b41fa959aa5apag3lq8n.img {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:05 devstack sudo[104136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/2237adf3-3cc6-4016-86ae-7bf3839092d6.temp_image.6ce34253-34a5-49c5-ad4a-b41fa959aa5apag3lq8n.img Nov 03 07:46:05 devstack sudo[104136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:05 devstack sudo[104136]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-027ccf11-6308-4fd9-b1e3-5c985d230dbf tempest-VolumesActionsTest-1342507824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/2237adf3-3cc6-4016-86ae-7bf3839092d6.temp_image.6ce34253-34a5-49c5-ad4a-b41fa959aa5apag3lq8n.img" returned: 1 in 0.314s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-027ccf11-6308-4fd9-b1e3-5c985d230dbf tempest-VolumesActionsTest-1342507824 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/2237adf3-3cc6-4016-86ae-7bf3839092d6.temp_image.6ce34253-34a5-49c5-ad4a-b41fa959aa5apag3lq8n.img' failed. Not Retrying. {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:46:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-027ccf11-6308-4fd9-b1e3-5c985d230dbf tempest-VolumesActionsTest-1342507824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/2237adf3-3cc6-4016-86ae-7bf3839092d6.temp_image.6ce34253-34a5-49c5-ad4a-b41fa959aa5apag3lq8n.img /opt/stack/data/cinder/conversion/vol_upload__yhixrr_ {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:05 devstack sudo[104141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/2237adf3-3cc6-4016-86ae-7bf3839092d6.temp_image.6ce34253-34a5-49c5-ad4a-b41fa959aa5apag3lq8n.img /opt/stack/data/cinder/conversion/vol_upload__yhixrr_ Nov 03 07:46:05 devstack sudo[104141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:05 devstack sudo[104141]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-027ccf11-6308-4fd9-b1e3-5c985d230dbf tempest-VolumesActionsTest-1342507824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/2237adf3-3cc6-4016-86ae-7bf3839092d6.temp_image.6ce34253-34a5-49c5-ad4a-b41fa959aa5apag3lq8n.img /opt/stack/data/cinder/conversion/vol_upload__yhixrr_" returned: 0 in 0.251s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:05 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-027ccf11-6308-4fd9-b1e3-5c985d230dbf tempest-VolumesActionsTest-1342507824 None] Image conversion details: src /opt/stack/data/cinder/conversion/2237adf3-3cc6-4016-86ae-7bf3839092d6.temp_image.6ce34253-34a5-49c5-ad4a-b41fa959aa5apag3lq8n.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload__yhixrr_ {{(pid=86875) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:46:05 devstack cinder-volume[86875]: INFO cinder.image.image_utils [None req-027ccf11-6308-4fd9-b1e3-5c985d230dbf tempest-VolumesActionsTest-1342507824 None] Converted 1024.00 MB image at 1024.00 MB/s Nov 03 07:46:05 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9ea4a1-2a57-4941-a0e4-11374852e492]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-027ccf11-6308-4fd9-b1e3-5c985d230dbf tempest-VolumesActionsTest-1342507824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload__yhixrr_ {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:05 devstack sudo[104146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload__yhixrr_ Nov 03 07:46:05 devstack sudo[104146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:05 devstack sudo[104146]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-027ccf11-6308-4fd9-b1e3-5c985d230dbf tempest-VolumesActionsTest-1342507824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload__yhixrr_" returned: 0 in 0.322s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-027ccf11-6308-4fd9-b1e3-5c985d230dbf tempest-VolumesActionsTest-1342507824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.250s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:07 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-027ccf11-6308-4fd9-b1e3-5c985d230dbf tempest-VolumesActionsTest-1342507824 None] Uploaded volume to glance image-id: 6ce34253-34a5-49c5-ad4a-b41fa959aa5a. {{(pid=86875) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 03 07:46:07 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-027ccf11-6308-4fd9-b1e3-5c985d230dbf tempest-VolumesActionsTest-1342507824 None] Copy volume to image completed successfully. Nov 03 07:46:07 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-cf7d0a85-f73e-4b64-9cae-7222cd09a238 tempest-VolumesActionsTest-1342507824 None] Acquiring lock "cinder-2237adf3-3cc6-4016-86ae-7bf3839092d6-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:07 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-cf7d0a85-f73e-4b64-9cae-7222cd09a238 tempest-VolumesActionsTest-1342507824 None] Lock "cinder-2237adf3-3cc6-4016-86ae-7bf3839092d6-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:07 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-cf7d0a85-f73e-4b64-9cae-7222cd09a238 tempest-VolumesActionsTest-1342507824 None] Acquiring lock "cinder-quobyte-2237adf3-3cc6-4016-86ae-7bf3839092d6" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:07 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-cf7d0a85-f73e-4b64-9cae-7222cd09a238 tempest-VolumesActionsTest-1342507824 None] Lock "cinder-quobyte-2237adf3-3cc6-4016-86ae-7bf3839092d6" acquired by "delete_volume" :: waited 0.016s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:07 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2ce8fa-75b6-452f-9195-55cf3e2bf6a0]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-cf7d0a85-f73e-4b64-9cae-7222cd09a238 tempest-VolumesActionsTest-1342507824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2237adf3-3cc6-4016-86ae-7bf3839092d6 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:08 devstack sudo[104152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2237adf3-3cc6-4016-86ae-7bf3839092d6 Nov 03 07:46:08 devstack sudo[104152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:08 devstack sudo[104152]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-cf7d0a85-f73e-4b64-9cae-7222cd09a238 tempest-VolumesActionsTest-1342507824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2237adf3-3cc6-4016-86ae-7bf3839092d6" returned: 0 in 0.370s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-cf7d0a85-f73e-4b64-9cae-7222cd09a238 tempest-VolumesActionsTest-1342507824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2237adf3-3cc6-4016-86ae-7bf3839092d6 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:08 devstack sudo[104157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2237adf3-3cc6-4016-86ae-7bf3839092d6 Nov 03 07:46:08 devstack sudo[104157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:08 devstack sudo[104157]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-cf7d0a85-f73e-4b64-9cae-7222cd09a238 tempest-VolumesActionsTest-1342507824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2237adf3-3cc6-4016-86ae-7bf3839092d6" returned: 0 in 0.242s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:08 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-cf7d0a85-f73e-4b64-9cae-7222cd09a238 tempest-VolumesActionsTest-1342507824 None] Lock "cinder-quobyte-2237adf3-3cc6-4016-86ae-7bf3839092d6" released by "delete_volume" :: held 0.652s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:08 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-cf7d0a85-f73e-4b64-9cae-7222cd09a238 tempest-VolumesActionsTest-1342507824 None] Created reservations ['d4f2fcdf-0519-4842-a7af-b8b9b18b20cd', '323e2aaf-0d80-49c4-9c44-0703429246b4', '6e50c55c-0083-42de-9516-00e2879da929', 'cacab3cb-4ed3-4ae3-81ac-f7de4eb55049'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:46:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-cf7d0a85-f73e-4b64-9cae-7222cd09a238 tempest-VolumesActionsTest-1342507824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-cf7d0a85-f73e-4b64-9cae-7222cd09a238 tempest-VolumesActionsTest-1342507824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:08 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-cf7d0a85-f73e-4b64-9cae-7222cd09a238 tempest-VolumesActionsTest-1342507824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:46:08 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-cf7d0a85-f73e-4b64-9cae-7222cd09a238 tempest-VolumesActionsTest-1342507824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:46:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-cf7d0a85-f73e-4b64-9cae-7222cd09a238 tempest-VolumesActionsTest-1342507824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-cf7d0a85-f73e-4b64-9cae-7222cd09a238 tempest-VolumesActionsTest-1342507824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:08 devstack sudo[104160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:46:08 devstack sudo[104160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:08 devstack sudo[104160]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-cf7d0a85-f73e-4b64-9cae-7222cd09a238 tempest-VolumesActionsTest-1342507824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.236s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:08 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-cf7d0a85-f73e-4b64-9cae-7222cd09a238 tempest-VolumesActionsTest-1342507824 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:46:08 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-cf7d0a85-f73e-4b64-9cae-7222cd09a238 tempest-VolumesActionsTest-1342507824 None] Deleted volume successfully. Nov 03 07:46:08 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-cf7d0a85-f73e-4b64-9cae-7222cd09a238 tempest-VolumesActionsTest-1342507824 None] Lock "cinder-2237adf3-3cc6-4016-86ae-7bf3839092d6-delete_volume" released by "delete_volume" :: held 1.094s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:16 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-30a60bda-cd37-4dcf-b9f6-5006b3e112eb tempest-VolumesNegativeTest-673674835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:46:16 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-30a60bda-cd37-4dcf-b9f6-5006b3e112eb tempest-VolumesNegativeTest-673674835 None] Flow 'volume_create_manager' (9cb6579b-c629-4c7a-a04b-1702121a7924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:46:16 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-30a60bda-cd37-4dcf-b9f6-5006b3e112eb tempest-VolumesNegativeTest-673674835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5afa041f-41aa-46bf-9c85-de961cdee86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:16 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-30a60bda-cd37-4dcf-b9f6-5006b3e112eb tempest-VolumesNegativeTest-673674835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5afa041f-41aa-46bf-9c85-de961cdee86a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:46:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1805466323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32d9b12c-89fc-49fa-8830-9a7d99fbacf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='340fe63f4d0d41c1b381c2a7d71113fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:46:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:46:16Z,use_quota=True,user_id='a8bc41fc6f5f4b0bbd99d42f35655701',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:16 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-30a60bda-cd37-4dcf-b9f6-5006b3e112eb tempest-VolumesNegativeTest-673674835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d427880-f066-43fb-b6b1-05ad31efe652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:16 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-30a60bda-cd37-4dcf-b9f6-5006b3e112eb tempest-VolumesNegativeTest-673674835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d427880-f066-43fb-b6b1-05ad31efe652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:16 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-30a60bda-cd37-4dcf-b9f6-5006b3e112eb tempest-VolumesNegativeTest-673674835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6e2238c-39a0-4a38-8a3e-75742f4b5d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:16 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-30a60bda-cd37-4dcf-b9f6-5006b3e112eb tempest-VolumesNegativeTest-673674835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6e2238c-39a0-4a38-8a3e-75742f4b5d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32d9b12c-89fc-49fa-8830-9a7d99fbacf5', 'volume_name': 'volume-32d9b12c-89fc-49fa-8830-9a7d99fbacf5', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:16 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-30a60bda-cd37-4dcf-b9f6-5006b3e112eb tempest-VolumesNegativeTest-673674835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec7ca2da-96b5-4bc7-81b2-2f21c2452a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:16 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-30a60bda-cd37-4dcf-b9f6-5006b3e112eb tempest-VolumesNegativeTest-673674835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec7ca2da-96b5-4bc7-81b2-2f21c2452a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:16 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-30a60bda-cd37-4dcf-b9f6-5006b3e112eb tempest-VolumesNegativeTest-673674835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a42972c-62f9-4101-81a9-61305ed2ea58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:16 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-30a60bda-cd37-4dcf-b9f6-5006b3e112eb tempest-VolumesNegativeTest-673674835 None] Volume 32d9b12c-89fc-49fa-8830-9a7d99fbacf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32d9b12c-89fc-49fa-8830-9a7d99fbacf5', 'volume_size': 1} Nov 03 07:46:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-30a60bda-cd37-4dcf-b9f6-5006b3e112eb tempest-VolumesNegativeTest-673674835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-30a60bda-cd37-4dcf-b9f6-5006b3e112eb tempest-VolumesNegativeTest-673674835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:16 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-30a60bda-cd37-4dcf-b9f6-5006b3e112eb tempest-VolumesNegativeTest-673674835 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:46:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1805466323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32d9b12c-89fc-49fa-8830-9a7d99fbacf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='340fe63f4d0d41c1b381c2a7d71113fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:46:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:46:16Z,use_quota=True,user_id='a8bc41fc6f5f4b0bbd99d42f35655701',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:46:16 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-30a60bda-cd37-4dcf-b9f6-5006b3e112eb tempest-VolumesNegativeTest-673674835 None] Creating volume 32d9b12c-89fc-49fa-8830-9a7d99fbacf5 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:46:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-30a60bda-cd37-4dcf-b9f6-5006b3e112eb tempest-VolumesNegativeTest-673674835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-30a60bda-cd37-4dcf-b9f6-5006b3e112eb tempest-VolumesNegativeTest-673674835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:16 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-30a60bda-cd37-4dcf-b9f6-5006b3e112eb tempest-VolumesNegativeTest-673674835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:46:16 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-30a60bda-cd37-4dcf-b9f6-5006b3e112eb tempest-VolumesNegativeTest-673674835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:46:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-30a60bda-cd37-4dcf-b9f6-5006b3e112eb tempest-VolumesNegativeTest-673674835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:16 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-30a60bda-cd37-4dcf-b9f6-5006b3e112eb tempest-VolumesNegativeTest-673674835 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:46:16 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-30a60bda-cd37-4dcf-b9f6-5006b3e112eb tempest-VolumesNegativeTest-673674835 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:46:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-30a60bda-cd37-4dcf-b9f6-5006b3e112eb tempest-VolumesNegativeTest-673674835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-32d9b12c-89fc-49fa-8830-9a7d99fbacf5 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:16 devstack sudo[104166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-32d9b12c-89fc-49fa-8830-9a7d99fbacf5 1073741824 Nov 03 07:46:16 devstack sudo[104166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:16 devstack sudo[104166]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-30a60bda-cd37-4dcf-b9f6-5006b3e112eb tempest-VolumesNegativeTest-673674835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-32d9b12c-89fc-49fa-8830-9a7d99fbacf5 1073741824" returned: 0 in 0.463s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-30a60bda-cd37-4dcf-b9f6-5006b3e112eb tempest-VolumesNegativeTest-673674835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-32d9b12c-89fc-49fa-8830-9a7d99fbacf5 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:16 devstack sudo[104172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-32d9b12c-89fc-49fa-8830-9a7d99fbacf5 Nov 03 07:46:16 devstack sudo[104172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:17 devstack sudo[104172]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-30a60bda-cd37-4dcf-b9f6-5006b3e112eb tempest-VolumesNegativeTest-673674835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-32d9b12c-89fc-49fa-8830-9a7d99fbacf5" returned: 0 in 0.282s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:17 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-30a60bda-cd37-4dcf-b9f6-5006b3e112eb tempest-VolumesNegativeTest-673674835 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:46:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-30a60bda-cd37-4dcf-b9f6-5006b3e112eb tempest-VolumesNegativeTest-673674835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:17 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-30a60bda-cd37-4dcf-b9f6-5006b3e112eb tempest-VolumesNegativeTest-673674835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a42972c-62f9-4101-81a9-61305ed2ea58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32d9b12c-89fc-49fa-8830-9a7d99fbacf5', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:17 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-30a60bda-cd37-4dcf-b9f6-5006b3e112eb tempest-VolumesNegativeTest-673674835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c088e252-098a-4a8f-b686-e97453b65217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:17 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-30a60bda-cd37-4dcf-b9f6-5006b3e112eb tempest-VolumesNegativeTest-673674835 None] Volume volume-32d9b12c-89fc-49fa-8830-9a7d99fbacf5 (32d9b12c-89fc-49fa-8830-9a7d99fbacf5): created successfully Nov 03 07:46:17 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-30a60bda-cd37-4dcf-b9f6-5006b3e112eb tempest-VolumesNegativeTest-673674835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c088e252-098a-4a8f-b686-e97453b65217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:17 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-30a60bda-cd37-4dcf-b9f6-5006b3e112eb tempest-VolumesNegativeTest-673674835 None] Flow 'volume_create_manager' (9cb6579b-c629-4c7a-a04b-1702121a7924) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:46:17 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-30a60bda-cd37-4dcf-b9f6-5006b3e112eb tempest-VolumesNegativeTest-673674835 None] Created volume successfully. Nov 03 07:46:27 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:SELECT=12,cinder:UPDATE=12,cinder:INSERT=1 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:46:34 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-3934cc40-6d89-4438-b8bc-37e47a2f6559 tempest-VolumesNegativeTest-673674835 None] Acquiring lock "cinder-32d9b12c-89fc-49fa-8830-9a7d99fbacf5-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:34 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-3934cc40-6d89-4438-b8bc-37e47a2f6559 tempest-VolumesNegativeTest-673674835 None] Lock "cinder-32d9b12c-89fc-49fa-8830-9a7d99fbacf5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:34 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-3934cc40-6d89-4438-b8bc-37e47a2f6559 tempest-VolumesNegativeTest-673674835 None] Acquiring lock "cinder-quobyte-32d9b12c-89fc-49fa-8830-9a7d99fbacf5" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:46:34 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-3934cc40-6d89-4438-b8bc-37e47a2f6559 tempest-VolumesNegativeTest-673674835 None] Lock "cinder-quobyte-32d9b12c-89fc-49fa-8830-9a7d99fbacf5" acquired by "delete_volume" :: waited 0.021s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:46:34 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1544001-e14a-4a89-86a5-32182e1171ad]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:46:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3934cc40-6d89-4438-b8bc-37e47a2f6559 tempest-VolumesNegativeTest-673674835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-32d9b12c-89fc-49fa-8830-9a7d99fbacf5 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:34 devstack sudo[104329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-32d9b12c-89fc-49fa-8830-9a7d99fbacf5 Nov 03 07:46:34 devstack sudo[104329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:34 devstack sudo[104329]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3934cc40-6d89-4438-b8bc-37e47a2f6559 tempest-VolumesNegativeTest-673674835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-32d9b12c-89fc-49fa-8830-9a7d99fbacf5" returned: 0 in 0.357s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3934cc40-6d89-4438-b8bc-37e47a2f6559 tempest-VolumesNegativeTest-673674835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-32d9b12c-89fc-49fa-8830-9a7d99fbacf5 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:34 devstack sudo[104335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-32d9b12c-89fc-49fa-8830-9a7d99fbacf5 Nov 03 07:46:34 devstack sudo[104335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:34 devstack sudo[104335]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3934cc40-6d89-4438-b8bc-37e47a2f6559 tempest-VolumesNegativeTest-673674835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-32d9b12c-89fc-49fa-8830-9a7d99fbacf5" returned: 0 in 0.241s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:34 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-3934cc40-6d89-4438-b8bc-37e47a2f6559 tempest-VolumesNegativeTest-673674835 None] Lock "cinder-quobyte-32d9b12c-89fc-49fa-8830-9a7d99fbacf5" released by "delete_volume" :: held 0.644s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:34 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-3934cc40-6d89-4438-b8bc-37e47a2f6559 tempest-VolumesNegativeTest-673674835 None] Created reservations ['440532d3-9697-45cf-905b-77ef4d14bb74', '9661079b-d7ca-4a30-bd8c-e9ce2416c418', 'e15f8fd2-e4a0-4ae5-bf7a-0e72bb32eb2c', '024d0b97-78d3-46c7-8c0d-300a2d6a9a97'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:46:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3934cc40-6d89-4438-b8bc-37e47a2f6559 tempest-VolumesNegativeTest-673674835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3934cc40-6d89-4438-b8bc-37e47a2f6559 tempest-VolumesNegativeTest-673674835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:35 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-3934cc40-6d89-4438-b8bc-37e47a2f6559 tempest-VolumesNegativeTest-673674835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:46:35 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-3934cc40-6d89-4438-b8bc-37e47a2f6559 tempest-VolumesNegativeTest-673674835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:46:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3934cc40-6d89-4438-b8bc-37e47a2f6559 tempest-VolumesNegativeTest-673674835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3934cc40-6d89-4438-b8bc-37e47a2f6559 tempest-VolumesNegativeTest-673674835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:35 devstack sudo[104338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:46:35 devstack sudo[104338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:35 devstack sudo[104338]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3934cc40-6d89-4438-b8bc-37e47a2f6559 tempest-VolumesNegativeTest-673674835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.262s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:35 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-3934cc40-6d89-4438-b8bc-37e47a2f6559 tempest-VolumesNegativeTest-673674835 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:46:35 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-3934cc40-6d89-4438-b8bc-37e47a2f6559 tempest-VolumesNegativeTest-673674835 None] Deleted volume successfully. Nov 03 07:46:35 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-3934cc40-6d89-4438-b8bc-37e47a2f6559 tempest-VolumesNegativeTest-673674835 None] Lock "cinder-32d9b12c-89fc-49fa-8830-9a7d99fbacf5-delete_volume" released by "delete_volume" :: held 1.128s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:46:45 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:UPDATE=21,cinder:SELECT=12,cinder:INSERT=6,cinder:DELETE=2 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:46:45 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:46:58 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c7d4ac0-50ed-4ccf-b88f-56e96b75f6f3 tempest-TestInstancesWithCinderVolumes-2112103413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:46:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-6c7d4ac0-50ed-4ccf-b88f-56e96b75f6f3 tempest-TestInstancesWithCinderVolumes-2112103413 None] Flow 'volume_create_manager' (b5c52ce0-3f0b-4a8b-8b1d-61708916b633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:46:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-6c7d4ac0-50ed-4ccf-b88f-56e96b75f6f3 tempest-TestInstancesWithCinderVolumes-2112103413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71f79c06-b735-4df9-a4aa-4d8b73fc2270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-6c7d4ac0-50ed-4ccf-b88f-56e96b75f6f3 tempest-TestInstancesWithCinderVolumes-2112103413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71f79c06-b735-4df9-a4aa-4d8b73fc2270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:46:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-75899633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=590601b6-1e1b-4b08-bc23-1eb53c5b95e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96209dcea887440886e3f38c029684b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:46:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:46:59Z,use_quota=True,user_id='f3d0a1b5968e4cbab804e50c9ee99e8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0e415da-6714-49f5-bd2b-db6987564744),volume_type_id=c0e415da-6714-49f5-bd2b-db6987564744)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-6c7d4ac0-50ed-4ccf-b88f-56e96b75f6f3 tempest-TestInstancesWithCinderVolumes-2112103413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c2d08b5-15b2-4f55-8a49-4a290e6b7816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-6c7d4ac0-50ed-4ccf-b88f-56e96b75f6f3 tempest-TestInstancesWithCinderVolumes-2112103413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c2d08b5-15b2-4f55-8a49-4a290e6b7816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-6c7d4ac0-50ed-4ccf-b88f-56e96b75f6f3 tempest-TestInstancesWithCinderVolumes-2112103413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c37ed58a-80cf-4a2d-b1f6-111487bc1ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-6c7d4ac0-50ed-4ccf-b88f-56e96b75f6f3 tempest-TestInstancesWithCinderVolumes-2112103413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c37ed58a-80cf-4a2d-b1f6-111487bc1ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '590601b6-1e1b-4b08-bc23-1eb53c5b95e1', 'volume_name': 'volume-590601b6-1e1b-4b08-bc23-1eb53c5b95e1', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-6c7d4ac0-50ed-4ccf-b88f-56e96b75f6f3 tempest-TestInstancesWithCinderVolumes-2112103413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (830a0d2e-c3b7-4c0f-8e49-24c0c4ff35c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-6c7d4ac0-50ed-4ccf-b88f-56e96b75f6f3 tempest-TestInstancesWithCinderVolumes-2112103413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (830a0d2e-c3b7-4c0f-8e49-24c0c4ff35c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-6c7d4ac0-50ed-4ccf-b88f-56e96b75f6f3 tempest-TestInstancesWithCinderVolumes-2112103413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18661598-fbf9-40c1-89a6-2b4d3b496568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:59 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-6c7d4ac0-50ed-4ccf-b88f-56e96b75f6f3 tempest-TestInstancesWithCinderVolumes-2112103413 None] Volume 590601b6-1e1b-4b08-bc23-1eb53c5b95e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-590601b6-1e1b-4b08-bc23-1eb53c5b95e1', 'volume_size': 1} Nov 03 07:46:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-6c7d4ac0-50ed-4ccf-b88f-56e96b75f6f3 tempest-TestInstancesWithCinderVolumes-2112103413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-6c7d4ac0-50ed-4ccf-b88f-56e96b75f6f3 tempest-TestInstancesWithCinderVolumes-2112103413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:59 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-6c7d4ac0-50ed-4ccf-b88f-56e96b75f6f3 tempest-TestInstancesWithCinderVolumes-2112103413 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:46:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-75899633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=590601b6-1e1b-4b08-bc23-1eb53c5b95e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96209dcea887440886e3f38c029684b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:46:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:46:59Z,use_quota=True,user_id='f3d0a1b5968e4cbab804e50c9ee99e8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0e415da-6714-49f5-bd2b-db6987564744),volume_type_id=c0e415da-6714-49f5-bd2b-db6987564744)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:46:59 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-6c7d4ac0-50ed-4ccf-b88f-56e96b75f6f3 tempest-TestInstancesWithCinderVolumes-2112103413 None] Creating volume 590601b6-1e1b-4b08-bc23-1eb53c5b95e1 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:46:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-6c7d4ac0-50ed-4ccf-b88f-56e96b75f6f3 tempest-TestInstancesWithCinderVolumes-2112103413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-6c7d4ac0-50ed-4ccf-b88f-56e96b75f6f3 tempest-TestInstancesWithCinderVolumes-2112103413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:59 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-6c7d4ac0-50ed-4ccf-b88f-56e96b75f6f3 tempest-TestInstancesWithCinderVolumes-2112103413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:46:59 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-6c7d4ac0-50ed-4ccf-b88f-56e96b75f6f3 tempest-TestInstancesWithCinderVolumes-2112103413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:46:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-6c7d4ac0-50ed-4ccf-b88f-56e96b75f6f3 tempest-TestInstancesWithCinderVolumes-2112103413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:59 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-6c7d4ac0-50ed-4ccf-b88f-56e96b75f6f3 tempest-TestInstancesWithCinderVolumes-2112103413 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:46:59 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-6c7d4ac0-50ed-4ccf-b88f-56e96b75f6f3 tempest-TestInstancesWithCinderVolumes-2112103413 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:46:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6c7d4ac0-50ed-4ccf-b88f-56e96b75f6f3 tempest-TestInstancesWithCinderVolumes-2112103413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-590601b6-1e1b-4b08-bc23-1eb53c5b95e1 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:59 devstack sudo[104349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-590601b6-1e1b-4b08-bc23-1eb53c5b95e1 1073741824 Nov 03 07:46:59 devstack sudo[104349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:59 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-60fb76d6-6519-4735-bd7d-87f5bb71ca9c tempest-TestInstancesWithCinderVolumes-2112103413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:46:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-60fb76d6-6519-4735-bd7d-87f5bb71ca9c tempest-TestInstancesWithCinderVolumes-2112103413 None] Flow 'volume_create_manager' (2e4e9176-3b2b-4a8a-a18d-a2e49c56b93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:46:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-60fb76d6-6519-4735-bd7d-87f5bb71ca9c tempest-TestInstancesWithCinderVolumes-2112103413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9098fed2-e899-4fd1-9ac6-a7b7fe4a7090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-60fb76d6-6519-4735-bd7d-87f5bb71ca9c tempest-TestInstancesWithCinderVolumes-2112103413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9098fed2-e899-4fd1-9ac6-a7b7fe4a7090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:46:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1080602142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2263c76b-58b4-44ab-8468-4f8d89cc9ad4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96209dcea887440886e3f38c029684b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:46:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:46:59Z,use_quota=True,user_id='f3d0a1b5968e4cbab804e50c9ee99e8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b74b2ae4-3a03-479d-939e-863c2337d00c),volume_type_id=b74b2ae4-3a03-479d-939e-863c2337d00c)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-60fb76d6-6519-4735-bd7d-87f5bb71ca9c tempest-TestInstancesWithCinderVolumes-2112103413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4071047f-2b16-4cb8-a16a-8c9ed8b7ac50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-60fb76d6-6519-4735-bd7d-87f5bb71ca9c tempest-TestInstancesWithCinderVolumes-2112103413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4071047f-2b16-4cb8-a16a-8c9ed8b7ac50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-60fb76d6-6519-4735-bd7d-87f5bb71ca9c tempest-TestInstancesWithCinderVolumes-2112103413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87b674c4-a2db-47c3-bc49-d0bbad64b458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-60fb76d6-6519-4735-bd7d-87f5bb71ca9c tempest-TestInstancesWithCinderVolumes-2112103413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87b674c4-a2db-47c3-bc49-d0bbad64b458) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2263c76b-58b4-44ab-8468-4f8d89cc9ad4', 'volume_name': 'volume-2263c76b-58b4-44ab-8468-4f8d89cc9ad4', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-60fb76d6-6519-4735-bd7d-87f5bb71ca9c tempest-TestInstancesWithCinderVolumes-2112103413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (501c1143-e06f-44fc-8825-eb1f59c71f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-60fb76d6-6519-4735-bd7d-87f5bb71ca9c tempest-TestInstancesWithCinderVolumes-2112103413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (501c1143-e06f-44fc-8825-eb1f59c71f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-60fb76d6-6519-4735-bd7d-87f5bb71ca9c tempest-TestInstancesWithCinderVolumes-2112103413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (542a8840-3006-489c-82ac-47c5ec74a77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:59 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-60fb76d6-6519-4735-bd7d-87f5bb71ca9c tempest-TestInstancesWithCinderVolumes-2112103413 None] Volume 2263c76b-58b4-44ab-8468-4f8d89cc9ad4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2263c76b-58b4-44ab-8468-4f8d89cc9ad4', 'volume_size': 1} Nov 03 07:46:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-60fb76d6-6519-4735-bd7d-87f5bb71ca9c tempest-TestInstancesWithCinderVolumes-2112103413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:59 devstack sudo[104349]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6c7d4ac0-50ed-4ccf-b88f-56e96b75f6f3 tempest-TestInstancesWithCinderVolumes-2112103413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-590601b6-1e1b-4b08-bc23-1eb53c5b95e1 1073741824" returned: 0 in 0.552s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6c7d4ac0-50ed-4ccf-b88f-56e96b75f6f3 tempest-TestInstancesWithCinderVolumes-2112103413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-590601b6-1e1b-4b08-bc23-1eb53c5b95e1 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:59 devstack sudo[104355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-590601b6-1e1b-4b08-bc23-1eb53c5b95e1 Nov 03 07:46:59 devstack sudo[104355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:59 devstack sudo[104355]: pam_unix(sudo:session): session closed for user root Nov 03 07:46:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6c7d4ac0-50ed-4ccf-b88f-56e96b75f6f3 tempest-TestInstancesWithCinderVolumes-2112103413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-590601b6-1e1b-4b08-bc23-1eb53c5b95e1" returned: 0 in 0.248s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:46:59 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-6c7d4ac0-50ed-4ccf-b88f-56e96b75f6f3 tempest-TestInstancesWithCinderVolumes-2112103413 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:46:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-6c7d4ac0-50ed-4ccf-b88f-56e96b75f6f3 tempest-TestInstancesWithCinderVolumes-2112103413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-60fb76d6-6519-4735-bd7d-87f5bb71ca9c tempest-TestInstancesWithCinderVolumes-2112103413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.378s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:59 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-60fb76d6-6519-4735-bd7d-87f5bb71ca9c tempest-TestInstancesWithCinderVolumes-2112103413 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:46:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1080602142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2263c76b-58b4-44ab-8468-4f8d89cc9ad4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96209dcea887440886e3f38c029684b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:46:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:46:59Z,use_quota=True,user_id='f3d0a1b5968e4cbab804e50c9ee99e8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b74b2ae4-3a03-479d-939e-863c2337d00c),volume_type_id=b74b2ae4-3a03-479d-939e-863c2337d00c)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:46:59 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-60fb76d6-6519-4735-bd7d-87f5bb71ca9c tempest-TestInstancesWithCinderVolumes-2112103413 None] Creating volume 2263c76b-58b4-44ab-8468-4f8d89cc9ad4 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:46:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-60fb76d6-6519-4735-bd7d-87f5bb71ca9c tempest-TestInstancesWithCinderVolumes-2112103413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:46:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-60fb76d6-6519-4735-bd7d-87f5bb71ca9c tempest-TestInstancesWithCinderVolumes-2112103413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:46:59 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-60fb76d6-6519-4735-bd7d-87f5bb71ca9c tempest-TestInstancesWithCinderVolumes-2112103413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:46:59 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-60fb76d6-6519-4735-bd7d-87f5bb71ca9c tempest-TestInstancesWithCinderVolumes-2112103413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:46:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-60fb76d6-6519-4735-bd7d-87f5bb71ca9c tempest-TestInstancesWithCinderVolumes-2112103413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:46:59 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-60fb76d6-6519-4735-bd7d-87f5bb71ca9c tempest-TestInstancesWithCinderVolumes-2112103413 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:46:59 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-60fb76d6-6519-4735-bd7d-87f5bb71ca9c tempest-TestInstancesWithCinderVolumes-2112103413 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:46:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-60fb76d6-6519-4735-bd7d-87f5bb71ca9c tempest-TestInstancesWithCinderVolumes-2112103413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2263c76b-58b4-44ab-8468-4f8d89cc9ad4 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:46:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-6c7d4ac0-50ed-4ccf-b88f-56e96b75f6f3 tempest-TestInstancesWithCinderVolumes-2112103413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18661598-fbf9-40c1-89a6-2b4d3b496568) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-590601b6-1e1b-4b08-bc23-1eb53c5b95e1', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:59 devstack sudo[104358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2263c76b-58b4-44ab-8468-4f8d89cc9ad4 1073741824 Nov 03 07:46:59 devstack sudo[104358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:46:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-6c7d4ac0-50ed-4ccf-b88f-56e96b75f6f3 tempest-TestInstancesWithCinderVolumes-2112103413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (264409f3-bdbd-4278-a9e2-0b8109ba3722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:46:59 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-6c7d4ac0-50ed-4ccf-b88f-56e96b75f6f3 tempest-TestInstancesWithCinderVolumes-2112103413 None] Volume volume-590601b6-1e1b-4b08-bc23-1eb53c5b95e1 (590601b6-1e1b-4b08-bc23-1eb53c5b95e1): created successfully Nov 03 07:46:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-6c7d4ac0-50ed-4ccf-b88f-56e96b75f6f3 tempest-TestInstancesWithCinderVolumes-2112103413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (264409f3-bdbd-4278-a9e2-0b8109ba3722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:46:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-6c7d4ac0-50ed-4ccf-b88f-56e96b75f6f3 tempest-TestInstancesWithCinderVolumes-2112103413 None] Flow 'volume_create_manager' (b5c52ce0-3f0b-4a8b-8b1d-61708916b633) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:46:59 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-6c7d4ac0-50ed-4ccf-b88f-56e96b75f6f3 tempest-TestInstancesWithCinderVolumes-2112103413 None] Created volume successfully. Nov 03 07:47:00 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ed89bdc-aa8e-4785-8e58-2433aef1ab72 tempest-TestInstancesWithCinderVolumes-2112103413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:47:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4ed89bdc-aa8e-4785-8e58-2433aef1ab72 tempest-TestInstancesWithCinderVolumes-2112103413 None] Flow 'volume_create_manager' (c7ab4981-8ea8-47e6-a25e-61cb4713b7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:47:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4ed89bdc-aa8e-4785-8e58-2433aef1ab72 tempest-TestInstancesWithCinderVolumes-2112103413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5ab1fd8-e0a4-4e01-a2c9-049a5a4af4b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4ed89bdc-aa8e-4785-8e58-2433aef1ab72 tempest-TestInstancesWithCinderVolumes-2112103413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5ab1fd8-e0a4-4e01-a2c9-049a5a4af4b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2014301909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72a0d0b2-c59f-4730-96c3-3e8dd7d520f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96209dcea887440886e3f38c029684b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:47:00Z,use_quota=True,user_id='f3d0a1b5968e4cbab804e50c9ee99e8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(172cefca-10ed-42d1-bb9a-6c386ab7d74c),volume_type_id=172cefca-10ed-42d1-bb9a-6c386ab7d74c)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4ed89bdc-aa8e-4785-8e58-2433aef1ab72 tempest-TestInstancesWithCinderVolumes-2112103413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39a73e7b-1a0c-4483-86a1-fa735f3806df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4ed89bdc-aa8e-4785-8e58-2433aef1ab72 tempest-TestInstancesWithCinderVolumes-2112103413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39a73e7b-1a0c-4483-86a1-fa735f3806df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4ed89bdc-aa8e-4785-8e58-2433aef1ab72 tempest-TestInstancesWithCinderVolumes-2112103413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ba65559-799f-4ec2-8e40-840851e78cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:00 devstack cinder-volume[86875]: DEBUG cinder.image.glance [None req-4ed89bdc-aa8e-4785-8e58-2433aef1ab72 tempest-TestInstancesWithCinderVolumes-2112103413 None] Creating Keystone auth plugin from conf {{(pid=86875) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 07:47:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4ed89bdc-aa8e-4785-8e58-2433aef1ab72 tempest-TestInstancesWithCinderVolumes-2112103413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ba65559-799f-4ec2-8e40-840851e78cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '72a0d0b2-c59f-4730-96c3-3e8dd7d520f8', 'volume_name': 'volume-72a0d0b2-c59f-4730-96c3-3e8dd7d520f8', 'volume_size': 1, 'image_id': '7320cf7c-62a2-46e2-8019-c4ffe42b55cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7320cf7c-62a2-46e2-8019-c4ffe42b55cd', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--821804720', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '96209dcea887440886e3f38c029684b3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7320cf7c-62a2-46e2-8019-c4ffe42b55cd', 'created_at': datetime.datetime(2026, 11, 3, 6, 46, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 46, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7320cf7c-62a2-46e2-8019-c4ffe42b55cd/file', 'properties': {}}, 'image_service': }' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4ed89bdc-aa8e-4785-8e58-2433aef1ab72 tempest-TestInstancesWithCinderVolumes-2112103413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc21ad84-174b-4498-8b90-d86bfdb0951e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4ed89bdc-aa8e-4785-8e58-2433aef1ab72 tempest-TestInstancesWithCinderVolumes-2112103413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc21ad84-174b-4498-8b90-d86bfdb0951e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4ed89bdc-aa8e-4785-8e58-2433aef1ab72 tempest-TestInstancesWithCinderVolumes-2112103413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad85eed8-6846-49bb-94ae-c188bf2d9b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:00 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-4ed89bdc-aa8e-4785-8e58-2433aef1ab72 tempest-TestInstancesWithCinderVolumes-2112103413 None] Volume 72a0d0b2-c59f-4730-96c3-3e8dd7d520f8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-72a0d0b2-c59f-4730-96c3-3e8dd7d520f8', 'volume_size': 1, 'image_id': '7320cf7c-62a2-46e2-8019-c4ffe42b55cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7320cf7c-62a2-46e2-8019-c4ffe42b55cd', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--821804720', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '96209dcea887440886e3f38c029684b3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7320cf7c-62a2-46e2-8019-c4ffe42b55cd', 'created_at': datetime.datetime(2026, 11, 3, 6, 46, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 46, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7320cf7c-62a2-46e2-8019-c4ffe42b55cd/file', 'properties': {}}, 'image_service': } Nov 03 07:47:00 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ed89bdc-aa8e-4785-8e58-2433aef1ab72 tempest-TestInstancesWithCinderVolumes-2112103413 None] Trying to clone 72a0d0b2-c59f-4730-96c3-3e8dd7d520f8 from image 7320cf7c-62a2-46e2-8019-c4ffe42b55cd at location (None, [{'url': 'file:///opt/stack/data/glance/images/7320cf7c-62a2-46e2-8019-c4ffe42b55cd', 'metadata': {}}]). {{(pid=86875) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 07:47:00 devstack sudo[104358]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-60fb76d6-6519-4735-bd7d-87f5bb71ca9c tempest-TestInstancesWithCinderVolumes-2112103413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2263c76b-58b4-44ab-8468-4f8d89cc9ad4 1073741824" returned: 0 in 0.465s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-60fb76d6-6519-4735-bd7d-87f5bb71ca9c tempest-TestInstancesWithCinderVolumes-2112103413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2263c76b-58b4-44ab-8468-4f8d89cc9ad4 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:00 devstack sudo[104364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2263c76b-58b4-44ab-8468-4f8d89cc9ad4 Nov 03 07:47:00 devstack sudo[104364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:00 devstack sudo[104364]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-60fb76d6-6519-4735-bd7d-87f5bb71ca9c tempest-TestInstancesWithCinderVolumes-2112103413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2263c76b-58b4-44ab-8468-4f8d89cc9ad4" returned: 0 in 0.234s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:00 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-60fb76d6-6519-4735-bd7d-87f5bb71ca9c tempest-TestInstancesWithCinderVolumes-2112103413 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:47:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-60fb76d6-6519-4735-bd7d-87f5bb71ca9c tempest-TestInstancesWithCinderVolumes-2112103413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:47:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-60fb76d6-6519-4735-bd7d-87f5bb71ca9c tempest-TestInstancesWithCinderVolumes-2112103413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (542a8840-3006-489c-82ac-47c5ec74a77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2263c76b-58b4-44ab-8468-4f8d89cc9ad4', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-60fb76d6-6519-4735-bd7d-87f5bb71ca9c tempest-TestInstancesWithCinderVolumes-2112103413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (397aae2a-3f45-4198-aeec-b27bcf97f8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:00 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-60fb76d6-6519-4735-bd7d-87f5bb71ca9c tempest-TestInstancesWithCinderVolumes-2112103413 None] Volume volume-2263c76b-58b4-44ab-8468-4f8d89cc9ad4 (2263c76b-58b4-44ab-8468-4f8d89cc9ad4): created successfully Nov 03 07:47:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-60fb76d6-6519-4735-bd7d-87f5bb71ca9c tempest-TestInstancesWithCinderVolumes-2112103413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (397aae2a-3f45-4198-aeec-b27bcf97f8d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-60fb76d6-6519-4735-bd7d-87f5bb71ca9c tempest-TestInstancesWithCinderVolumes-2112103413 None] Flow 'volume_create_manager' (2e4e9176-3b2b-4a8a-a18d-a2e49c56b93e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:47:00 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-60fb76d6-6519-4735-bd7d-87f5bb71ca9c tempest-TestInstancesWithCinderVolumes-2112103413 None] Created volume successfully. Nov 03 07:47:03 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-4ed89bdc-aa8e-4785-8e58-2433aef1ab72 tempest-TestInstancesWithCinderVolumes-2112103413 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7320cf7c-62a2-46e2-8019-c4ffe42b55cd_xvbajttwdevstack@QuobyteHD, size 20.69 MB, duration 2.75 sec {{(pid=86875) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 07:47:03 devstack cinder-volume[86875]: INFO cinder.image.image_utils [None req-4ed89bdc-aa8e-4785-8e58-2433aef1ab72 tempest-TestInstancesWithCinderVolumes-2112103413 None] Image download 20.69 MB at 7.51 MB/s Nov 03 07:47:03 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48176de-0181-4c39-8124-fbaffd6544fd]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:47:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4ed89bdc-aa8e-4785-8e58-2433aef1ab72 tempest-TestInstancesWithCinderVolumes-2112103413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7320cf7c-62a2-46e2-8019-c4ffe42b55cd_xvbajttwdevstack@QuobyteHD {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:03 devstack sudo[104367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7320cf7c-62a2-46e2-8019-c4ffe42b55cd_xvbajttwdevstack@QuobyteHD Nov 03 07:47:03 devstack sudo[104367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:03 devstack sudo[104367]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4ed89bdc-aa8e-4785-8e58-2433aef1ab72 tempest-TestInstancesWithCinderVolumes-2112103413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7320cf7c-62a2-46e2-8019-c4ffe42b55cd_xvbajttwdevstack@QuobyteHD" returned: 0 in 0.340s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:03 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-4ed89bdc-aa8e-4785-8e58-2433aef1ab72 tempest-TestInstancesWithCinderVolumes-2112103413 None] Temporary image 7320cf7c-62a2-46e2-8019-c4ffe42b55cd is fetched for user f3d0a1b5968e4cbab804e50c9ee99e8e. {{(pid=86875) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 07:47:03 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eba7736-8ab8-4d62-85f3-244cc075bced]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:47:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4ed89bdc-aa8e-4785-8e58-2433aef1ab72 tempest-TestInstancesWithCinderVolumes-2112103413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7320cf7c-62a2-46e2-8019-c4ffe42b55cd_xvbajttwdevstack@QuobyteHD {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:03 devstack cinder-volume[86875]: DEBUG oslo_service.periodic_task [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86875) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:47:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:47:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:47:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:47:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:47:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:47:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:03 devstack sudo[104373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:47:03 devstack sudo[104373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:03 devstack sudo[104372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7320cf7c-62a2-46e2-8019-c4ffe42b55cd_xvbajttwdevstack@QuobyteHD Nov 03 07:47:03 devstack sudo[104372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:03 devstack sudo[104373]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:03 devstack sudo[104372]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.272s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:03 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:47:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4ed89bdc-aa8e-4785-8e58-2433aef1ab72 tempest-TestInstancesWithCinderVolumes-2112103413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7320cf7c-62a2-46e2-8019-c4ffe42b55cd_xvbajttwdevstack@QuobyteHD" returned: 0 in 0.331s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-4ed89bdc-aa8e-4785-8e58-2433aef1ab72 tempest-TestInstancesWithCinderVolumes-2112103413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:47:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-4ed89bdc-aa8e-4785-8e58-2433aef1ab72 tempest-TestInstancesWithCinderVolumes-2112103413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:47:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-4ed89bdc-aa8e-4785-8e58-2433aef1ab72 tempest-TestInstancesWithCinderVolumes-2112103413 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2014301909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72a0d0b2-c59f-4730-96c3-3e8dd7d520f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96209dcea887440886e3f38c029684b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:47:00Z,use_quota=True,user_id='f3d0a1b5968e4cbab804e50c9ee99e8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(172cefca-10ed-42d1-bb9a-6c386ab7d74c),volume_type_id=172cefca-10ed-42d1-bb9a-6c386ab7d74c)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:47:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-4ed89bdc-aa8e-4785-8e58-2433aef1ab72 tempest-TestInstancesWithCinderVolumes-2112103413 None] Creating volume 72a0d0b2-c59f-4730-96c3-3e8dd7d520f8 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:47:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-4ed89bdc-aa8e-4785-8e58-2433aef1ab72 tempest-TestInstancesWithCinderVolumes-2112103413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:47:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-4ed89bdc-aa8e-4785-8e58-2433aef1ab72 tempest-TestInstancesWithCinderVolumes-2112103413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:47:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-4ed89bdc-aa8e-4785-8e58-2433aef1ab72 tempest-TestInstancesWithCinderVolumes-2112103413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:47:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-4ed89bdc-aa8e-4785-8e58-2433aef1ab72 tempest-TestInstancesWithCinderVolumes-2112103413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:47:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-4ed89bdc-aa8e-4785-8e58-2433aef1ab72 tempest-TestInstancesWithCinderVolumes-2112103413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:47:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-4ed89bdc-aa8e-4785-8e58-2433aef1ab72 tempest-TestInstancesWithCinderVolumes-2112103413 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:47:03 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-4ed89bdc-aa8e-4785-8e58-2433aef1ab72 tempest-TestInstancesWithCinderVolumes-2112103413 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:47:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4ed89bdc-aa8e-4785-8e58-2433aef1ab72 tempest-TestInstancesWithCinderVolumes-2112103413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72a0d0b2-c59f-4730-96c3-3e8dd7d520f8 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:03 devstack cinder-volume[86875]: DEBUG oslo_service.periodic_task [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running periodic task VolumeManager._thread_info {{(pid=86875) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:47:03 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] thread count: 28 {{(pid=86875) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:47:03 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] thread info: [<_MainThread(MainThread, started 125626325639296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86875) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:47:03 devstack sudo[104380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72a0d0b2-c59f-4730-96c3-3e8dd7d520f8 1073741824 Nov 03 07:47:03 devstack sudo[104380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:04 devstack sudo[104380]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4ed89bdc-aa8e-4785-8e58-2433aef1ab72 tempest-TestInstancesWithCinderVolumes-2112103413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72a0d0b2-c59f-4730-96c3-3e8dd7d520f8 1073741824" returned: 0 in 0.414s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4ed89bdc-aa8e-4785-8e58-2433aef1ab72 tempest-TestInstancesWithCinderVolumes-2112103413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72a0d0b2-c59f-4730-96c3-3e8dd7d520f8 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:04 devstack sudo[104386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72a0d0b2-c59f-4730-96c3-3e8dd7d520f8 Nov 03 07:47:04 devstack sudo[104386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:04 devstack sudo[104386]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4ed89bdc-aa8e-4785-8e58-2433aef1ab72 tempest-TestInstancesWithCinderVolumes-2112103413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72a0d0b2-c59f-4730-96c3-3e8dd7d520f8" returned: 0 in 0.238s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:04 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-4ed89bdc-aa8e-4785-8e58-2433aef1ab72 tempest-TestInstancesWithCinderVolumes-2112103413 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:47:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-4ed89bdc-aa8e-4785-8e58-2433aef1ab72 tempest-TestInstancesWithCinderVolumes-2112103413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:47:04 devstack cinder-volume[86875]: DEBUG cinder.volume.volume_utils [None req-4ed89bdc-aa8e-4785-8e58-2433aef1ab72 tempest-TestInstancesWithCinderVolumes-2112103413 None] Attempting download of 7320cf7c-62a2-46e2-8019-c4ffe42b55cd ((None, [{'url': 'file:///opt/stack/data/glance/images/7320cf7c-62a2-46e2-8019-c4ffe42b55cd', 'metadata': {}}])) to volume 72a0d0b2-c59f-4730-96c3-3e8dd7d520f8. {{(pid=86875) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 07:47:04 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c402a1-0b54-4181-97c9-5bfba2832669]: (4, 'raw') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:47:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4ed89bdc-aa8e-4785-8e58-2433aef1ab72 tempest-TestInstancesWithCinderVolumes-2112103413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7320cf7c-62a2-46e2-8019-c4ffe42b55cd_k9so27j5 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:04 devstack sudo[104389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7320cf7c-62a2-46e2-8019-c4ffe42b55cd_k9so27j5 Nov 03 07:47:04 devstack sudo[104389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:04 devstack sudo[104389]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4ed89bdc-aa8e-4785-8e58-2433aef1ab72 tempest-TestInstancesWithCinderVolumes-2112103413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7320cf7c-62a2-46e2-8019-c4ffe42b55cd_k9so27j5" returned: 0 in 0.315s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4ed89bdc-aa8e-4785-8e58-2433aef1ab72 tempest-TestInstancesWithCinderVolumes-2112103413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7320cf7c-62a2-46e2-8019-c4ffe42b55cd_k9so27j5 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:05 devstack sudo[104393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7320cf7c-62a2-46e2-8019-c4ffe42b55cd_k9so27j5 Nov 03 07:47:05 devstack sudo[104393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:05 devstack sudo[104393]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4ed89bdc-aa8e-4785-8e58-2433aef1ab72 tempest-TestInstancesWithCinderVolumes-2112103413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7320cf7c-62a2-46e2-8019-c4ffe42b55cd_k9so27j5" returned: 1 in 0.316s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4ed89bdc-aa8e-4785-8e58-2433aef1ab72 tempest-TestInstancesWithCinderVolumes-2112103413 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7320cf7c-62a2-46e2-8019-c4ffe42b55cd_k9so27j5' failed. Not Retrying. {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:47:05 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[faccbef1-0c6a-4d09-a7d0-e75711c07416]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:47:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4ed89bdc-aa8e-4785-8e58-2433aef1ab72 tempest-TestInstancesWithCinderVolumes-2112103413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7320cf7c-62a2-46e2-8019-c4ffe42b55cd_xvbajttwdevstack@QuobyteHD {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:05 devstack sudo[104397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7320cf7c-62a2-46e2-8019-c4ffe42b55cd_xvbajttwdevstack@QuobyteHD Nov 03 07:47:05 devstack sudo[104397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:05 devstack sudo[104397]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4ed89bdc-aa8e-4785-8e58-2433aef1ab72 tempest-TestInstancesWithCinderVolumes-2112103413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7320cf7c-62a2-46e2-8019-c4ffe42b55cd_xvbajttwdevstack@QuobyteHD" returned: 0 in 0.322s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:05 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-4ed89bdc-aa8e-4785-8e58-2433aef1ab72 tempest-TestInstancesWithCinderVolumes-2112103413 None] 7320cf7c-62a2-46e2-8019-c4ffe42b55cd was qcow2, converting to qcow2 {{(pid=86875) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 07:47:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4ed89bdc-aa8e-4785-8e58-2433aef1ab72 tempest-TestInstancesWithCinderVolumes-2112103413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7320cf7c-62a2-46e2-8019-c4ffe42b55cd_xvbajttwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72a0d0b2-c59f-4730-96c3-3e8dd7d520f8 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:05 devstack sudo[104402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7320cf7c-62a2-46e2-8019-c4ffe42b55cd_xvbajttwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72a0d0b2-c59f-4730-96c3-3e8dd7d520f8 Nov 03 07:47:05 devstack sudo[104402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:07 devstack sudo[104402]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4ed89bdc-aa8e-4785-8e58-2433aef1ab72 tempest-TestInstancesWithCinderVolumes-2112103413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7320cf7c-62a2-46e2-8019-c4ffe42b55cd_xvbajttwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72a0d0b2-c59f-4730-96c3-3e8dd7d520f8" returned: 0 in 1.753s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:07 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-4ed89bdc-aa8e-4785-8e58-2433aef1ab72 tempest-TestInstancesWithCinderVolumes-2112103413 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7320cf7c-62a2-46e2-8019-c4ffe42b55cd_xvbajttwdevstack@QuobyteHD, size 112.00 MB, duration 1.75 sec, destination /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72a0d0b2-c59f-4730-96c3-3e8dd7d520f8 {{(pid=86875) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:47:07 devstack cinder-volume[86875]: INFO cinder.image.image_utils [None req-4ed89bdc-aa8e-4785-8e58-2433aef1ab72 tempest-TestInstancesWithCinderVolumes-2112103413 None] Converted 112.00 MB image at 63.86 MB/s Nov 03 07:47:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4ed89bdc-aa8e-4785-8e58-2433aef1ab72 tempest-TestInstancesWithCinderVolumes-2112103413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72a0d0b2-c59f-4730-96c3-3e8dd7d520f8 1G {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:07 devstack sudo[104409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72a0d0b2-c59f-4730-96c3-3e8dd7d520f8 1G Nov 03 07:47:07 devstack sudo[104409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:07 devstack sudo[104409]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4ed89bdc-aa8e-4785-8e58-2433aef1ab72 tempest-TestInstancesWithCinderVolumes-2112103413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72a0d0b2-c59f-4730-96c3-3e8dd7d520f8 1G" returned: 0 in 0.311s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:07 devstack cinder-volume[86875]: DEBUG cinder.volume.volume_utils [None req-4ed89bdc-aa8e-4785-8e58-2433aef1ab72 tempest-TestInstancesWithCinderVolumes-2112103413 None] Downloaded image 7320cf7c-62a2-46e2-8019-c4ffe42b55cd ((None, [{'url': 'file:///opt/stack/data/glance/images/7320cf7c-62a2-46e2-8019-c4ffe42b55cd', 'metadata': {}}])) to volume 72a0d0b2-c59f-4730-96c3-3e8dd7d520f8 successfully. {{(pid=86875) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 07:47:07 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-4ed89bdc-aa8e-4785-8e58-2433aef1ab72 tempest-TestInstancesWithCinderVolumes-2112103413 None] Temporary image 7320cf7c-62a2-46e2-8019-c4ffe42b55cd for user f3d0a1b5968e4cbab804e50c9ee99e8e is deleted. {{(pid=86875) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 07:47:07 devstack cinder-volume[86875]: DEBUG cinder.volume.volume_utils [None req-4ed89bdc-aa8e-4785-8e58-2433aef1ab72 tempest-TestInstancesWithCinderVolumes-2112103413 None] Marking volume 72a0d0b2-c59f-4730-96c3-3e8dd7d520f8 as bootable. {{(pid=86875) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 07:47:07 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ed89bdc-aa8e-4785-8e58-2433aef1ab72 tempest-TestInstancesWithCinderVolumes-2112103413 None] Copying metadata from image 7320cf7c-62a2-46e2-8019-c4ffe42b55cd to 72a0d0b2-c59f-4730-96c3-3e8dd7d520f8. {{(pid=86875) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 07:47:07 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ed89bdc-aa8e-4785-8e58-2433aef1ab72 tempest-TestInstancesWithCinderVolumes-2112103413 None] Creating volume glance metadata for volume 72a0d0b2-c59f-4730-96c3-3e8dd7d520f8 backed by image 7320cf7c-62a2-46e2-8019-c4ffe42b55cd with: {'image_id': '7320cf7c-62a2-46e2-8019-c4ffe42b55cd', 'image_name': 'tempest-scenario-img--821804720', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86875) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 07:47:07 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4ed89bdc-aa8e-4785-8e58-2433aef1ab72 tempest-TestInstancesWithCinderVolumes-2112103413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad85eed8-6846-49bb-94ae-c188bf2d9b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72a0d0b2-c59f-4730-96c3-3e8dd7d520f8', 'volume_size': 1, 'image_id': '7320cf7c-62a2-46e2-8019-c4ffe42b55cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7320cf7c-62a2-46e2-8019-c4ffe42b55cd', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--821804720', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '96209dcea887440886e3f38c029684b3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7320cf7c-62a2-46e2-8019-c4ffe42b55cd', 'created_at': datetime.datetime(2026, 11, 3, 6, 46, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 46, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7320cf7c-62a2-46e2-8019-c4ffe42b55cd/file', 'properties': {}}, 'image_service': }' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:07 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4ed89bdc-aa8e-4785-8e58-2433aef1ab72 tempest-TestInstancesWithCinderVolumes-2112103413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e26639f3-26f3-4f1f-a312-8b708170b062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:47:07 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-4ed89bdc-aa8e-4785-8e58-2433aef1ab72 tempest-TestInstancesWithCinderVolumes-2112103413 None] Volume volume-72a0d0b2-c59f-4730-96c3-3e8dd7d520f8 (72a0d0b2-c59f-4730-96c3-3e8dd7d520f8): created successfully Nov 03 07:47:07 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4ed89bdc-aa8e-4785-8e58-2433aef1ab72 tempest-TestInstancesWithCinderVolumes-2112103413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e26639f3-26f3-4f1f-a312-8b708170b062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:47:07 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-4ed89bdc-aa8e-4785-8e58-2433aef1ab72 tempest-TestInstancesWithCinderVolumes-2112103413 None] Flow 'volume_create_manager' (c7ab4981-8ea8-47e6-a25e-61cb4713b7bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:47:07 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-4ed89bdc-aa8e-4785-8e58-2433aef1ab72 tempest-TestInstancesWithCinderVolumes-2112103413 None] Created volume successfully. Nov 03 07:47:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-c0d23b06-1cf9-4973-82b8-05f55a5e270e req-47ffa045-5dd3-43b9-95c7-318ae64892d9 tempest-TestInstancesWithCinderVolumes-2112103413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:47:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-c0d23b06-1cf9-4973-82b8-05f55a5e270e req-47ffa045-5dd3-43b9-95c7-318ae64892d9 tempest-TestInstancesWithCinderVolumes-2112103413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:47:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-c0d23b06-1cf9-4973-82b8-05f55a5e270e req-47ffa045-5dd3-43b9-95c7-318ae64892d9 tempest-TestInstancesWithCinderVolumes-2112103413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:47:11 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-c0d23b06-1cf9-4973-82b8-05f55a5e270e req-47ffa045-5dd3-43b9-95c7-318ae64892d9 tempest-TestInstancesWithCinderVolumes-2112103413 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1', 'name': 'volume-72a0d0b2-c59f-4730-96c3-3e8dd7d520f8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '353e934c-a73f-4196-97d4-7900b8a83c6c', 'enforce_multipath': True} {{(pid=86875) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:47:11 devstack cinder-volume[86875]: INFO cinder.volume.manager [req-c0d23b06-1cf9-4973-82b8-05f55a5e270e req-47ffa045-5dd3-43b9-95c7-318ae64892d9 tempest-TestInstancesWithCinderVolumes-2112103413 None] attachment_update completed successfully. Nov 03 07:47:21 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:SELECT=18,cinder:UPDATE=11,cinder:INSERT=3,cinder:DELETE=3 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:47:21 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:UPDATE=13,cinder:SELECT=18,cinder:INSERT=9 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:47:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-75295542-c01c-4051-83de-40b9f710ce4c req-3beccedc-9e5a-4c29-b6f2-ff8e12a45d05 tempest-TestInstancesWithCinderVolumes-2112103413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:47:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-75295542-c01c-4051-83de-40b9f710ce4c req-3beccedc-9e5a-4c29-b6f2-ff8e12a45d05 tempest-TestInstancesWithCinderVolumes-2112103413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:47:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-75295542-c01c-4051-83de-40b9f710ce4c req-3beccedc-9e5a-4c29-b6f2-ff8e12a45d05 tempest-TestInstancesWithCinderVolumes-2112103413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:47:42 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-75295542-c01c-4051-83de-40b9f710ce4c req-3beccedc-9e5a-4c29-b6f2-ff8e12a45d05 tempest-TestInstancesWithCinderVolumes-2112103413 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1', 'name': 'volume-590601b6-1e1b-4b08-bc23-1eb53c5b95e1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '01aafe0e-ed2e-4676-9980-176d1889f103', 'enforce_multipath': True} {{(pid=86875) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:47:42 devstack cinder-volume[86875]: INFO cinder.volume.manager [req-75295542-c01c-4051-83de-40b9f710ce4c req-3beccedc-9e5a-4c29-b6f2-ff8e12a45d05 tempest-TestInstancesWithCinderVolumes-2112103413 None] attachment_update completed successfully. Nov 03 07:47:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-55c6f9c7-1505-452d-82ab-5a47e6ac5dcb req-6c6a58bc-c8bb-488c-9051-587bf70d429a tempest-TestInstancesWithCinderVolumes-2112103413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:47:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-55c6f9c7-1505-452d-82ab-5a47e6ac5dcb req-6c6a58bc-c8bb-488c-9051-587bf70d429a tempest-TestInstancesWithCinderVolumes-2112103413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:47:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-55c6f9c7-1505-452d-82ab-5a47e6ac5dcb req-6c6a58bc-c8bb-488c-9051-587bf70d429a tempest-TestInstancesWithCinderVolumes-2112103413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:47:44 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-55c6f9c7-1505-452d-82ab-5a47e6ac5dcb req-6c6a58bc-c8bb-488c-9051-587bf70d429a tempest-TestInstancesWithCinderVolumes-2112103413 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1', 'name': 'volume-2263c76b-58b4-44ab-8468-4f8d89cc9ad4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '781c3cd4-42ea-46ea-9689-d73a59ca3457', 'enforce_multipath': True} {{(pid=86875) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:47:44 devstack cinder-volume[86875]: INFO cinder.volume.manager [req-55c6f9c7-1505-452d-82ab-5a47e6ac5dcb req-6c6a58bc-c8bb-488c-9051-587bf70d429a tempest-TestInstancesWithCinderVolumes-2112103413 None] attachment_update completed successfully. Nov 03 07:47:49 devstack cinder-volume[86875]: INFO cinder.volume.manager [req-08c2e524-119f-444e-949b-d51970a26f31 req-e185e463-c3b5-47e5-839a-8c3322dae853 tempest-TestInstancesWithCinderVolumes-2112103413 None] Terminate volume connection completed successfully. Nov 03 07:47:49 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-08c2e524-119f-444e-949b-d51970a26f31 req-e185e463-c3b5-47e5-839a-8c3322dae853 tempest-TestInstancesWithCinderVolumes-2112103413 None] Deleting attachment 01aafe0e-ed2e-4676-9980-176d1889f103. {{(pid=86875) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:47:50 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-5fa0afff-7939-4f4f-bd35-56215a1c2f0d tempest-TestInstancesWithCinderVolumes-2112103413 None] Acquiring lock "cinder-590601b6-1e1b-4b08-bc23-1eb53c5b95e1-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:47:50 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-5fa0afff-7939-4f4f-bd35-56215a1c2f0d tempest-TestInstancesWithCinderVolumes-2112103413 None] Lock "cinder-590601b6-1e1b-4b08-bc23-1eb53c5b95e1-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:47:50 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-5fa0afff-7939-4f4f-bd35-56215a1c2f0d tempest-TestInstancesWithCinderVolumes-2112103413 None] Acquiring lock "cinder-quobyte-590601b6-1e1b-4b08-bc23-1eb53c5b95e1" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:47:50 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-5fa0afff-7939-4f4f-bd35-56215a1c2f0d tempest-TestInstancesWithCinderVolumes-2112103413 None] Lock "cinder-quobyte-590601b6-1e1b-4b08-bc23-1eb53c5b95e1" acquired by "delete_volume" :: waited 0.016s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:47:50 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1bfb7d9-ee15-41fa-8a73-c1ded549d021]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:47:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5fa0afff-7939-4f4f-bd35-56215a1c2f0d tempest-TestInstancesWithCinderVolumes-2112103413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-590601b6-1e1b-4b08-bc23-1eb53c5b95e1 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:50 devstack sudo[105077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-590601b6-1e1b-4b08-bc23-1eb53c5b95e1 Nov 03 07:47:50 devstack sudo[105077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:50 devstack sudo[105077]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5fa0afff-7939-4f4f-bd35-56215a1c2f0d tempest-TestInstancesWithCinderVolumes-2112103413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-590601b6-1e1b-4b08-bc23-1eb53c5b95e1" returned: 0 in 0.423s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5fa0afff-7939-4f4f-bd35-56215a1c2f0d tempest-TestInstancesWithCinderVolumes-2112103413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-590601b6-1e1b-4b08-bc23-1eb53c5b95e1 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:50 devstack sudo[105084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-590601b6-1e1b-4b08-bc23-1eb53c5b95e1 Nov 03 07:47:50 devstack sudo[105084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:51 devstack sudo[105084]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5fa0afff-7939-4f4f-bd35-56215a1c2f0d tempest-TestInstancesWithCinderVolumes-2112103413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-590601b6-1e1b-4b08-bc23-1eb53c5b95e1" returned: 0 in 0.264s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:51 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-5fa0afff-7939-4f4f-bd35-56215a1c2f0d tempest-TestInstancesWithCinderVolumes-2112103413 None] Lock "cinder-quobyte-590601b6-1e1b-4b08-bc23-1eb53c5b95e1" released by "delete_volume" :: held 0.744s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:47:51 devstack cinder-volume[86875]: WARNING cinder.quota [None req-5fa0afff-7939-4f4f-bd35-56215a1c2f0d tempest-TestInstancesWithCinderVolumes-2112103413 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-876038196-323724894 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-876038196-323724894, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:47:51 devstack cinder-volume[86875]: WARNING cinder.quota [None req-5fa0afff-7939-4f4f-bd35-56215a1c2f0d tempest-TestInstancesWithCinderVolumes-2112103413 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-876038196-323724894 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-876038196-323724894, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:47:51 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-5fa0afff-7939-4f4f-bd35-56215a1c2f0d tempest-TestInstancesWithCinderVolumes-2112103413 None] Created reservations ['741487be-21fc-4ae5-97b5-50ed1e9d8a31', '82d34a17-7e86-4acf-aaab-a79ffe3d1791', 'ab03d430-5bdb-43a9-817c-b65c0815aaf0', 'bff040ea-1805-4860-bd30-2c50bc4e4bd0'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:47:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-5fa0afff-7939-4f4f-bd35-56215a1c2f0d tempest-TestInstancesWithCinderVolumes-2112103413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:47:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-5fa0afff-7939-4f4f-bd35-56215a1c2f0d tempest-TestInstancesWithCinderVolumes-2112103413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:47:51 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-5fa0afff-7939-4f4f-bd35-56215a1c2f0d tempest-TestInstancesWithCinderVolumes-2112103413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:47:51 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-5fa0afff-7939-4f4f-bd35-56215a1c2f0d tempest-TestInstancesWithCinderVolumes-2112103413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:47:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-5fa0afff-7939-4f4f-bd35-56215a1c2f0d tempest-TestInstancesWithCinderVolumes-2112103413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:47:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5fa0afff-7939-4f4f-bd35-56215a1c2f0d tempest-TestInstancesWithCinderVolumes-2112103413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:51 devstack sudo[105087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:47:51 devstack sudo[105087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:51 devstack sudo[105087]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5fa0afff-7939-4f4f-bd35-56215a1c2f0d tempest-TestInstancesWithCinderVolumes-2112103413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.258s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:51 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-5fa0afff-7939-4f4f-bd35-56215a1c2f0d tempest-TestInstancesWithCinderVolumes-2112103413 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:47:51 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-5fa0afff-7939-4f4f-bd35-56215a1c2f0d tempest-TestInstancesWithCinderVolumes-2112103413 None] Deleted volume successfully. Nov 03 07:47:51 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-5fa0afff-7939-4f4f-bd35-56215a1c2f0d tempest-TestInstancesWithCinderVolumes-2112103413 None] Lock "cinder-590601b6-1e1b-4b08-bc23-1eb53c5b95e1-delete_volume" released by "delete_volume" :: held 1.234s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:47:54 devstack cinder-volume[86875]: INFO cinder.volume.manager [req-be42d62c-dd87-4d25-8e11-60b8e9fe45a2 req-a68f2bac-c970-49ef-9a72-7c48edea43a3 tempest-TestInstancesWithCinderVolumes-2112103413 None] Terminate volume connection completed successfully. Nov 03 07:47:54 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-be42d62c-dd87-4d25-8e11-60b8e9fe45a2 req-a68f2bac-c970-49ef-9a72-7c48edea43a3 tempest-TestInstancesWithCinderVolumes-2112103413 None] Deleting attachment 781c3cd4-42ea-46ea-9689-d73a59ca3457. {{(pid=86875) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:47:54 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ea5d7f48-920e-45f5-9b7e-8d101a803359 tempest-TestInstancesWithCinderVolumes-2112103413 None] Acquiring lock "cinder-2263c76b-58b4-44ab-8468-4f8d89cc9ad4-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:47:54 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ea5d7f48-920e-45f5-9b7e-8d101a803359 tempest-TestInstancesWithCinderVolumes-2112103413 None] Lock "cinder-2263c76b-58b4-44ab-8468-4f8d89cc9ad4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:47:55 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ea5d7f48-920e-45f5-9b7e-8d101a803359 tempest-TestInstancesWithCinderVolumes-2112103413 None] Acquiring lock "cinder-quobyte-2263c76b-58b4-44ab-8468-4f8d89cc9ad4" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:47:55 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ea5d7f48-920e-45f5-9b7e-8d101a803359 tempest-TestInstancesWithCinderVolumes-2112103413 None] Lock "cinder-quobyte-2263c76b-58b4-44ab-8468-4f8d89cc9ad4" acquired by "delete_volume" :: waited 0.018s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:47:55 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0432106-6f7b-49e7-9eda-fb8f1faf792d]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:47:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ea5d7f48-920e-45f5-9b7e-8d101a803359 tempest-TestInstancesWithCinderVolumes-2112103413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2263c76b-58b4-44ab-8468-4f8d89cc9ad4 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:55 devstack sudo[105112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2263c76b-58b4-44ab-8468-4f8d89cc9ad4 Nov 03 07:47:55 devstack sudo[105112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:55 devstack sudo[105112]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ea5d7f48-920e-45f5-9b7e-8d101a803359 tempest-TestInstancesWithCinderVolumes-2112103413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2263c76b-58b4-44ab-8468-4f8d89cc9ad4" returned: 0 in 0.400s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ea5d7f48-920e-45f5-9b7e-8d101a803359 tempest-TestInstancesWithCinderVolumes-2112103413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2263c76b-58b4-44ab-8468-4f8d89cc9ad4 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:55 devstack sudo[105117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2263c76b-58b4-44ab-8468-4f8d89cc9ad4 Nov 03 07:47:55 devstack sudo[105117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:55 devstack sudo[105117]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ea5d7f48-920e-45f5-9b7e-8d101a803359 tempest-TestInstancesWithCinderVolumes-2112103413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2263c76b-58b4-44ab-8468-4f8d89cc9ad4" returned: 0 in 0.292s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:55 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ea5d7f48-920e-45f5-9b7e-8d101a803359 tempest-TestInstancesWithCinderVolumes-2112103413 None] Lock "cinder-quobyte-2263c76b-58b4-44ab-8468-4f8d89cc9ad4" released by "delete_volume" :: held 0.740s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:47:55 devstack cinder-volume[86875]: WARNING cinder.quota [None req-ea5d7f48-920e-45f5-9b7e-8d101a803359 tempest-TestInstancesWithCinderVolumes-2112103413 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-628832437-514334949 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-628832437-514334949, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:47:55 devstack cinder-volume[86875]: WARNING cinder.quota [None req-ea5d7f48-920e-45f5-9b7e-8d101a803359 tempest-TestInstancesWithCinderVolumes-2112103413 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-628832437-514334949 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-628832437-514334949, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:47:55 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-ea5d7f48-920e-45f5-9b7e-8d101a803359 tempest-TestInstancesWithCinderVolumes-2112103413 None] Created reservations ['1c87c63a-96e8-464f-a6da-0ab2a95e07cf', '731b5155-73b4-4983-aa98-33612c280b93', 'c92eab6a-644e-4f1f-be44-dd85a9625792', 'a15bd3c9-20cc-486a-8895-ad0a3fe7a796'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:47:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-ea5d7f48-920e-45f5-9b7e-8d101a803359 tempest-TestInstancesWithCinderVolumes-2112103413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:47:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-ea5d7f48-920e-45f5-9b7e-8d101a803359 tempest-TestInstancesWithCinderVolumes-2112103413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:47:55 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-ea5d7f48-920e-45f5-9b7e-8d101a803359 tempest-TestInstancesWithCinderVolumes-2112103413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:47:55 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-ea5d7f48-920e-45f5-9b7e-8d101a803359 tempest-TestInstancesWithCinderVolumes-2112103413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:47:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-ea5d7f48-920e-45f5-9b7e-8d101a803359 tempest-TestInstancesWithCinderVolumes-2112103413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:47:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ea5d7f48-920e-45f5-9b7e-8d101a803359 tempest-TestInstancesWithCinderVolumes-2112103413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:47:56 devstack sudo[105120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:47:56 devstack sudo[105120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:47:56 devstack sudo[105120]: pam_unix(sudo:session): session closed for user root Nov 03 07:47:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ea5d7f48-920e-45f5-9b7e-8d101a803359 tempest-TestInstancesWithCinderVolumes-2112103413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.312s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:47:56 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-ea5d7f48-920e-45f5-9b7e-8d101a803359 tempest-TestInstancesWithCinderVolumes-2112103413 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:47:56 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-ea5d7f48-920e-45f5-9b7e-8d101a803359 tempest-TestInstancesWithCinderVolumes-2112103413 None] Deleted volume successfully. Nov 03 07:47:56 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ea5d7f48-920e-45f5-9b7e-8d101a803359 tempest-TestInstancesWithCinderVolumes-2112103413 None] Lock "cinder-2263c76b-58b4-44ab-8468-4f8d89cc9ad4-delete_volume" released by "delete_volume" :: held 1.336s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:47:59 devstack cinder-volume[86875]: INFO cinder.volume.manager [req-2019e4aa-7e29-4ff0-92ee-5a55920bcffc req-a0b56e93-7c33-4c1d-8aa6-e873a117a8fa tempest-TestInstancesWithCinderVolumes-2112103413 None] Terminate volume connection completed successfully. Nov 03 07:47:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-2019e4aa-7e29-4ff0-92ee-5a55920bcffc req-a0b56e93-7c33-4c1d-8aa6-e873a117a8fa tempest-TestInstancesWithCinderVolumes-2112103413 None] Deleting attachment 353e934c-a73f-4196-97d4-7900b8a83c6c. {{(pid=86875) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:48:00 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-f002141a-3fda-4a89-8d24-2ab7dde143e8 tempest-TestInstancesWithCinderVolumes-2112103413 None] Acquiring lock "cinder-72a0d0b2-c59f-4730-96c3-3e8dd7d520f8-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:48:00 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-f002141a-3fda-4a89-8d24-2ab7dde143e8 tempest-TestInstancesWithCinderVolumes-2112103413 None] Lock "cinder-72a0d0b2-c59f-4730-96c3-3e8dd7d520f8-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:48:00 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-f002141a-3fda-4a89-8d24-2ab7dde143e8 tempest-TestInstancesWithCinderVolumes-2112103413 None] Acquiring lock "cinder-quobyte-72a0d0b2-c59f-4730-96c3-3e8dd7d520f8" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:48:00 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-f002141a-3fda-4a89-8d24-2ab7dde143e8 tempest-TestInstancesWithCinderVolumes-2112103413 None] Lock "cinder-quobyte-72a0d0b2-c59f-4730-96c3-3e8dd7d520f8" acquired by "delete_volume" :: waited 0.017s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:48:00 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[911f04f4-bceb-4c7e-aaed-8060b6a129be]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:48:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f002141a-3fda-4a89-8d24-2ab7dde143e8 tempest-TestInstancesWithCinderVolumes-2112103413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72a0d0b2-c59f-4730-96c3-3e8dd7d520f8 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:48:00 devstack sudo[105154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72a0d0b2-c59f-4730-96c3-3e8dd7d520f8 Nov 03 07:48:00 devstack sudo[105154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:48:00 devstack sudo[105154]: pam_unix(sudo:session): session closed for user root Nov 03 07:48:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f002141a-3fda-4a89-8d24-2ab7dde143e8 tempest-TestInstancesWithCinderVolumes-2112103413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72a0d0b2-c59f-4730-96c3-3e8dd7d520f8" returned: 0 in 0.361s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:48:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f002141a-3fda-4a89-8d24-2ab7dde143e8 tempest-TestInstancesWithCinderVolumes-2112103413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72a0d0b2-c59f-4730-96c3-3e8dd7d520f8 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:48:00 devstack sudo[105159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72a0d0b2-c59f-4730-96c3-3e8dd7d520f8 Nov 03 07:48:00 devstack sudo[105159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:48:00 devstack sudo[105159]: pam_unix(sudo:session): session closed for user root Nov 03 07:48:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f002141a-3fda-4a89-8d24-2ab7dde143e8 tempest-TestInstancesWithCinderVolumes-2112103413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-72a0d0b2-c59f-4730-96c3-3e8dd7d520f8" returned: 0 in 0.242s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:48:00 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-f002141a-3fda-4a89-8d24-2ab7dde143e8 tempest-TestInstancesWithCinderVolumes-2112103413 None] Lock "cinder-quobyte-72a0d0b2-c59f-4730-96c3-3e8dd7d520f8" released by "delete_volume" :: held 0.652s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:48:00 devstack cinder-volume[86875]: WARNING cinder.quota [None req-f002141a-3fda-4a89-8d24-2ab7dde143e8 tempest-TestInstancesWithCinderVolumes-2112103413 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-813718585-1633832837 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-813718585-1633832837, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:48:00 devstack cinder-volume[86875]: WARNING cinder.quota [None req-f002141a-3fda-4a89-8d24-2ab7dde143e8 tempest-TestInstancesWithCinderVolumes-2112103413 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-813718585-1633832837 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-813718585-1633832837, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:48:00 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-f002141a-3fda-4a89-8d24-2ab7dde143e8 tempest-TestInstancesWithCinderVolumes-2112103413 None] Created reservations ['38815f49-4616-4051-a8bd-f5b391a92e43', '8ab085e3-ee56-494c-91bf-fcb792f272c2', 'b68996d7-3eb4-4d56-adc1-b6fab6963d52', '7daabcfc-1212-47e1-9ca0-69a3eedc0667'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:48:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-f002141a-3fda-4a89-8d24-2ab7dde143e8 tempest-TestInstancesWithCinderVolumes-2112103413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:48:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-f002141a-3fda-4a89-8d24-2ab7dde143e8 tempest-TestInstancesWithCinderVolumes-2112103413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:48:00 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-f002141a-3fda-4a89-8d24-2ab7dde143e8 tempest-TestInstancesWithCinderVolumes-2112103413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:48:00 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-f002141a-3fda-4a89-8d24-2ab7dde143e8 tempest-TestInstancesWithCinderVolumes-2112103413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:48:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-f002141a-3fda-4a89-8d24-2ab7dde143e8 tempest-TestInstancesWithCinderVolumes-2112103413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:48:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f002141a-3fda-4a89-8d24-2ab7dde143e8 tempest-TestInstancesWithCinderVolumes-2112103413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:48:00 devstack sudo[105162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:48:00 devstack sudo[105162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:48:01 devstack sudo[105162]: pam_unix(sudo:session): session closed for user root Nov 03 07:48:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f002141a-3fda-4a89-8d24-2ab7dde143e8 tempest-TestInstancesWithCinderVolumes-2112103413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.265s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:48:01 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-f002141a-3fda-4a89-8d24-2ab7dde143e8 tempest-TestInstancesWithCinderVolumes-2112103413 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:48:01 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-f002141a-3fda-4a89-8d24-2ab7dde143e8 tempest-TestInstancesWithCinderVolumes-2112103413 None] Deleted volume successfully. Nov 03 07:48:01 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-f002141a-3fda-4a89-8d24-2ab7dde143e8 tempest-TestInstancesWithCinderVolumes-2112103413 None] Lock "cinder-72a0d0b2-c59f-4730-96c3-3e8dd7d520f8-delete_volume" released by "delete_volume" :: held 1.119s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:48:03 devstack cinder-volume[86875]: DEBUG oslo_service.periodic_task [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86875) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:48:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:48:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:48:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:48:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:48:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:48:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:48:03 devstack sudo[105166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:48:03 devstack sudo[105166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:48:03 devstack sudo[105166]: pam_unix(sudo:session): session closed for user root Nov 03 07:48:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.257s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:48:03 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:48:03 devstack cinder-volume[86875]: DEBUG oslo_service.periodic_task [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running periodic task VolumeManager._thread_info {{(pid=86875) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:48:03 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] thread count: 28 {{(pid=86875) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:48:03 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] thread info: [<_MainThread(MainThread, started 125626325639296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86875) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:48:10 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:SELECT=32,cinder:UPDATE=27,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:48:11 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:SELECT=30,cinder:UPDATE=27,cinder:INSERT=6,cinder:DELETE=2 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:48:35 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:SELECT=1 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:48:35 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:UPDATE=1 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:49:01 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-18b2a6e8-3ed8-4a27-a363-34a51530d1e8 tempest-TestServerVolumeAttachScenarioOldVersion-493957936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:49:01 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-18b2a6e8-3ed8-4a27-a363-34a51530d1e8 tempest-TestServerVolumeAttachScenarioOldVersion-493957936 None] Flow 'volume_create_manager' (2ddfe371-1bee-4299-8e28-32344cbeb333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:49:01 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-18b2a6e8-3ed8-4a27-a363-34a51530d1e8 tempest-TestServerVolumeAttachScenarioOldVersion-493957936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4375ba0f-f0e1-4416-b086-638d19d93e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:01 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-18b2a6e8-3ed8-4a27-a363-34a51530d1e8 tempest-TestServerVolumeAttachScenarioOldVersion-493957936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4375ba0f-f0e1-4416-b086-638d19d93e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:49:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1401165245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=792934c7-8e4b-4e00-9db3-874773effc5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b04a96b215041df94276f60d7fef51e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:49:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:49:01Z,use_quota=True,user_id='070c207000cc43a9acea67e78db6373a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:01 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-18b2a6e8-3ed8-4a27-a363-34a51530d1e8 tempest-TestServerVolumeAttachScenarioOldVersion-493957936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8800ad24-743d-45a9-b578-cdca0c2d7806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:01 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-18b2a6e8-3ed8-4a27-a363-34a51530d1e8 tempest-TestServerVolumeAttachScenarioOldVersion-493957936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8800ad24-743d-45a9-b578-cdca0c2d7806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:01 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-18b2a6e8-3ed8-4a27-a363-34a51530d1e8 tempest-TestServerVolumeAttachScenarioOldVersion-493957936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96e5e154-5853-4b86-af6c-5474ccd8339a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:01 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-18b2a6e8-3ed8-4a27-a363-34a51530d1e8 tempest-TestServerVolumeAttachScenarioOldVersion-493957936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96e5e154-5853-4b86-af6c-5474ccd8339a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '792934c7-8e4b-4e00-9db3-874773effc5f', 'volume_name': 'volume-792934c7-8e4b-4e00-9db3-874773effc5f', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:01 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-18b2a6e8-3ed8-4a27-a363-34a51530d1e8 tempest-TestServerVolumeAttachScenarioOldVersion-493957936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60692dc8-443c-4e04-b329-ded48ed6aada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:01 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-18b2a6e8-3ed8-4a27-a363-34a51530d1e8 tempest-TestServerVolumeAttachScenarioOldVersion-493957936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60692dc8-443c-4e04-b329-ded48ed6aada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:01 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-18b2a6e8-3ed8-4a27-a363-34a51530d1e8 tempest-TestServerVolumeAttachScenarioOldVersion-493957936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (685edeaf-be97-4a19-aa47-4e26e304ad7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:01 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-18b2a6e8-3ed8-4a27-a363-34a51530d1e8 tempest-TestServerVolumeAttachScenarioOldVersion-493957936 None] Volume 792934c7-8e4b-4e00-9db3-874773effc5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-792934c7-8e4b-4e00-9db3-874773effc5f', 'volume_size': 1} Nov 03 07:49:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-18b2a6e8-3ed8-4a27-a363-34a51530d1e8 tempest-TestServerVolumeAttachScenarioOldVersion-493957936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:49:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-18b2a6e8-3ed8-4a27-a363-34a51530d1e8 tempest-TestServerVolumeAttachScenarioOldVersion-493957936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:49:01 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-18b2a6e8-3ed8-4a27-a363-34a51530d1e8 tempest-TestServerVolumeAttachScenarioOldVersion-493957936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:49:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1401165245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=792934c7-8e4b-4e00-9db3-874773effc5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b04a96b215041df94276f60d7fef51e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:49:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:49:01Z,use_quota=True,user_id='070c207000cc43a9acea67e78db6373a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:49:01 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-18b2a6e8-3ed8-4a27-a363-34a51530d1e8 tempest-TestServerVolumeAttachScenarioOldVersion-493957936 None] Creating volume 792934c7-8e4b-4e00-9db3-874773effc5f {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:49:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-18b2a6e8-3ed8-4a27-a363-34a51530d1e8 tempest-TestServerVolumeAttachScenarioOldVersion-493957936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:49:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-18b2a6e8-3ed8-4a27-a363-34a51530d1e8 tempest-TestServerVolumeAttachScenarioOldVersion-493957936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:49:01 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-18b2a6e8-3ed8-4a27-a363-34a51530d1e8 tempest-TestServerVolumeAttachScenarioOldVersion-493957936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:49:01 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-18b2a6e8-3ed8-4a27-a363-34a51530d1e8 tempest-TestServerVolumeAttachScenarioOldVersion-493957936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:49:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-18b2a6e8-3ed8-4a27-a363-34a51530d1e8 tempest-TestServerVolumeAttachScenarioOldVersion-493957936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:49:01 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-18b2a6e8-3ed8-4a27-a363-34a51530d1e8 tempest-TestServerVolumeAttachScenarioOldVersion-493957936 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:49:01 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-18b2a6e8-3ed8-4a27-a363-34a51530d1e8 tempest-TestServerVolumeAttachScenarioOldVersion-493957936 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:49:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-18b2a6e8-3ed8-4a27-a363-34a51530d1e8 tempest-TestServerVolumeAttachScenarioOldVersion-493957936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-792934c7-8e4b-4e00-9db3-874773effc5f 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:01 devstack sudo[105346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-792934c7-8e4b-4e00-9db3-874773effc5f 1073741824 Nov 03 07:49:01 devstack sudo[105346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:01 devstack sudo[105346]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-18b2a6e8-3ed8-4a27-a363-34a51530d1e8 tempest-TestServerVolumeAttachScenarioOldVersion-493957936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-792934c7-8e4b-4e00-9db3-874773effc5f 1073741824" returned: 0 in 0.426s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-18b2a6e8-3ed8-4a27-a363-34a51530d1e8 tempest-TestServerVolumeAttachScenarioOldVersion-493957936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-792934c7-8e4b-4e00-9db3-874773effc5f {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:02 devstack sudo[105351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-792934c7-8e4b-4e00-9db3-874773effc5f Nov 03 07:49:02 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:02 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-18b2a6e8-3ed8-4a27-a363-34a51530d1e8 tempest-TestServerVolumeAttachScenarioOldVersion-493957936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-792934c7-8e4b-4e00-9db3-874773effc5f" returned: 0 in 0.264s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:02 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-18b2a6e8-3ed8-4a27-a363-34a51530d1e8 tempest-TestServerVolumeAttachScenarioOldVersion-493957936 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:49:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-18b2a6e8-3ed8-4a27-a363-34a51530d1e8 tempest-TestServerVolumeAttachScenarioOldVersion-493957936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:49:02 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-18b2a6e8-3ed8-4a27-a363-34a51530d1e8 tempest-TestServerVolumeAttachScenarioOldVersion-493957936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (685edeaf-be97-4a19-aa47-4e26e304ad7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-792934c7-8e4b-4e00-9db3-874773effc5f', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:02 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-18b2a6e8-3ed8-4a27-a363-34a51530d1e8 tempest-TestServerVolumeAttachScenarioOldVersion-493957936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f9120e4-d85b-4d09-8e66-fc7d29eafdda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:02 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-18b2a6e8-3ed8-4a27-a363-34a51530d1e8 tempest-TestServerVolumeAttachScenarioOldVersion-493957936 None] Volume volume-792934c7-8e4b-4e00-9db3-874773effc5f (792934c7-8e4b-4e00-9db3-874773effc5f): created successfully Nov 03 07:49:02 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-18b2a6e8-3ed8-4a27-a363-34a51530d1e8 tempest-TestServerVolumeAttachScenarioOldVersion-493957936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f9120e4-d85b-4d09-8e66-fc7d29eafdda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:02 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-18b2a6e8-3ed8-4a27-a363-34a51530d1e8 tempest-TestServerVolumeAttachScenarioOldVersion-493957936 None] Flow 'volume_create_manager' (2ddfe371-1bee-4299-8e28-32344cbeb333) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:49:02 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-18b2a6e8-3ed8-4a27-a363-34a51530d1e8 tempest-TestServerVolumeAttachScenarioOldVersion-493957936 None] Created volume successfully. Nov 03 07:49:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-a8358fda-6a28-4be8-94ed-39a7545bc03b req-018d88c4-f0f0-4c0c-8641-d50365fe8d5f tempest-TestServerVolumeAttachScenarioOldVersion-493957936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:49:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-a8358fda-6a28-4be8-94ed-39a7545bc03b req-018d88c4-f0f0-4c0c-8641-d50365fe8d5f tempest-TestServerVolumeAttachScenarioOldVersion-493957936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:49:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [req-a8358fda-6a28-4be8-94ed-39a7545bc03b req-018d88c4-f0f0-4c0c-8641-d50365fe8d5f tempest-TestServerVolumeAttachScenarioOldVersion-493957936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:49:03 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-a8358fda-6a28-4be8-94ed-39a7545bc03b req-018d88c4-f0f0-4c0c-8641-d50365fe8d5f tempest-TestServerVolumeAttachScenarioOldVersion-493957936 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1', 'name': 'volume-792934c7-8e4b-4e00-9db3-874773effc5f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b1b6e401-58d4-467b-adb7-80b59ebfa538', 'enforce_multipath': True} {{(pid=86875) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 07:49:03 devstack cinder-volume[86875]: INFO cinder.volume.manager [req-a8358fda-6a28-4be8-94ed-39a7545bc03b req-018d88c4-f0f0-4c0c-8641-d50365fe8d5f tempest-TestServerVolumeAttachScenarioOldVersion-493957936 None] attachment_update completed successfully. Nov 03 07:49:03 devstack cinder-volume[86875]: DEBUG oslo_service.periodic_task [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86875) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:49:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:49:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:49:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:49:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:49:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:49:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:03 devstack sudo[105780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:49:03 devstack sudo[105780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:03 devstack sudo[105780]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.297s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:03 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:49:03 devstack cinder-volume[86875]: DEBUG oslo_service.periodic_task [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running periodic task VolumeManager._thread_info {{(pid=86875) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:49:03 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] thread count: 28 {{(pid=86875) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:49:03 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] thread info: [<_MainThread(MainThread, started 125626325639296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86875) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:49:06 devstack cinder-volume[86875]: INFO cinder.volume.manager [req-2a8e287c-12cc-4e07-b5ef-01f3550110c5 req-1bd22e0b-baeb-437b-8596-1e7e10cad75f tempest-TestServerVolumeAttachScenarioOldVersion-493957936 None] Terminate volume connection completed successfully. Nov 03 07:49:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [req-2a8e287c-12cc-4e07-b5ef-01f3550110c5 req-1bd22e0b-baeb-437b-8596-1e7e10cad75f tempest-TestServerVolumeAttachScenarioOldVersion-493957936 None] Deleting attachment b1b6e401-58d4-467b-adb7-80b59ebfa538. {{(pid=86875) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 07:49:07 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-947d2d5a-b45d-4dc8-a8a4-b2234492388f tempest-TestServerVolumeAttachScenarioOldVersion-493957936 None] Acquiring lock "cinder-792934c7-8e4b-4e00-9db3-874773effc5f-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:49:07 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-947d2d5a-b45d-4dc8-a8a4-b2234492388f tempest-TestServerVolumeAttachScenarioOldVersion-493957936 None] Lock "cinder-792934c7-8e4b-4e00-9db3-874773effc5f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:49:07 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-947d2d5a-b45d-4dc8-a8a4-b2234492388f tempest-TestServerVolumeAttachScenarioOldVersion-493957936 None] Acquiring lock "cinder-quobyte-792934c7-8e4b-4e00-9db3-874773effc5f" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:49:07 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-947d2d5a-b45d-4dc8-a8a4-b2234492388f tempest-TestServerVolumeAttachScenarioOldVersion-493957936 None] Lock "cinder-quobyte-792934c7-8e4b-4e00-9db3-874773effc5f" acquired by "delete_volume" :: waited 0.013s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:49:07 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58ac326-9022-427e-97ed-a10efca3b5da]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:49:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-947d2d5a-b45d-4dc8-a8a4-b2234492388f tempest-TestServerVolumeAttachScenarioOldVersion-493957936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-792934c7-8e4b-4e00-9db3-874773effc5f {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:07 devstack sudo[105810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-792934c7-8e4b-4e00-9db3-874773effc5f Nov 03 07:49:07 devstack sudo[105810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:07 devstack sudo[105810]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-947d2d5a-b45d-4dc8-a8a4-b2234492388f tempest-TestServerVolumeAttachScenarioOldVersion-493957936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-792934c7-8e4b-4e00-9db3-874773effc5f" returned: 0 in 0.347s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-947d2d5a-b45d-4dc8-a8a4-b2234492388f tempest-TestServerVolumeAttachScenarioOldVersion-493957936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-792934c7-8e4b-4e00-9db3-874773effc5f {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:07 devstack sudo[105815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-792934c7-8e4b-4e00-9db3-874773effc5f Nov 03 07:49:07 devstack sudo[105815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:07 devstack sudo[105815]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-947d2d5a-b45d-4dc8-a8a4-b2234492388f tempest-TestServerVolumeAttachScenarioOldVersion-493957936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-792934c7-8e4b-4e00-9db3-874773effc5f" returned: 0 in 0.236s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:07 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-947d2d5a-b45d-4dc8-a8a4-b2234492388f tempest-TestServerVolumeAttachScenarioOldVersion-493957936 None] Lock "cinder-quobyte-792934c7-8e4b-4e00-9db3-874773effc5f" released by "delete_volume" :: held 0.619s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:49:07 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-947d2d5a-b45d-4dc8-a8a4-b2234492388f tempest-TestServerVolumeAttachScenarioOldVersion-493957936 None] Created reservations ['12778de6-adf7-49a6-a852-4ea0dd0e36a0', 'e06552fa-bd5c-42d8-a524-d600207becf2', 'f99a5fa1-3b80-4f4e-bed0-078a751ee582', 'b8278cd7-42ee-493a-8845-0c209fbbca1a'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:49:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-947d2d5a-b45d-4dc8-a8a4-b2234492388f tempest-TestServerVolumeAttachScenarioOldVersion-493957936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:49:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-947d2d5a-b45d-4dc8-a8a4-b2234492388f tempest-TestServerVolumeAttachScenarioOldVersion-493957936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:49:07 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-947d2d5a-b45d-4dc8-a8a4-b2234492388f tempest-TestServerVolumeAttachScenarioOldVersion-493957936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:49:07 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-947d2d5a-b45d-4dc8-a8a4-b2234492388f tempest-TestServerVolumeAttachScenarioOldVersion-493957936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:49:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-947d2d5a-b45d-4dc8-a8a4-b2234492388f tempest-TestServerVolumeAttachScenarioOldVersion-493957936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:49:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-947d2d5a-b45d-4dc8-a8a4-b2234492388f tempest-TestServerVolumeAttachScenarioOldVersion-493957936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:07 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:49:07 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:08 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-947d2d5a-b45d-4dc8-a8a4-b2234492388f tempest-TestServerVolumeAttachScenarioOldVersion-493957936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.231s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:08 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-947d2d5a-b45d-4dc8-a8a4-b2234492388f tempest-TestServerVolumeAttachScenarioOldVersion-493957936 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:49:08 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-947d2d5a-b45d-4dc8-a8a4-b2234492388f tempest-TestServerVolumeAttachScenarioOldVersion-493957936 None] Deleted volume successfully. Nov 03 07:49:08 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-947d2d5a-b45d-4dc8-a8a4-b2234492388f tempest-TestServerVolumeAttachScenarioOldVersion-493957936 None] Lock "cinder-792934c7-8e4b-4e00-9db3-874773effc5f-delete_volume" released by "delete_volume" :: held 1.033s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:49:17 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:SELECT=18,cinder:INSERT=4,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:49:18 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:SELECT=11,cinder:UPDATE=15,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:49:24 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:49:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Flow 'volume_create_manager' (794d22f8-7009-492a-8f5a-8ced0b0003e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:49:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6765bd53-39d0-4ddb-8f1f-fbbbb0ab5b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6765bd53-39d0-4ddb-8f1f-fbbbb0ab5b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:49:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ef00919-19e9-4004-b57e-8631cda7cae4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2971513c2b9c4a5090ba3a90f4e1dc85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:49:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:49:25Z,use_quota=True,user_id='4fe7cf4db9c44e9e8fa88a313aeba68d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e55959d2-aa3f-40a6-a5b9-9adbdee053b4),volume_type_id=e55959d2-aa3f-40a6-a5b9-9adbdee053b4)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b952f008-6f59-45a5-99bc-152be61d0d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b952f008-6f59-45a5-99bc-152be61d0d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d9d5ecc-d26b-473e-b2d1-4ec9fe689f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:24 devstack cinder-volume[86875]: DEBUG cinder.image.glance [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Creating Keystone auth plugin from conf {{(pid=86875) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 07:49:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d9d5ecc-d26b-473e-b2d1-4ec9fe689f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7ef00919-19e9-4004-b57e-8631cda7cae4', 'volume_name': 'volume-7ef00919-19e9-4004-b57e-8631cda7cae4', 'volume_size': 1, 'image_id': 'd4f382e5-c375-49c9-b89f-0f120c800d8f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d4f382e5-c375-49c9-b89f-0f120c800d8f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c7ff2b6538a9b214a431265a807b2dbf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2971513c2b9c4a5090ba3a90f4e1dc85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '01f96a81ecfe41faa14c8b49d03c1d2d855ceaeb3975ac1a8aac4e292ff431ee61bb8a4ebeec7b19be8a91b3a0bbaa48758f1fa5c3b221071fce548102508978', 'id': 'd4f382e5-c375-49c9-b89f-0f120c800d8f', 'created_at': datetime.datetime(2026, 11, 3, 6, 49, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 49, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d4f382e5-c375-49c9-b89f-0f120c800d8f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b29e4ae-304f-41c0-920d-f8be1e9dec2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b29e4ae-304f-41c0-920d-f8be1e9dec2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:24 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43128e73-3ba6-4f09-b611-f8c55a81a11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:24 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Volume 7ef00919-19e9-4004-b57e-8631cda7cae4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7ef00919-19e9-4004-b57e-8631cda7cae4', 'volume_size': 1, 'image_id': 'd4f382e5-c375-49c9-b89f-0f120c800d8f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d4f382e5-c375-49c9-b89f-0f120c800d8f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c7ff2b6538a9b214a431265a807b2dbf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2971513c2b9c4a5090ba3a90f4e1dc85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '01f96a81ecfe41faa14c8b49d03c1d2d855ceaeb3975ac1a8aac4e292ff431ee61bb8a4ebeec7b19be8a91b3a0bbaa48758f1fa5c3b221071fce548102508978', 'id': 'd4f382e5-c375-49c9-b89f-0f120c800d8f', 'created_at': datetime.datetime(2026, 11, 3, 6, 49, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 49, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d4f382e5-c375-49c9-b89f-0f120c800d8f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 03 07:49:24 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Trying to clone 7ef00919-19e9-4004-b57e-8631cda7cae4 from image d4f382e5-c375-49c9-b89f-0f120c800d8f at location (None, [{'url': 'file:///opt/stack/data/glance/images/d4f382e5-c375-49c9-b89f-0f120c800d8f', 'metadata': {}}]). {{(pid=86875) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 07:49:25 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d4f382e5-c375-49c9-b89f-0f120c800d8f_1c_uf3rpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86875) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 07:49:25 devstack cinder-volume[86875]: INFO cinder.image.image_utils [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Image download 0.00 MB at 0.00 MB/s Nov 03 07:49:25 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a63d7a0-b90a-4077-8bac-e099b45f8c4d]: (4, 'raw') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:49:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d4f382e5-c375-49c9-b89f-0f120c800d8f_1c_uf3rpdevstack@QuobyteHD {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:25 devstack sudo[105859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d4f382e5-c375-49c9-b89f-0f120c800d8f_1c_uf3rpdevstack@QuobyteHD Nov 03 07:49:25 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:25 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d4f382e5-c375-49c9-b89f-0f120c800d8f_1c_uf3rpdevstack@QuobyteHD" returned: 0 in 0.321s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d4f382e5-c375-49c9-b89f-0f120c800d8f_1c_uf3rpdevstack@QuobyteHD {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:25 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d4f382e5-c375-49c9-b89f-0f120c800d8f_1c_uf3rpdevstack@QuobyteHD Nov 03 07:49:25 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:25 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d4f382e5-c375-49c9-b89f-0f120c800d8f_1c_uf3rpdevstack@QuobyteHD" returned: 1 in 0.303s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d4f382e5-c375-49c9-b89f-0f120c800d8f_1c_uf3rpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:49:25 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Temporary image d4f382e5-c375-49c9-b89f-0f120c800d8f is fetched for user 4fe7cf4db9c44e9e8fa88a313aeba68d. {{(pid=86875) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 07:49:25 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[c468c1e1-3299-48a4-b8d0-4d4219c793bf]: (4, 'raw') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:49:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d4f382e5-c375-49c9-b89f-0f120c800d8f_1c_uf3rpdevstack@QuobyteHD {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:25 devstack sudo[105868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d4f382e5-c375-49c9-b89f-0f120c800d8f_1c_uf3rpdevstack@QuobyteHD Nov 03 07:49:25 devstack sudo[105868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:26 devstack sudo[105868]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:26 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d4f382e5-c375-49c9-b89f-0f120c800d8f_1c_uf3rpdevstack@QuobyteHD" returned: 0 in 0.334s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:26 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d4f382e5-c375-49c9-b89f-0f120c800d8f_1c_uf3rpdevstack@QuobyteHD {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:26 devstack sudo[105872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d4f382e5-c375-49c9-b89f-0f120c800d8f_1c_uf3rpdevstack@QuobyteHD Nov 03 07:49:26 devstack sudo[105872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:26 devstack sudo[105872]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:26 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d4f382e5-c375-49c9-b89f-0f120c800d8f_1c_uf3rpdevstack@QuobyteHD" returned: 1 in 0.311s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:26 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d4f382e5-c375-49c9-b89f-0f120c800d8f_1c_uf3rpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:49:26 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:49:26 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:49:26 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:49:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ef00919-19e9-4004-b57e-8631cda7cae4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2971513c2b9c4a5090ba3a90f4e1dc85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:49:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:49:25Z,use_quota=True,user_id='4fe7cf4db9c44e9e8fa88a313aeba68d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e55959d2-aa3f-40a6-a5b9-9adbdee053b4),volume_type_id=e55959d2-aa3f-40a6-a5b9-9adbdee053b4)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:49:26 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Creating volume 7ef00919-19e9-4004-b57e-8631cda7cae4 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:49:26 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:49:26 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:49:26 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:49:26 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:49:26 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:49:26 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:49:26 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:49:26 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7ef00919-19e9-4004-b57e-8631cda7cae4 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:26 devstack sudo[105877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7ef00919-19e9-4004-b57e-8631cda7cae4 1073741824 Nov 03 07:49:26 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:26 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:26 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7ef00919-19e9-4004-b57e-8631cda7cae4 1073741824" returned: 0 in 0.428s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:26 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7ef00919-19e9-4004-b57e-8631cda7cae4 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:26 devstack sudo[105883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7ef00919-19e9-4004-b57e-8631cda7cae4 Nov 03 07:49:26 devstack sudo[105883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:27 devstack sudo[105883]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7ef00919-19e9-4004-b57e-8631cda7cae4" returned: 0 in 0.237s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:27 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:49:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:49:27 devstack cinder-volume[86875]: DEBUG cinder.volume.volume_utils [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Attempting download of d4f382e5-c375-49c9-b89f-0f120c800d8f ((None, [{'url': 'file:///opt/stack/data/glance/images/d4f382e5-c375-49c9-b89f-0f120c800d8f', 'metadata': {}}])) to volume 7ef00919-19e9-4004-b57e-8631cda7cae4. {{(pid=86875) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 07:49:27 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeedb7e7-8eb6-4727-a76a-9645eb994715]: (4, 'raw') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:49:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d4f382e5-c375-49c9-b89f-0f120c800d8f_w1s5f92k {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:27 devstack sudo[105886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d4f382e5-c375-49c9-b89f-0f120c800d8f_w1s5f92k Nov 03 07:49:27 devstack sudo[105886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:27 devstack sudo[105886]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d4f382e5-c375-49c9-b89f-0f120c800d8f_w1s5f92k" returned: 0 in 0.302s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d4f382e5-c375-49c9-b89f-0f120c800d8f_w1s5f92k {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:27 devstack sudo[105890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d4f382e5-c375-49c9-b89f-0f120c800d8f_w1s5f92k Nov 03 07:49:27 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:27 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d4f382e5-c375-49c9-b89f-0f120c800d8f_w1s5f92k" returned: 1 in 0.316s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d4f382e5-c375-49c9-b89f-0f120c800d8f_w1s5f92k' failed. Not Retrying. {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:49:27 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbce0b94-f23d-4114-8b4b-2d5709d65ed6]: (4, 'raw') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:49:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d4f382e5-c375-49c9-b89f-0f120c800d8f_1c_uf3rpdevstack@QuobyteHD {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:27 devstack sudo[105894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d4f382e5-c375-49c9-b89f-0f120c800d8f_1c_uf3rpdevstack@QuobyteHD Nov 03 07:49:27 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:28 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d4f382e5-c375-49c9-b89f-0f120c800d8f_1c_uf3rpdevstack@QuobyteHD" returned: 0 in 0.311s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d4f382e5-c375-49c9-b89f-0f120c800d8f_1c_uf3rpdevstack@QuobyteHD {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:28 devstack sudo[105933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d4f382e5-c375-49c9-b89f-0f120c800d8f_1c_uf3rpdevstack@QuobyteHD Nov 03 07:49:28 devstack sudo[105933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:28 devstack sudo[105933]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d4f382e5-c375-49c9-b89f-0f120c800d8f_1c_uf3rpdevstack@QuobyteHD" returned: 1 in 0.313s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d4f382e5-c375-49c9-b89f-0f120c800d8f_1c_uf3rpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:49:28 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] d4f382e5-c375-49c9-b89f-0f120c800d8f was raw, converting to qcow2 {{(pid=86875) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 07:49:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d4f382e5-c375-49c9-b89f-0f120c800d8f_1c_uf3rpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7ef00919-19e9-4004-b57e-8631cda7cae4 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:28 devstack sudo[105940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d4f382e5-c375-49c9-b89f-0f120c800d8f_1c_uf3rpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7ef00919-19e9-4004-b57e-8631cda7cae4 Nov 03 07:49:28 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:28 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d4f382e5-c375-49c9-b89f-0f120c800d8f_1c_uf3rpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7ef00919-19e9-4004-b57e-8631cda7cae4" returned: 0 in 0.408s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:28 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d4f382e5-c375-49c9-b89f-0f120c800d8f_1c_uf3rpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7ef00919-19e9-4004-b57e-8631cda7cae4 {{(pid=86875) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:49:28 devstack cinder-volume[86875]: INFO cinder.image.image_utils [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Converted 0.00 MB image at 0.00 MB/s Nov 03 07:49:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7ef00919-19e9-4004-b57e-8631cda7cae4 1G {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:28 devstack sudo[105946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7ef00919-19e9-4004-b57e-8631cda7cae4 1G Nov 03 07:49:28 devstack sudo[105946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:29 devstack sudo[105946]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:29 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7ef00919-19e9-4004-b57e-8631cda7cae4 1G" returned: 0 in 0.282s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:29 devstack cinder-volume[86875]: DEBUG cinder.volume.volume_utils [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Downloaded image d4f382e5-c375-49c9-b89f-0f120c800d8f ((None, [{'url': 'file:///opt/stack/data/glance/images/d4f382e5-c375-49c9-b89f-0f120c800d8f', 'metadata': {}}])) to volume 7ef00919-19e9-4004-b57e-8631cda7cae4 successfully. {{(pid=86875) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 07:49:29 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Temporary image d4f382e5-c375-49c9-b89f-0f120c800d8f for user 4fe7cf4db9c44e9e8fa88a313aeba68d is deleted. {{(pid=86875) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 07:49:29 devstack cinder-volume[86875]: DEBUG cinder.volume.volume_utils [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Marking volume 7ef00919-19e9-4004-b57e-8631cda7cae4 as bootable. {{(pid=86875) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 07:49:29 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Copying metadata from image d4f382e5-c375-49c9-b89f-0f120c800d8f to 7ef00919-19e9-4004-b57e-8631cda7cae4. {{(pid=86875) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 07:49:29 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Creating volume glance metadata for volume 7ef00919-19e9-4004-b57e-8631cda7cae4 backed by image d4f382e5-c375-49c9-b89f-0f120c800d8f with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'd4f382e5-c375-49c9-b89f-0f120c800d8f', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'c7ff2b6538a9b214a431265a807b2dbf', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86875) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 07:49:29 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43128e73-3ba6-4f09-b611-f8c55a81a11f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ef00919-19e9-4004-b57e-8631cda7cae4', 'volume_size': 1, 'image_id': 'd4f382e5-c375-49c9-b89f-0f120c800d8f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d4f382e5-c375-49c9-b89f-0f120c800d8f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c7ff2b6538a9b214a431265a807b2dbf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2971513c2b9c4a5090ba3a90f4e1dc85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '01f96a81ecfe41faa14c8b49d03c1d2d855ceaeb3975ac1a8aac4e292ff431ee61bb8a4ebeec7b19be8a91b3a0bbaa48758f1fa5c3b221071fce548102508978', 'id': 'd4f382e5-c375-49c9-b89f-0f120c800d8f', 'created_at': datetime.datetime(2026, 11, 3, 6, 49, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 49, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d4f382e5-c375-49c9-b89f-0f120c800d8f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:29 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b132c1af-c41f-45f9-bd5f-2784578c3449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:29 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Volume volume-7ef00919-19e9-4004-b57e-8631cda7cae4 (7ef00919-19e9-4004-b57e-8631cda7cae4): created successfully Nov 03 07:49:29 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b132c1af-c41f-45f9-bd5f-2784578c3449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:29 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Flow 'volume_create_manager' (794d22f8-7009-492a-8f5a-8ced0b0003e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:49:29 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-46d0e21d-6cb8-4f32-b9d1-967c50cdd674 tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Created volume successfully. Nov 03 07:49:29 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-4c4ed697-8aaf-4db9-bf0f-ccb32fce570d tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Acquiring lock "cinder-7ef00919-19e9-4004-b57e-8631cda7cae4-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:49:29 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-4c4ed697-8aaf-4db9-bf0f-ccb32fce570d tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Lock "cinder-7ef00919-19e9-4004-b57e-8631cda7cae4-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:49:30 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-4c4ed697-8aaf-4db9-bf0f-ccb32fce570d tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Acquiring lock "cinder-quobyte-7ef00919-19e9-4004-b57e-8631cda7cae4" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:49:30 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-4c4ed697-8aaf-4db9-bf0f-ccb32fce570d tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Lock "cinder-quobyte-7ef00919-19e9-4004-b57e-8631cda7cae4" acquired by "delete_volume" :: waited 0.016s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:49:30 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[189d22bb-d620-4865-ac92-edf87997995c]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:49:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4c4ed697-8aaf-4db9-bf0f-ccb32fce570d tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7ef00919-19e9-4004-b57e-8631cda7cae4 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:30 devstack sudo[105951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7ef00919-19e9-4004-b57e-8631cda7cae4 Nov 03 07:49:30 devstack sudo[105951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:30 devstack sudo[105951]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4c4ed697-8aaf-4db9-bf0f-ccb32fce570d tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7ef00919-19e9-4004-b57e-8631cda7cae4" returned: 0 in 0.348s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4c4ed697-8aaf-4db9-bf0f-ccb32fce570d tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7ef00919-19e9-4004-b57e-8631cda7cae4 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:30 devstack sudo[105956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7ef00919-19e9-4004-b57e-8631cda7cae4 Nov 03 07:49:30 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:30 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4c4ed697-8aaf-4db9-bf0f-ccb32fce570d tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7ef00919-19e9-4004-b57e-8631cda7cae4" returned: 0 in 0.229s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:30 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-4c4ed697-8aaf-4db9-bf0f-ccb32fce570d tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Lock "cinder-quobyte-7ef00919-19e9-4004-b57e-8631cda7cae4" released by "delete_volume" :: held 0.613s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:49:30 devstack cinder-volume[86875]: WARNING cinder.quota [None req-4c4ed697-8aaf-4db9-bf0f-ccb32fce570d tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:49:30 devstack cinder-volume[86875]: WARNING cinder.quota [None req-4c4ed697-8aaf-4db9-bf0f-ccb32fce570d tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 03 07:49:30 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-4c4ed697-8aaf-4db9-bf0f-ccb32fce570d tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Created reservations ['19513183-448f-4e16-b341-015bbb99b882', 'd236de4c-8fb8-4769-b1c1-e0c944db9c4f', '01a377a5-45e1-4ea2-8617-c45e5595d553', 'e75cd5cc-f3f1-434f-8120-14b69a5bafac'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:49:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-4c4ed697-8aaf-4db9-bf0f-ccb32fce570d tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:49:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-4c4ed697-8aaf-4db9-bf0f-ccb32fce570d tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:49:30 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-4c4ed697-8aaf-4db9-bf0f-ccb32fce570d tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:49:30 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-4c4ed697-8aaf-4db9-bf0f-ccb32fce570d tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:49:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-4c4ed697-8aaf-4db9-bf0f-ccb32fce570d tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:49:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4c4ed697-8aaf-4db9-bf0f-ccb32fce570d tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:30 devstack sudo[105959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:49:30 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:30 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4c4ed697-8aaf-4db9-bf0f-ccb32fce570d tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.227s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:30 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-4c4ed697-8aaf-4db9-bf0f-ccb32fce570d tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:49:30 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-4c4ed697-8aaf-4db9-bf0f-ccb32fce570d tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Deleted volume successfully. Nov 03 07:49:30 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-4c4ed697-8aaf-4db9-bf0f-ccb32fce570d tempest-VolumeAndVolumeTypeFromImageTest-1683836457 None] Lock "cinder-7ef00919-19e9-4004-b57e-8631cda7cae4-delete_volume" released by "delete_volume" :: held 1.018s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:49:35 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-13cfaa64-c2d1-4801-aea7-65fd6ed43ce2 tempest-ProjectReaderTests-818354761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:49:35 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-13cfaa64-c2d1-4801-aea7-65fd6ed43ce2 tempest-ProjectReaderTests-818354761 None] Flow 'volume_create_manager' (8cb74162-e692-4237-b4b0-5b522c32950f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:49:35 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-13cfaa64-c2d1-4801-aea7-65fd6ed43ce2 tempest-ProjectReaderTests-818354761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40fe7d1b-ac74-4837-a65b-21b019cc8d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:35 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-13cfaa64-c2d1-4801-aea7-65fd6ed43ce2 tempest-ProjectReaderTests-818354761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40fe7d1b-ac74-4837-a65b-21b019cc8d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:49:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1477399802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fffeffc-67fd-4455-82d4-7bb4b8fe0f27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc51d2c667394d1d93a585ba1d3aa1c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:49:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:49:35Z,use_quota=True,user_id='7578371e89ab4359abcd0690578af63b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:35 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-13cfaa64-c2d1-4801-aea7-65fd6ed43ce2 tempest-ProjectReaderTests-818354761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (343cd946-0da7-4f85-a41b-27e3de31717f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:35 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-13cfaa64-c2d1-4801-aea7-65fd6ed43ce2 tempest-ProjectReaderTests-818354761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (343cd946-0da7-4f85-a41b-27e3de31717f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:35 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-13cfaa64-c2d1-4801-aea7-65fd6ed43ce2 tempest-ProjectReaderTests-818354761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (758f7207-e8b6-4bd9-9450-6a3218e6850d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:35 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-13cfaa64-c2d1-4801-aea7-65fd6ed43ce2 tempest-ProjectReaderTests-818354761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (758f7207-e8b6-4bd9-9450-6a3218e6850d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fffeffc-67fd-4455-82d4-7bb4b8fe0f27', 'volume_name': 'volume-2fffeffc-67fd-4455-82d4-7bb4b8fe0f27', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:35 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-13cfaa64-c2d1-4801-aea7-65fd6ed43ce2 tempest-ProjectReaderTests-818354761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (425ef468-0927-4ba6-b48a-3a552cfd2aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:35 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-13cfaa64-c2d1-4801-aea7-65fd6ed43ce2 tempest-ProjectReaderTests-818354761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (425ef468-0927-4ba6-b48a-3a552cfd2aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:35 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-13cfaa64-c2d1-4801-aea7-65fd6ed43ce2 tempest-ProjectReaderTests-818354761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68a724db-3840-470d-8c98-370ea05bda8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:35 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-13cfaa64-c2d1-4801-aea7-65fd6ed43ce2 tempest-ProjectReaderTests-818354761 None] Volume 2fffeffc-67fd-4455-82d4-7bb4b8fe0f27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fffeffc-67fd-4455-82d4-7bb4b8fe0f27', 'volume_size': 1} Nov 03 07:49:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-13cfaa64-c2d1-4801-aea7-65fd6ed43ce2 tempest-ProjectReaderTests-818354761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:49:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-13cfaa64-c2d1-4801-aea7-65fd6ed43ce2 tempest-ProjectReaderTests-818354761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:49:35 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-13cfaa64-c2d1-4801-aea7-65fd6ed43ce2 tempest-ProjectReaderTests-818354761 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:49:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1477399802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fffeffc-67fd-4455-82d4-7bb4b8fe0f27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc51d2c667394d1d93a585ba1d3aa1c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:49:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:49:35Z,use_quota=True,user_id='7578371e89ab4359abcd0690578af63b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:49:35 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-13cfaa64-c2d1-4801-aea7-65fd6ed43ce2 tempest-ProjectReaderTests-818354761 None] Creating volume 2fffeffc-67fd-4455-82d4-7bb4b8fe0f27 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:49:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-13cfaa64-c2d1-4801-aea7-65fd6ed43ce2 tempest-ProjectReaderTests-818354761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:49:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-13cfaa64-c2d1-4801-aea7-65fd6ed43ce2 tempest-ProjectReaderTests-818354761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:49:35 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-13cfaa64-c2d1-4801-aea7-65fd6ed43ce2 tempest-ProjectReaderTests-818354761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:49:35 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-13cfaa64-c2d1-4801-aea7-65fd6ed43ce2 tempest-ProjectReaderTests-818354761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:49:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-13cfaa64-c2d1-4801-aea7-65fd6ed43ce2 tempest-ProjectReaderTests-818354761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:49:35 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-13cfaa64-c2d1-4801-aea7-65fd6ed43ce2 tempest-ProjectReaderTests-818354761 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:49:35 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-13cfaa64-c2d1-4801-aea7-65fd6ed43ce2 tempest-ProjectReaderTests-818354761 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:49:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-13cfaa64-c2d1-4801-aea7-65fd6ed43ce2 tempest-ProjectReaderTests-818354761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2fffeffc-67fd-4455-82d4-7bb4b8fe0f27 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:35 devstack sudo[105963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2fffeffc-67fd-4455-82d4-7bb4b8fe0f27 1073741824 Nov 03 07:49:35 devstack sudo[105963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:35 devstack sudo[105963]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-13cfaa64-c2d1-4801-aea7-65fd6ed43ce2 tempest-ProjectReaderTests-818354761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2fffeffc-67fd-4455-82d4-7bb4b8fe0f27 1073741824" returned: 0 in 0.408s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-13cfaa64-c2d1-4801-aea7-65fd6ed43ce2 tempest-ProjectReaderTests-818354761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2fffeffc-67fd-4455-82d4-7bb4b8fe0f27 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:35 devstack sudo[105968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2fffeffc-67fd-4455-82d4-7bb4b8fe0f27 Nov 03 07:49:35 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:36 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:36 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-13cfaa64-c2d1-4801-aea7-65fd6ed43ce2 tempest-ProjectReaderTests-818354761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2fffeffc-67fd-4455-82d4-7bb4b8fe0f27" returned: 0 in 0.230s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:36 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-13cfaa64-c2d1-4801-aea7-65fd6ed43ce2 tempest-ProjectReaderTests-818354761 None] <== create_volume: return (673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:49:36 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-13cfaa64-c2d1-4801-aea7-65fd6ed43ce2 tempest-ProjectReaderTests-818354761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.675s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:49:36 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-13cfaa64-c2d1-4801-aea7-65fd6ed43ce2 tempest-ProjectReaderTests-818354761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68a724db-3840-470d-8c98-370ea05bda8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fffeffc-67fd-4455-82d4-7bb4b8fe0f27', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:36 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-13cfaa64-c2d1-4801-aea7-65fd6ed43ce2 tempest-ProjectReaderTests-818354761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ed12012-fb77-4a9c-b1ac-796ddea00028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:36 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-13cfaa64-c2d1-4801-aea7-65fd6ed43ce2 tempest-ProjectReaderTests-818354761 None] Volume volume-2fffeffc-67fd-4455-82d4-7bb4b8fe0f27 (2fffeffc-67fd-4455-82d4-7bb4b8fe0f27): created successfully Nov 03 07:49:36 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-13cfaa64-c2d1-4801-aea7-65fd6ed43ce2 tempest-ProjectReaderTests-818354761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ed12012-fb77-4a9c-b1ac-796ddea00028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:36 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-13cfaa64-c2d1-4801-aea7-65fd6ed43ce2 tempest-ProjectReaderTests-818354761 None] Flow 'volume_create_manager' (8cb74162-e692-4237-b4b0-5b522c32950f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:49:36 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-13cfaa64-c2d1-4801-aea7-65fd6ed43ce2 tempest-ProjectReaderTests-818354761 None] Created volume successfully. Nov 03 07:49:36 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-20a77a67-e4da-4378-bac6-f8494a828f69 tempest-ProjectReaderTests-818354761 None] Acquiring lock "cinder-2fffeffc-67fd-4455-82d4-7bb4b8fe0f27-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:49:36 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-20a77a67-e4da-4378-bac6-f8494a828f69 tempest-ProjectReaderTests-818354761 None] Lock "cinder-2fffeffc-67fd-4455-82d4-7bb4b8fe0f27-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:49:36 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-20a77a67-e4da-4378-bac6-f8494a828f69 tempest-ProjectReaderTests-818354761 None] Acquiring lock "cinder-quobyte-2fffeffc-67fd-4455-82d4-7bb4b8fe0f27" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:49:36 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-20a77a67-e4da-4378-bac6-f8494a828f69 tempest-ProjectReaderTests-818354761 None] Lock "cinder-quobyte-2fffeffc-67fd-4455-82d4-7bb4b8fe0f27" acquired by "delete_volume" :: waited 0.012s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:49:36 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[8606d1cd-8a14-424b-b933-929605d1bb0c]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:49:36 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-20a77a67-e4da-4378-bac6-f8494a828f69 tempest-ProjectReaderTests-818354761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2fffeffc-67fd-4455-82d4-7bb4b8fe0f27 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:36 devstack sudo[105971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2fffeffc-67fd-4455-82d4-7bb4b8fe0f27 Nov 03 07:49:36 devstack sudo[105971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:37 devstack sudo[105971]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-20a77a67-e4da-4378-bac6-f8494a828f69 tempest-ProjectReaderTests-818354761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2fffeffc-67fd-4455-82d4-7bb4b8fe0f27" returned: 0 in 0.346s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-20a77a67-e4da-4378-bac6-f8494a828f69 tempest-ProjectReaderTests-818354761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2fffeffc-67fd-4455-82d4-7bb4b8fe0f27 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:37 devstack sudo[105978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2fffeffc-67fd-4455-82d4-7bb4b8fe0f27 Nov 03 07:49:37 devstack sudo[105978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:37 devstack sudo[105978]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-20a77a67-e4da-4378-bac6-f8494a828f69 tempest-ProjectReaderTests-818354761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2fffeffc-67fd-4455-82d4-7bb4b8fe0f27" returned: 0 in 0.231s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:37 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-20a77a67-e4da-4378-bac6-f8494a828f69 tempest-ProjectReaderTests-818354761 None] Lock "cinder-quobyte-2fffeffc-67fd-4455-82d4-7bb4b8fe0f27" released by "delete_volume" :: held 0.616s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:49:37 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-20a77a67-e4da-4378-bac6-f8494a828f69 tempest-ProjectReaderTests-818354761 None] Created reservations ['efa1f299-d7ce-4e9f-a258-75ef48149d6d', 'f4f6e01e-d943-454b-9ab8-0d3f12f70958', 'f5744f41-2054-44ed-bdbe-aa007078ffd2', '50fb7d2f-03db-41a1-bb9e-bd77c753b176'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:49:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-20a77a67-e4da-4378-bac6-f8494a828f69 tempest-ProjectReaderTests-818354761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:49:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-20a77a67-e4da-4378-bac6-f8494a828f69 tempest-ProjectReaderTests-818354761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:49:37 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-20a77a67-e4da-4378-bac6-f8494a828f69 tempest-ProjectReaderTests-818354761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:49:37 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-20a77a67-e4da-4378-bac6-f8494a828f69 tempest-ProjectReaderTests-818354761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:49:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-20a77a67-e4da-4378-bac6-f8494a828f69 tempest-ProjectReaderTests-818354761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:49:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-20a77a67-e4da-4378-bac6-f8494a828f69 tempest-ProjectReaderTests-818354761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:37 devstack sudo[105981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:49:37 devstack sudo[105981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:37 devstack sudo[105981]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-20a77a67-e4da-4378-bac6-f8494a828f69 tempest-ProjectReaderTests-818354761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.228s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:37 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-20a77a67-e4da-4378-bac6-f8494a828f69 tempest-ProjectReaderTests-818354761 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:49:37 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-20a77a67-e4da-4378-bac6-f8494a828f69 tempest-ProjectReaderTests-818354761 None] Deleted volume successfully. Nov 03 07:49:37 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-20a77a67-e4da-4378-bac6-f8494a828f69 tempest-ProjectReaderTests-818354761 None] Lock "cinder-2fffeffc-67fd-4455-82d4-7bb4b8fe0f27-delete_volume" released by "delete_volume" :: held 1.014s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:49:38 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0f8ced1-6153-4b97-b1e4-03b6de8d51c9 tempest-ProjectReaderTests-818354761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:49:38 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d0f8ced1-6153-4b97-b1e4-03b6de8d51c9 tempest-ProjectReaderTests-818354761 None] Flow 'volume_create_manager' (5b4a0c38-6f94-44eb-af89-1b408688b8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:49:38 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d0f8ced1-6153-4b97-b1e4-03b6de8d51c9 tempest-ProjectReaderTests-818354761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (333bb00a-0abf-4664-a7e2-0ed76461d8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:38 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d0f8ced1-6153-4b97-b1e4-03b6de8d51c9 tempest-ProjectReaderTests-818354761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (333bb00a-0abf-4664-a7e2-0ed76461d8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:49:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1400979501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb83642a-30d0-4345-a9cc-9e54e53f9485,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc51d2c667394d1d93a585ba1d3aa1c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:49:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:49:38Z,use_quota=True,user_id='7578371e89ab4359abcd0690578af63b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:38 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d0f8ced1-6153-4b97-b1e4-03b6de8d51c9 tempest-ProjectReaderTests-818354761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90c5f762-a692-4c69-acef-9bbe10b8a2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:38 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d0f8ced1-6153-4b97-b1e4-03b6de8d51c9 tempest-ProjectReaderTests-818354761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90c5f762-a692-4c69-acef-9bbe10b8a2a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:38 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d0f8ced1-6153-4b97-b1e4-03b6de8d51c9 tempest-ProjectReaderTests-818354761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59abbea4-e38e-40d3-93e1-1ed8a90f2997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:38 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d0f8ced1-6153-4b97-b1e4-03b6de8d51c9 tempest-ProjectReaderTests-818354761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59abbea4-e38e-40d3-93e1-1ed8a90f2997) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb83642a-30d0-4345-a9cc-9e54e53f9485', 'volume_name': 'volume-eb83642a-30d0-4345-a9cc-9e54e53f9485', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:38 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d0f8ced1-6153-4b97-b1e4-03b6de8d51c9 tempest-ProjectReaderTests-818354761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (778866cb-8ec5-4fca-b821-9f9f5451004a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:38 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d0f8ced1-6153-4b97-b1e4-03b6de8d51c9 tempest-ProjectReaderTests-818354761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (778866cb-8ec5-4fca-b821-9f9f5451004a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:38 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d0f8ced1-6153-4b97-b1e4-03b6de8d51c9 tempest-ProjectReaderTests-818354761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47810275-d1f8-4d31-b5d2-53e22ad08274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:38 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-d0f8ced1-6153-4b97-b1e4-03b6de8d51c9 tempest-ProjectReaderTests-818354761 None] Volume eb83642a-30d0-4345-a9cc-9e54e53f9485: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb83642a-30d0-4345-a9cc-9e54e53f9485', 'volume_size': 1} Nov 03 07:49:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-d0f8ced1-6153-4b97-b1e4-03b6de8d51c9 tempest-ProjectReaderTests-818354761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:49:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-d0f8ced1-6153-4b97-b1e4-03b6de8d51c9 tempest-ProjectReaderTests-818354761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:49:38 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-d0f8ced1-6153-4b97-b1e4-03b6de8d51c9 tempest-ProjectReaderTests-818354761 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:49:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1400979501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb83642a-30d0-4345-a9cc-9e54e53f9485,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc51d2c667394d1d93a585ba1d3aa1c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:49:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:49:38Z,use_quota=True,user_id='7578371e89ab4359abcd0690578af63b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:49:38 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-d0f8ced1-6153-4b97-b1e4-03b6de8d51c9 tempest-ProjectReaderTests-818354761 None] Creating volume eb83642a-30d0-4345-a9cc-9e54e53f9485 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:49:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-d0f8ced1-6153-4b97-b1e4-03b6de8d51c9 tempest-ProjectReaderTests-818354761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:49:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-d0f8ced1-6153-4b97-b1e4-03b6de8d51c9 tempest-ProjectReaderTests-818354761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:49:38 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-d0f8ced1-6153-4b97-b1e4-03b6de8d51c9 tempest-ProjectReaderTests-818354761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:49:38 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-d0f8ced1-6153-4b97-b1e4-03b6de8d51c9 tempest-ProjectReaderTests-818354761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:49:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-d0f8ced1-6153-4b97-b1e4-03b6de8d51c9 tempest-ProjectReaderTests-818354761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:49:38 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-d0f8ced1-6153-4b97-b1e4-03b6de8d51c9 tempest-ProjectReaderTests-818354761 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:49:38 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-d0f8ced1-6153-4b97-b1e4-03b6de8d51c9 tempest-ProjectReaderTests-818354761 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:49:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d0f8ced1-6153-4b97-b1e4-03b6de8d51c9 tempest-ProjectReaderTests-818354761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-eb83642a-30d0-4345-a9cc-9e54e53f9485 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:38 devstack sudo[105985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-eb83642a-30d0-4345-a9cc-9e54e53f9485 1073741824 Nov 03 07:49:38 devstack sudo[105985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:38 devstack sudo[105985]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d0f8ced1-6153-4b97-b1e4-03b6de8d51c9 tempest-ProjectReaderTests-818354761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-eb83642a-30d0-4345-a9cc-9e54e53f9485 1073741824" returned: 0 in 0.383s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d0f8ced1-6153-4b97-b1e4-03b6de8d51c9 tempest-ProjectReaderTests-818354761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-eb83642a-30d0-4345-a9cc-9e54e53f9485 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:38 devstack sudo[105990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-eb83642a-30d0-4345-a9cc-9e54e53f9485 Nov 03 07:49:38 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:38 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d0f8ced1-6153-4b97-b1e4-03b6de8d51c9 tempest-ProjectReaderTests-818354761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-eb83642a-30d0-4345-a9cc-9e54e53f9485" returned: 0 in 0.226s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:38 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-d0f8ced1-6153-4b97-b1e4-03b6de8d51c9 tempest-ProjectReaderTests-818354761 None] <== create_volume: return (646ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:49:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-d0f8ced1-6153-4b97-b1e4-03b6de8d51c9 tempest-ProjectReaderTests-818354761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.648s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:49:38 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d0f8ced1-6153-4b97-b1e4-03b6de8d51c9 tempest-ProjectReaderTests-818354761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47810275-d1f8-4d31-b5d2-53e22ad08274) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb83642a-30d0-4345-a9cc-9e54e53f9485', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:38 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d0f8ced1-6153-4b97-b1e4-03b6de8d51c9 tempest-ProjectReaderTests-818354761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f6c7e2d-bafc-41cd-927f-4f7218cd8c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:38 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-d0f8ced1-6153-4b97-b1e4-03b6de8d51c9 tempest-ProjectReaderTests-818354761 None] Volume volume-eb83642a-30d0-4345-a9cc-9e54e53f9485 (eb83642a-30d0-4345-a9cc-9e54e53f9485): created successfully Nov 03 07:49:38 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d0f8ced1-6153-4b97-b1e4-03b6de8d51c9 tempest-ProjectReaderTests-818354761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f6c7e2d-bafc-41cd-927f-4f7218cd8c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:38 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d0f8ced1-6153-4b97-b1e4-03b6de8d51c9 tempest-ProjectReaderTests-818354761 None] Flow 'volume_create_manager' (5b4a0c38-6f94-44eb-af89-1b408688b8a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:49:38 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-d0f8ced1-6153-4b97-b1e4-03b6de8d51c9 tempest-ProjectReaderTests-818354761 None] Created volume successfully. Nov 03 07:49:39 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-c1c64b4f-388f-4a61-a71d-11512a8af129 tempest-ProjectReaderTests-818354761 None] Acquiring lock "cinder-eb83642a-30d0-4345-a9cc-9e54e53f9485-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:49:39 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-c1c64b4f-388f-4a61-a71d-11512a8af129 tempest-ProjectReaderTests-818354761 None] Lock "cinder-eb83642a-30d0-4345-a9cc-9e54e53f9485-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:49:39 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-c1c64b4f-388f-4a61-a71d-11512a8af129 tempest-ProjectReaderTests-818354761 None] Acquiring lock "cinder-quobyte-eb83642a-30d0-4345-a9cc-9e54e53f9485" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:49:39 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-c1c64b4f-388f-4a61-a71d-11512a8af129 tempest-ProjectReaderTests-818354761 None] Lock "cinder-quobyte-eb83642a-30d0-4345-a9cc-9e54e53f9485" acquired by "delete_volume" :: waited 0.019s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:49:39 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c526e3-b59b-41c7-b15a-fbe0e498944a]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:49:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c1c64b4f-388f-4a61-a71d-11512a8af129 tempest-ProjectReaderTests-818354761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-eb83642a-30d0-4345-a9cc-9e54e53f9485 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:39 devstack sudo[105993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-eb83642a-30d0-4345-a9cc-9e54e53f9485 Nov 03 07:49:39 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:39 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c1c64b4f-388f-4a61-a71d-11512a8af129 tempest-ProjectReaderTests-818354761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-eb83642a-30d0-4345-a9cc-9e54e53f9485" returned: 0 in 0.334s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c1c64b4f-388f-4a61-a71d-11512a8af129 tempest-ProjectReaderTests-818354761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-eb83642a-30d0-4345-a9cc-9e54e53f9485 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:39 devstack sudo[105998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-eb83642a-30d0-4345-a9cc-9e54e53f9485 Nov 03 07:49:39 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:39 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c1c64b4f-388f-4a61-a71d-11512a8af129 tempest-ProjectReaderTests-818354761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-eb83642a-30d0-4345-a9cc-9e54e53f9485" returned: 0 in 0.228s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:39 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-c1c64b4f-388f-4a61-a71d-11512a8af129 tempest-ProjectReaderTests-818354761 None] Lock "cinder-quobyte-eb83642a-30d0-4345-a9cc-9e54e53f9485" released by "delete_volume" :: held 0.599s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:49:39 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-c1c64b4f-388f-4a61-a71d-11512a8af129 tempest-ProjectReaderTests-818354761 None] Created reservations ['f658ebe1-7dd5-40b2-9658-d9810463e654', '1353cdac-d273-4989-b6a7-b4ce2e1228ab', '4f0b561f-c535-4605-9760-bd18dd9e5937', '1e0e3617-a177-46d1-951c-75ca70ba5d9d'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:49:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-c1c64b4f-388f-4a61-a71d-11512a8af129 tempest-ProjectReaderTests-818354761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:49:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-c1c64b4f-388f-4a61-a71d-11512a8af129 tempest-ProjectReaderTests-818354761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:49:39 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-c1c64b4f-388f-4a61-a71d-11512a8af129 tempest-ProjectReaderTests-818354761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:49:39 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-c1c64b4f-388f-4a61-a71d-11512a8af129 tempest-ProjectReaderTests-818354761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:49:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-c1c64b4f-388f-4a61-a71d-11512a8af129 tempest-ProjectReaderTests-818354761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:49:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c1c64b4f-388f-4a61-a71d-11512a8af129 tempest-ProjectReaderTests-818354761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:40 devstack sudo[106001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:49:40 devstack sudo[106001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:40 devstack sudo[106001]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c1c64b4f-388f-4a61-a71d-11512a8af129 tempest-ProjectReaderTests-818354761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.229s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:40 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-c1c64b4f-388f-4a61-a71d-11512a8af129 tempest-ProjectReaderTests-818354761 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:49:40 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-c1c64b4f-388f-4a61-a71d-11512a8af129 tempest-ProjectReaderTests-818354761 None] Deleted volume successfully. Nov 03 07:49:40 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-c1c64b4f-388f-4a61-a71d-11512a8af129 tempest-ProjectReaderTests-818354761 None] Lock "cinder-eb83642a-30d0-4345-a9cc-9e54e53f9485-delete_volume" released by "delete_volume" :: held 1.006s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:49:43 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfc7b834-3c5a-4cf8-9822-48bbf5409e82 tempest-ProjectReaderTests-575974097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:49:43 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-bfc7b834-3c5a-4cf8-9822-48bbf5409e82 tempest-ProjectReaderTests-575974097 None] Flow 'volume_create_manager' (7b80a375-7b04-4bb8-adb3-9b5a7a22a66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:49:43 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-bfc7b834-3c5a-4cf8-9822-48bbf5409e82 tempest-ProjectReaderTests-575974097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cffbb687-6554-4cb3-854d-a2181b487d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:43 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-bfc7b834-3c5a-4cf8-9822-48bbf5409e82 tempest-ProjectReaderTests-575974097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cffbb687-6554-4cb3-854d-a2181b487d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:49:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1982924210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=699bd67c-3feb-4593-acb1-ce5f60206bf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47f104a86ca346f5b898eab1c4d9482a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:49:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:49:44Z,use_quota=True,user_id='70b95a27fada42e8b98b7b321e013804',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:43 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-bfc7b834-3c5a-4cf8-9822-48bbf5409e82 tempest-ProjectReaderTests-575974097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a27e08e2-4efb-47ba-be2a-78c056a85386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:43 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-bfc7b834-3c5a-4cf8-9822-48bbf5409e82 tempest-ProjectReaderTests-575974097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a27e08e2-4efb-47ba-be2a-78c056a85386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:43 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-bfc7b834-3c5a-4cf8-9822-48bbf5409e82 tempest-ProjectReaderTests-575974097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b4d928d-8b0e-4796-b6f0-b23ff3f8ad4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:43 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-bfc7b834-3c5a-4cf8-9822-48bbf5409e82 tempest-ProjectReaderTests-575974097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b4d928d-8b0e-4796-b6f0-b23ff3f8ad4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '699bd67c-3feb-4593-acb1-ce5f60206bf1', 'volume_name': 'volume-699bd67c-3feb-4593-acb1-ce5f60206bf1', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:43 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-bfc7b834-3c5a-4cf8-9822-48bbf5409e82 tempest-ProjectReaderTests-575974097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ceff38f-515f-4df2-85d8-1bbb6b8a180e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:43 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-bfc7b834-3c5a-4cf8-9822-48bbf5409e82 tempest-ProjectReaderTests-575974097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ceff38f-515f-4df2-85d8-1bbb6b8a180e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:43 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-bfc7b834-3c5a-4cf8-9822-48bbf5409e82 tempest-ProjectReaderTests-575974097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b86ad2c-0d2f-4cdd-b7e8-76477317ca21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:43 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-bfc7b834-3c5a-4cf8-9822-48bbf5409e82 tempest-ProjectReaderTests-575974097 None] Volume 699bd67c-3feb-4593-acb1-ce5f60206bf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-699bd67c-3feb-4593-acb1-ce5f60206bf1', 'volume_size': 1} Nov 03 07:49:43 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-bfc7b834-3c5a-4cf8-9822-48bbf5409e82 tempest-ProjectReaderTests-575974097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:49:43 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-bfc7b834-3c5a-4cf8-9822-48bbf5409e82 tempest-ProjectReaderTests-575974097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:49:43 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-bfc7b834-3c5a-4cf8-9822-48bbf5409e82 tempest-ProjectReaderTests-575974097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:49:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1982924210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=699bd67c-3feb-4593-acb1-ce5f60206bf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47f104a86ca346f5b898eab1c4d9482a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:49:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:49:44Z,use_quota=True,user_id='70b95a27fada42e8b98b7b321e013804',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:49:43 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-bfc7b834-3c5a-4cf8-9822-48bbf5409e82 tempest-ProjectReaderTests-575974097 None] Creating volume 699bd67c-3feb-4593-acb1-ce5f60206bf1 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:49:43 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-bfc7b834-3c5a-4cf8-9822-48bbf5409e82 tempest-ProjectReaderTests-575974097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:49:43 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-bfc7b834-3c5a-4cf8-9822-48bbf5409e82 tempest-ProjectReaderTests-575974097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:49:43 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-bfc7b834-3c5a-4cf8-9822-48bbf5409e82 tempest-ProjectReaderTests-575974097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:49:43 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-bfc7b834-3c5a-4cf8-9822-48bbf5409e82 tempest-ProjectReaderTests-575974097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:49:43 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-bfc7b834-3c5a-4cf8-9822-48bbf5409e82 tempest-ProjectReaderTests-575974097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:49:43 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-bfc7b834-3c5a-4cf8-9822-48bbf5409e82 tempest-ProjectReaderTests-575974097 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:49:43 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-bfc7b834-3c5a-4cf8-9822-48bbf5409e82 tempest-ProjectReaderTests-575974097 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:49:43 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-bfc7b834-3c5a-4cf8-9822-48bbf5409e82 tempest-ProjectReaderTests-575974097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-699bd67c-3feb-4593-acb1-ce5f60206bf1 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:43 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-699bd67c-3feb-4593-acb1-ce5f60206bf1 1073741824 Nov 03 07:49:43 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:44 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-bfc7b834-3c5a-4cf8-9822-48bbf5409e82 tempest-ProjectReaderTests-575974097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-699bd67c-3feb-4593-acb1-ce5f60206bf1 1073741824" returned: 0 in 0.388s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-bfc7b834-3c5a-4cf8-9822-48bbf5409e82 tempest-ProjectReaderTests-575974097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-699bd67c-3feb-4593-acb1-ce5f60206bf1 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:44 devstack sudo[106011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-699bd67c-3feb-4593-acb1-ce5f60206bf1 Nov 03 07:49:44 devstack sudo[106011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:44 devstack sudo[106011]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-bfc7b834-3c5a-4cf8-9822-48bbf5409e82 tempest-ProjectReaderTests-575974097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-699bd67c-3feb-4593-acb1-ce5f60206bf1" returned: 0 in 0.228s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:44 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-bfc7b834-3c5a-4cf8-9822-48bbf5409e82 tempest-ProjectReaderTests-575974097 None] <== create_volume: return (653ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:49:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-bfc7b834-3c5a-4cf8-9822-48bbf5409e82 tempest-ProjectReaderTests-575974097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.656s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:49:44 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-bfc7b834-3c5a-4cf8-9822-48bbf5409e82 tempest-ProjectReaderTests-575974097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b86ad2c-0d2f-4cdd-b7e8-76477317ca21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-699bd67c-3feb-4593-acb1-ce5f60206bf1', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:44 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-bfc7b834-3c5a-4cf8-9822-48bbf5409e82 tempest-ProjectReaderTests-575974097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69f9cdc0-c1fc-422c-90ca-4bc11b2f2aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:44 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-bfc7b834-3c5a-4cf8-9822-48bbf5409e82 tempest-ProjectReaderTests-575974097 None] Volume volume-699bd67c-3feb-4593-acb1-ce5f60206bf1 (699bd67c-3feb-4593-acb1-ce5f60206bf1): created successfully Nov 03 07:49:44 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-bfc7b834-3c5a-4cf8-9822-48bbf5409e82 tempest-ProjectReaderTests-575974097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69f9cdc0-c1fc-422c-90ca-4bc11b2f2aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:44 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-bfc7b834-3c5a-4cf8-9822-48bbf5409e82 tempest-ProjectReaderTests-575974097 None] Flow 'volume_create_manager' (7b80a375-7b04-4bb8-adb3-9b5a7a22a66c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:49:44 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-bfc7b834-3c5a-4cf8-9822-48bbf5409e82 tempest-ProjectReaderTests-575974097 None] Created volume successfully. Nov 03 07:49:44 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-aba8e713-c542-4f53-a5ae-0eae14b2eece tempest-ProjectReaderTests-575974097 None] Acquiring lock "cinder-699bd67c-3feb-4593-acb1-ce5f60206bf1-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:49:44 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-aba8e713-c542-4f53-a5ae-0eae14b2eece tempest-ProjectReaderTests-575974097 None] Lock "cinder-699bd67c-3feb-4593-acb1-ce5f60206bf1-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:49:44 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-aba8e713-c542-4f53-a5ae-0eae14b2eece tempest-ProjectReaderTests-575974097 None] Acquiring lock "cinder-quobyte-699bd67c-3feb-4593-acb1-ce5f60206bf1" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:49:44 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-aba8e713-c542-4f53-a5ae-0eae14b2eece tempest-ProjectReaderTests-575974097 None] Lock "cinder-quobyte-699bd67c-3feb-4593-acb1-ce5f60206bf1" acquired by "delete_volume" :: waited 0.017s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:49:44 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29b713e-a9f1-4460-a8df-381d4ff27cf3]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:49:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-aba8e713-c542-4f53-a5ae-0eae14b2eece tempest-ProjectReaderTests-575974097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-699bd67c-3feb-4593-acb1-ce5f60206bf1 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:44 devstack sudo[106014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-699bd67c-3feb-4593-acb1-ce5f60206bf1 Nov 03 07:49:44 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:45 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-aba8e713-c542-4f53-a5ae-0eae14b2eece tempest-ProjectReaderTests-575974097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-699bd67c-3feb-4593-acb1-ce5f60206bf1" returned: 0 in 0.336s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-aba8e713-c542-4f53-a5ae-0eae14b2eece tempest-ProjectReaderTests-575974097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-699bd67c-3feb-4593-acb1-ce5f60206bf1 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:45 devstack sudo[106019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-699bd67c-3feb-4593-acb1-ce5f60206bf1 Nov 03 07:49:45 devstack sudo[106019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:45 devstack sudo[106019]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-aba8e713-c542-4f53-a5ae-0eae14b2eece tempest-ProjectReaderTests-575974097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-699bd67c-3feb-4593-acb1-ce5f60206bf1" returned: 0 in 0.240s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:45 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-aba8e713-c542-4f53-a5ae-0eae14b2eece tempest-ProjectReaderTests-575974097 None] Lock "cinder-quobyte-699bd67c-3feb-4593-acb1-ce5f60206bf1" released by "delete_volume" :: held 0.615s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:49:45 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-aba8e713-c542-4f53-a5ae-0eae14b2eece tempest-ProjectReaderTests-575974097 None] Created reservations ['60bba3a3-bc40-4b1d-8442-cb2ce3dc83b6', 'd301c996-e1c4-49fb-b7df-63579bee8170', '4c4df039-12fd-4fa0-8d75-e6678ab6e57f', '84397d43-1d37-48dc-a0b0-89c3bb1251b1'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:49:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-aba8e713-c542-4f53-a5ae-0eae14b2eece tempest-ProjectReaderTests-575974097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:49:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-aba8e713-c542-4f53-a5ae-0eae14b2eece tempest-ProjectReaderTests-575974097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:49:45 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-aba8e713-c542-4f53-a5ae-0eae14b2eece tempest-ProjectReaderTests-575974097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:49:45 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-aba8e713-c542-4f53-a5ae-0eae14b2eece tempest-ProjectReaderTests-575974097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:49:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-aba8e713-c542-4f53-a5ae-0eae14b2eece tempest-ProjectReaderTests-575974097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:49:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-aba8e713-c542-4f53-a5ae-0eae14b2eece tempest-ProjectReaderTests-575974097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:45 devstack sudo[106022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:49:45 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:45 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-aba8e713-c542-4f53-a5ae-0eae14b2eece tempest-ProjectReaderTests-575974097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.224s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:45 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-aba8e713-c542-4f53-a5ae-0eae14b2eece tempest-ProjectReaderTests-575974097 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:49:45 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-aba8e713-c542-4f53-a5ae-0eae14b2eece tempest-ProjectReaderTests-575974097 None] Deleted volume successfully. Nov 03 07:49:45 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-aba8e713-c542-4f53-a5ae-0eae14b2eece tempest-ProjectReaderTests-575974097 None] Lock "cinder-699bd67c-3feb-4593-acb1-ce5f60206bf1-delete_volume" released by "delete_volume" :: held 1.023s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:49:46 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a9b7395-3eb0-4669-8c4f-8a9ce2837f10 tempest-ProjectReaderTests-575974097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:49:46 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3a9b7395-3eb0-4669-8c4f-8a9ce2837f10 tempest-ProjectReaderTests-575974097 None] Flow 'volume_create_manager' (32986cce-7106-4b99-9e6d-0a05de2796b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:49:46 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3a9b7395-3eb0-4669-8c4f-8a9ce2837f10 tempest-ProjectReaderTests-575974097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a67355c-1b8a-433a-a29b-c1149f0871a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:46 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3a9b7395-3eb0-4669-8c4f-8a9ce2837f10 tempest-ProjectReaderTests-575974097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a67355c-1b8a-433a-a29b-c1149f0871a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1731222746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7bab641-d5bf-4e8a-88cd-f494a2a55f6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47f104a86ca346f5b898eab1c4d9482a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:49:46Z,use_quota=True,user_id='70b95a27fada42e8b98b7b321e013804',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:46 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3a9b7395-3eb0-4669-8c4f-8a9ce2837f10 tempest-ProjectReaderTests-575974097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86132cd3-1c14-4857-bb8c-18f7523e1eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:46 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3a9b7395-3eb0-4669-8c4f-8a9ce2837f10 tempest-ProjectReaderTests-575974097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86132cd3-1c14-4857-bb8c-18f7523e1eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:46 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3a9b7395-3eb0-4669-8c4f-8a9ce2837f10 tempest-ProjectReaderTests-575974097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b34ef74d-8ce3-40e8-81d7-52f02157e101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:46 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3a9b7395-3eb0-4669-8c4f-8a9ce2837f10 tempest-ProjectReaderTests-575974097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b34ef74d-8ce3-40e8-81d7-52f02157e101) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7bab641-d5bf-4e8a-88cd-f494a2a55f6f', 'volume_name': 'volume-e7bab641-d5bf-4e8a-88cd-f494a2a55f6f', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:46 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3a9b7395-3eb0-4669-8c4f-8a9ce2837f10 tempest-ProjectReaderTests-575974097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f55ad9d9-5485-4c7a-964e-485af3825ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:46 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3a9b7395-3eb0-4669-8c4f-8a9ce2837f10 tempest-ProjectReaderTests-575974097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f55ad9d9-5485-4c7a-964e-485af3825ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:46 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3a9b7395-3eb0-4669-8c4f-8a9ce2837f10 tempest-ProjectReaderTests-575974097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96c32bd3-7ee9-4e10-baec-0c8e88c31c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:46 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-3a9b7395-3eb0-4669-8c4f-8a9ce2837f10 tempest-ProjectReaderTests-575974097 None] Volume e7bab641-d5bf-4e8a-88cd-f494a2a55f6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7bab641-d5bf-4e8a-88cd-f494a2a55f6f', 'volume_size': 1} Nov 03 07:49:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3a9b7395-3eb0-4669-8c4f-8a9ce2837f10 tempest-ProjectReaderTests-575974097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:49:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3a9b7395-3eb0-4669-8c4f-8a9ce2837f10 tempest-ProjectReaderTests-575974097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:49:46 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-3a9b7395-3eb0-4669-8c4f-8a9ce2837f10 tempest-ProjectReaderTests-575974097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1731222746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7bab641-d5bf-4e8a-88cd-f494a2a55f6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47f104a86ca346f5b898eab1c4d9482a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:49:46Z,use_quota=True,user_id='70b95a27fada42e8b98b7b321e013804',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:49:46 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-3a9b7395-3eb0-4669-8c4f-8a9ce2837f10 tempest-ProjectReaderTests-575974097 None] Creating volume e7bab641-d5bf-4e8a-88cd-f494a2a55f6f {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:49:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3a9b7395-3eb0-4669-8c4f-8a9ce2837f10 tempest-ProjectReaderTests-575974097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:49:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3a9b7395-3eb0-4669-8c4f-8a9ce2837f10 tempest-ProjectReaderTests-575974097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:49:46 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-3a9b7395-3eb0-4669-8c4f-8a9ce2837f10 tempest-ProjectReaderTests-575974097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:49:46 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-3a9b7395-3eb0-4669-8c4f-8a9ce2837f10 tempest-ProjectReaderTests-575974097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:49:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3a9b7395-3eb0-4669-8c4f-8a9ce2837f10 tempest-ProjectReaderTests-575974097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:49:46 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-3a9b7395-3eb0-4669-8c4f-8a9ce2837f10 tempest-ProjectReaderTests-575974097 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:49:46 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-3a9b7395-3eb0-4669-8c4f-8a9ce2837f10 tempest-ProjectReaderTests-575974097 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:49:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3a9b7395-3eb0-4669-8c4f-8a9ce2837f10 tempest-ProjectReaderTests-575974097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e7bab641-d5bf-4e8a-88cd-f494a2a55f6f 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:46 devstack sudo[106025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e7bab641-d5bf-4e8a-88cd-f494a2a55f6f 1073741824 Nov 03 07:49:46 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:46 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3a9b7395-3eb0-4669-8c4f-8a9ce2837f10 tempest-ProjectReaderTests-575974097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e7bab641-d5bf-4e8a-88cd-f494a2a55f6f 1073741824" returned: 0 in 0.385s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3a9b7395-3eb0-4669-8c4f-8a9ce2837f10 tempest-ProjectReaderTests-575974097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e7bab641-d5bf-4e8a-88cd-f494a2a55f6f {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:46 devstack sudo[106030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e7bab641-d5bf-4e8a-88cd-f494a2a55f6f Nov 03 07:49:46 devstack sudo[106030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:47 devstack sudo[106030]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:47 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3a9b7395-3eb0-4669-8c4f-8a9ce2837f10 tempest-ProjectReaderTests-575974097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e7bab641-d5bf-4e8a-88cd-f494a2a55f6f" returned: 0 in 0.232s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:47 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-3a9b7395-3eb0-4669-8c4f-8a9ce2837f10 tempest-ProjectReaderTests-575974097 None] <== create_volume: return (655ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:49:47 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3a9b7395-3eb0-4669-8c4f-8a9ce2837f10 tempest-ProjectReaderTests-575974097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.659s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:49:47 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3a9b7395-3eb0-4669-8c4f-8a9ce2837f10 tempest-ProjectReaderTests-575974097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96c32bd3-7ee9-4e10-baec-0c8e88c31c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7bab641-d5bf-4e8a-88cd-f494a2a55f6f', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:47 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3a9b7395-3eb0-4669-8c4f-8a9ce2837f10 tempest-ProjectReaderTests-575974097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daad70ad-cc72-435d-b2bb-f673892e9f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:47 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-3a9b7395-3eb0-4669-8c4f-8a9ce2837f10 tempest-ProjectReaderTests-575974097 None] Volume volume-e7bab641-d5bf-4e8a-88cd-f494a2a55f6f (e7bab641-d5bf-4e8a-88cd-f494a2a55f6f): created successfully Nov 03 07:49:47 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3a9b7395-3eb0-4669-8c4f-8a9ce2837f10 tempest-ProjectReaderTests-575974097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daad70ad-cc72-435d-b2bb-f673892e9f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:47 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3a9b7395-3eb0-4669-8c4f-8a9ce2837f10 tempest-ProjectReaderTests-575974097 None] Flow 'volume_create_manager' (32986cce-7106-4b99-9e6d-0a05de2796b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:49:47 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-3a9b7395-3eb0-4669-8c4f-8a9ce2837f10 tempest-ProjectReaderTests-575974097 None] Created volume successfully. Nov 03 07:49:47 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a184faff-a067-46df-9ca2-c500a27c5f25 tempest-ProjectReaderTests-575974097 None] Acquiring lock "cinder-e7bab641-d5bf-4e8a-88cd-f494a2a55f6f-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:49:47 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a184faff-a067-46df-9ca2-c500a27c5f25 tempest-ProjectReaderTests-575974097 None] Lock "cinder-e7bab641-d5bf-4e8a-88cd-f494a2a55f6f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:49:47 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a184faff-a067-46df-9ca2-c500a27c5f25 tempest-ProjectReaderTests-575974097 None] Acquiring lock "cinder-quobyte-e7bab641-d5bf-4e8a-88cd-f494a2a55f6f" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:49:47 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a184faff-a067-46df-9ca2-c500a27c5f25 tempest-ProjectReaderTests-575974097 None] Lock "cinder-quobyte-e7bab641-d5bf-4e8a-88cd-f494a2a55f6f" acquired by "delete_volume" :: waited 0.014s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:49:47 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[488d005c-9ce6-4cd0-89c2-f9dae8179574]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:49:47 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a184faff-a067-46df-9ca2-c500a27c5f25 tempest-ProjectReaderTests-575974097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e7bab641-d5bf-4e8a-88cd-f494a2a55f6f {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:47 devstack sudo[106033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e7bab641-d5bf-4e8a-88cd-f494a2a55f6f Nov 03 07:49:47 devstack sudo[106033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:47 devstack sudo[106033]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:47 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a184faff-a067-46df-9ca2-c500a27c5f25 tempest-ProjectReaderTests-575974097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e7bab641-d5bf-4e8a-88cd-f494a2a55f6f" returned: 0 in 0.333s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:47 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a184faff-a067-46df-9ca2-c500a27c5f25 tempest-ProjectReaderTests-575974097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e7bab641-d5bf-4e8a-88cd-f494a2a55f6f {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:47 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e7bab641-d5bf-4e8a-88cd-f494a2a55f6f Nov 03 07:49:47 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:48 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a184faff-a067-46df-9ca2-c500a27c5f25 tempest-ProjectReaderTests-575974097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e7bab641-d5bf-4e8a-88cd-f494a2a55f6f" returned: 0 in 0.245s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:48 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a184faff-a067-46df-9ca2-c500a27c5f25 tempest-ProjectReaderTests-575974097 None] Lock "cinder-quobyte-e7bab641-d5bf-4e8a-88cd-f494a2a55f6f" released by "delete_volume" :: held 0.617s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:49:48 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-a184faff-a067-46df-9ca2-c500a27c5f25 tempest-ProjectReaderTests-575974097 None] Created reservations ['63171e68-14a8-41b3-a96c-30df9afe4c88', 'b8f50b2d-faa3-44da-8993-7ca1196c3a24', '07eb28df-fb6a-4432-a9ee-adf2363cbc46', 'f70ba3aa-c5cb-409e-b72b-504c88251eb6'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:49:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a184faff-a067-46df-9ca2-c500a27c5f25 tempest-ProjectReaderTests-575974097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:49:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a184faff-a067-46df-9ca2-c500a27c5f25 tempest-ProjectReaderTests-575974097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:49:48 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a184faff-a067-46df-9ca2-c500a27c5f25 tempest-ProjectReaderTests-575974097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:49:48 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a184faff-a067-46df-9ca2-c500a27c5f25 tempest-ProjectReaderTests-575974097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:49:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a184faff-a067-46df-9ca2-c500a27c5f25 tempest-ProjectReaderTests-575974097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:49:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a184faff-a067-46df-9ca2-c500a27c5f25 tempest-ProjectReaderTests-575974097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:48 devstack sudo[106042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:49:48 devstack sudo[106042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:48 devstack sudo[106042]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a184faff-a067-46df-9ca2-c500a27c5f25 tempest-ProjectReaderTests-575974097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.230s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:48 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-a184faff-a067-46df-9ca2-c500a27c5f25 tempest-ProjectReaderTests-575974097 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:49:48 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-a184faff-a067-46df-9ca2-c500a27c5f25 tempest-ProjectReaderTests-575974097 None] Deleted volume successfully. Nov 03 07:49:48 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a184faff-a067-46df-9ca2-c500a27c5f25 tempest-ProjectReaderTests-575974097 None] Lock "cinder-e7bab641-d5bf-4e8a-88cd-f494a2a55f6f-delete_volume" released by "delete_volume" :: held 1.043s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:49:48 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed50ddea-3896-4ed9-8c7c-4a3bbaa037b6 tempest-ProjectReaderTests-575974097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:49:48 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ed50ddea-3896-4ed9-8c7c-4a3bbaa037b6 tempest-ProjectReaderTests-575974097 None] Flow 'volume_create_manager' (cc43048f-0048-4220-8afd-4462b475d9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:49:48 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ed50ddea-3896-4ed9-8c7c-4a3bbaa037b6 tempest-ProjectReaderTests-575974097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (319523c4-5037-4e74-9188-a1859a5eeb28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:48 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ed50ddea-3896-4ed9-8c7c-4a3bbaa037b6 tempest-ProjectReaderTests-575974097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (319523c4-5037-4e74-9188-a1859a5eeb28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:49:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-20095632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8484958-abda-45c8-9739-4bf7dc68cf57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47f104a86ca346f5b898eab1c4d9482a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:49:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:49:49Z,use_quota=True,user_id='70b95a27fada42e8b98b7b321e013804',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:48 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ed50ddea-3896-4ed9-8c7c-4a3bbaa037b6 tempest-ProjectReaderTests-575974097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8420e6ce-778c-48a1-99c4-38ffa057b73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:48 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ed50ddea-3896-4ed9-8c7c-4a3bbaa037b6 tempest-ProjectReaderTests-575974097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8420e6ce-778c-48a1-99c4-38ffa057b73f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:48 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ed50ddea-3896-4ed9-8c7c-4a3bbaa037b6 tempest-ProjectReaderTests-575974097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fee4fba1-4c17-4c83-8cad-ab0c3cc96b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:48 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ed50ddea-3896-4ed9-8c7c-4a3bbaa037b6 tempest-ProjectReaderTests-575974097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fee4fba1-4c17-4c83-8cad-ab0c3cc96b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8484958-abda-45c8-9739-4bf7dc68cf57', 'volume_name': 'volume-d8484958-abda-45c8-9739-4bf7dc68cf57', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:49 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ed50ddea-3896-4ed9-8c7c-4a3bbaa037b6 tempest-ProjectReaderTests-575974097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c29a5e90-d638-4d0a-85fd-24eeecefaaf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:49 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ed50ddea-3896-4ed9-8c7c-4a3bbaa037b6 tempest-ProjectReaderTests-575974097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c29a5e90-d638-4d0a-85fd-24eeecefaaf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:49 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ed50ddea-3896-4ed9-8c7c-4a3bbaa037b6 tempest-ProjectReaderTests-575974097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af802a3d-90f8-4288-a391-9b0b52dd062b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:49 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-ed50ddea-3896-4ed9-8c7c-4a3bbaa037b6 tempest-ProjectReaderTests-575974097 None] Volume d8484958-abda-45c8-9739-4bf7dc68cf57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8484958-abda-45c8-9739-4bf7dc68cf57', 'volume_size': 1} Nov 03 07:49:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-ed50ddea-3896-4ed9-8c7c-4a3bbaa037b6 tempest-ProjectReaderTests-575974097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:49:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-ed50ddea-3896-4ed9-8c7c-4a3bbaa037b6 tempest-ProjectReaderTests-575974097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:49:49 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-ed50ddea-3896-4ed9-8c7c-4a3bbaa037b6 tempest-ProjectReaderTests-575974097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:49:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-20095632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8484958-abda-45c8-9739-4bf7dc68cf57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47f104a86ca346f5b898eab1c4d9482a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:49:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:49:49Z,use_quota=True,user_id='70b95a27fada42e8b98b7b321e013804',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:49:49 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-ed50ddea-3896-4ed9-8c7c-4a3bbaa037b6 tempest-ProjectReaderTests-575974097 None] Creating volume d8484958-abda-45c8-9739-4bf7dc68cf57 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:49:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-ed50ddea-3896-4ed9-8c7c-4a3bbaa037b6 tempest-ProjectReaderTests-575974097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:49:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-ed50ddea-3896-4ed9-8c7c-4a3bbaa037b6 tempest-ProjectReaderTests-575974097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:49:49 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-ed50ddea-3896-4ed9-8c7c-4a3bbaa037b6 tempest-ProjectReaderTests-575974097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:49:49 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-ed50ddea-3896-4ed9-8c7c-4a3bbaa037b6 tempest-ProjectReaderTests-575974097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:49:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-ed50ddea-3896-4ed9-8c7c-4a3bbaa037b6 tempest-ProjectReaderTests-575974097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:49:49 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-ed50ddea-3896-4ed9-8c7c-4a3bbaa037b6 tempest-ProjectReaderTests-575974097 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:49:49 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-ed50ddea-3896-4ed9-8c7c-4a3bbaa037b6 tempest-ProjectReaderTests-575974097 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:49:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ed50ddea-3896-4ed9-8c7c-4a3bbaa037b6 tempest-ProjectReaderTests-575974097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d8484958-abda-45c8-9739-4bf7dc68cf57 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:49 devstack sudo[106045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d8484958-abda-45c8-9739-4bf7dc68cf57 1073741824 Nov 03 07:49:49 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:49 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ed50ddea-3896-4ed9-8c7c-4a3bbaa037b6 tempest-ProjectReaderTests-575974097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d8484958-abda-45c8-9739-4bf7dc68cf57 1073741824" returned: 0 in 0.382s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ed50ddea-3896-4ed9-8c7c-4a3bbaa037b6 tempest-ProjectReaderTests-575974097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d8484958-abda-45c8-9739-4bf7dc68cf57 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:49 devstack sudo[106050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d8484958-abda-45c8-9739-4bf7dc68cf57 Nov 03 07:49:49 devstack sudo[106050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:49 devstack sudo[106050]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ed50ddea-3896-4ed9-8c7c-4a3bbaa037b6 tempest-ProjectReaderTests-575974097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d8484958-abda-45c8-9739-4bf7dc68cf57" returned: 0 in 0.232s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:49 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-ed50ddea-3896-4ed9-8c7c-4a3bbaa037b6 tempest-ProjectReaderTests-575974097 None] <== create_volume: return (650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:49:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-ed50ddea-3896-4ed9-8c7c-4a3bbaa037b6 tempest-ProjectReaderTests-575974097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.653s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:49:49 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ed50ddea-3896-4ed9-8c7c-4a3bbaa037b6 tempest-ProjectReaderTests-575974097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af802a3d-90f8-4288-a391-9b0b52dd062b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8484958-abda-45c8-9739-4bf7dc68cf57', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:49 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ed50ddea-3896-4ed9-8c7c-4a3bbaa037b6 tempest-ProjectReaderTests-575974097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (122a4616-c620-4ebd-b341-d9e8410e15c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:49 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-ed50ddea-3896-4ed9-8c7c-4a3bbaa037b6 tempest-ProjectReaderTests-575974097 None] Volume volume-d8484958-abda-45c8-9739-4bf7dc68cf57 (d8484958-abda-45c8-9739-4bf7dc68cf57): created successfully Nov 03 07:49:49 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ed50ddea-3896-4ed9-8c7c-4a3bbaa037b6 tempest-ProjectReaderTests-575974097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (122a4616-c620-4ebd-b341-d9e8410e15c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:49 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ed50ddea-3896-4ed9-8c7c-4a3bbaa037b6 tempest-ProjectReaderTests-575974097 None] Flow 'volume_create_manager' (cc43048f-0048-4220-8afd-4462b475d9e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:49:49 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-ed50ddea-3896-4ed9-8c7c-4a3bbaa037b6 tempest-ProjectReaderTests-575974097 None] Created volume successfully. Nov 03 07:49:49 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-952a620d-8c55-4ff7-b518-37b68ae3171d tempest-ProjectReaderTests-575974097 None] Acquiring lock "cinder-d8484958-abda-45c8-9739-4bf7dc68cf57-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:49:50 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-952a620d-8c55-4ff7-b518-37b68ae3171d tempest-ProjectReaderTests-575974097 None] Lock "cinder-d8484958-abda-45c8-9739-4bf7dc68cf57-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:49:50 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-952a620d-8c55-4ff7-b518-37b68ae3171d tempest-ProjectReaderTests-575974097 None] Acquiring lock "cinder-quobyte-d8484958-abda-45c8-9739-4bf7dc68cf57" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:49:50 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-952a620d-8c55-4ff7-b518-37b68ae3171d tempest-ProjectReaderTests-575974097 None] Lock "cinder-quobyte-d8484958-abda-45c8-9739-4bf7dc68cf57" acquired by "delete_volume" :: waited 0.013s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:49:50 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e26e78-270f-4d2d-9705-3a60475bbbbf]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:49:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-952a620d-8c55-4ff7-b518-37b68ae3171d tempest-ProjectReaderTests-575974097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d8484958-abda-45c8-9739-4bf7dc68cf57 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:50 devstack sudo[106053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d8484958-abda-45c8-9739-4bf7dc68cf57 Nov 03 07:49:50 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:50 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-952a620d-8c55-4ff7-b518-37b68ae3171d tempest-ProjectReaderTests-575974097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d8484958-abda-45c8-9739-4bf7dc68cf57" returned: 0 in 0.336s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-952a620d-8c55-4ff7-b518-37b68ae3171d tempest-ProjectReaderTests-575974097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d8484958-abda-45c8-9739-4bf7dc68cf57 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:50 devstack sudo[106059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d8484958-abda-45c8-9739-4bf7dc68cf57 Nov 03 07:49:50 devstack sudo[106059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:50 devstack sudo[106059]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-952a620d-8c55-4ff7-b518-37b68ae3171d tempest-ProjectReaderTests-575974097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d8484958-abda-45c8-9739-4bf7dc68cf57" returned: 0 in 0.233s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:50 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-952a620d-8c55-4ff7-b518-37b68ae3171d tempest-ProjectReaderTests-575974097 None] Lock "cinder-quobyte-d8484958-abda-45c8-9739-4bf7dc68cf57" released by "delete_volume" :: held 0.608s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:49:50 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-952a620d-8c55-4ff7-b518-37b68ae3171d tempest-ProjectReaderTests-575974097 None] Created reservations ['20318718-0593-4e21-af6d-ba316d4e262e', '0209c241-dc09-4b61-a2fc-b0c6780d02cc', 'b90e0a34-7646-4279-8484-596421807f38', 'd6b529c4-1d45-4e60-aee5-30d884a7ccda'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:49:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-952a620d-8c55-4ff7-b518-37b68ae3171d tempest-ProjectReaderTests-575974097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:49:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-952a620d-8c55-4ff7-b518-37b68ae3171d tempest-ProjectReaderTests-575974097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:49:50 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-952a620d-8c55-4ff7-b518-37b68ae3171d tempest-ProjectReaderTests-575974097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:49:50 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-952a620d-8c55-4ff7-b518-37b68ae3171d tempest-ProjectReaderTests-575974097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:49:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-952a620d-8c55-4ff7-b518-37b68ae3171d tempest-ProjectReaderTests-575974097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:49:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-952a620d-8c55-4ff7-b518-37b68ae3171d tempest-ProjectReaderTests-575974097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:50 devstack sudo[106062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:49:50 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:50 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-952a620d-8c55-4ff7-b518-37b68ae3171d tempest-ProjectReaderTests-575974097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.233s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:51 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-952a620d-8c55-4ff7-b518-37b68ae3171d tempest-ProjectReaderTests-575974097 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:49:51 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-952a620d-8c55-4ff7-b518-37b68ae3171d tempest-ProjectReaderTests-575974097 None] Deleted volume successfully. Nov 03 07:49:51 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-952a620d-8c55-4ff7-b518-37b68ae3171d tempest-ProjectReaderTests-575974097 None] Lock "cinder-d8484958-abda-45c8-9739-4bf7dc68cf57-delete_volume" released by "delete_volume" :: held 1.019s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:49:51 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-02937d9b-ae92-4b2e-a749-0cb7c03242cb tempest-ProjectReaderTests-575974097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:49:51 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-02937d9b-ae92-4b2e-a749-0cb7c03242cb tempest-ProjectReaderTests-575974097 None] Flow 'volume_create_manager' (ea63905c-793d-4f61-901e-3570e15aa75e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:49:51 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-02937d9b-ae92-4b2e-a749-0cb7c03242cb tempest-ProjectReaderTests-575974097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fa91647-f7a7-4e80-99df-57fc6acc58e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:51 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-02937d9b-ae92-4b2e-a749-0cb7c03242cb tempest-ProjectReaderTests-575974097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fa91647-f7a7-4e80-99df-57fc6acc58e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:49:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1728653319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ae86501-be19-425a-8da9-2ae2159cefbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47f104a86ca346f5b898eab1c4d9482a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:49:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:49:52Z,use_quota=True,user_id='70b95a27fada42e8b98b7b321e013804',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:51 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-02937d9b-ae92-4b2e-a749-0cb7c03242cb tempest-ProjectReaderTests-575974097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7de42792-9c3c-4fef-af61-955af9959c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:51 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-02937d9b-ae92-4b2e-a749-0cb7c03242cb tempest-ProjectReaderTests-575974097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7de42792-9c3c-4fef-af61-955af9959c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:51 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-02937d9b-ae92-4b2e-a749-0cb7c03242cb tempest-ProjectReaderTests-575974097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72bc305c-6e22-46b3-8207-f20182d19104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:51 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-02937d9b-ae92-4b2e-a749-0cb7c03242cb tempest-ProjectReaderTests-575974097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72bc305c-6e22-46b3-8207-f20182d19104) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ae86501-be19-425a-8da9-2ae2159cefbb', 'volume_name': 'volume-6ae86501-be19-425a-8da9-2ae2159cefbb', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:51 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-02937d9b-ae92-4b2e-a749-0cb7c03242cb tempest-ProjectReaderTests-575974097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd003989-0d57-48bd-a100-eeca1d2ea0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:51 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-02937d9b-ae92-4b2e-a749-0cb7c03242cb tempest-ProjectReaderTests-575974097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd003989-0d57-48bd-a100-eeca1d2ea0b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:51 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-02937d9b-ae92-4b2e-a749-0cb7c03242cb tempest-ProjectReaderTests-575974097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7c8d474-0342-4bc9-94ef-77f3b7938a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:51 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-02937d9b-ae92-4b2e-a749-0cb7c03242cb tempest-ProjectReaderTests-575974097 None] Volume 6ae86501-be19-425a-8da9-2ae2159cefbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ae86501-be19-425a-8da9-2ae2159cefbb', 'volume_size': 1} Nov 03 07:49:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-02937d9b-ae92-4b2e-a749-0cb7c03242cb tempest-ProjectReaderTests-575974097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:49:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-02937d9b-ae92-4b2e-a749-0cb7c03242cb tempest-ProjectReaderTests-575974097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:49:51 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-02937d9b-ae92-4b2e-a749-0cb7c03242cb tempest-ProjectReaderTests-575974097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:49:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1728653319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ae86501-be19-425a-8da9-2ae2159cefbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47f104a86ca346f5b898eab1c4d9482a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:49:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:49:52Z,use_quota=True,user_id='70b95a27fada42e8b98b7b321e013804',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:49:51 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-02937d9b-ae92-4b2e-a749-0cb7c03242cb tempest-ProjectReaderTests-575974097 None] Creating volume 6ae86501-be19-425a-8da9-2ae2159cefbb {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:49:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-02937d9b-ae92-4b2e-a749-0cb7c03242cb tempest-ProjectReaderTests-575974097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:49:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-02937d9b-ae92-4b2e-a749-0cb7c03242cb tempest-ProjectReaderTests-575974097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:49:51 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-02937d9b-ae92-4b2e-a749-0cb7c03242cb tempest-ProjectReaderTests-575974097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:49:51 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-02937d9b-ae92-4b2e-a749-0cb7c03242cb tempest-ProjectReaderTests-575974097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:49:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-02937d9b-ae92-4b2e-a749-0cb7c03242cb tempest-ProjectReaderTests-575974097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:49:51 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-02937d9b-ae92-4b2e-a749-0cb7c03242cb tempest-ProjectReaderTests-575974097 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:49:51 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-02937d9b-ae92-4b2e-a749-0cb7c03242cb tempest-ProjectReaderTests-575974097 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:49:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-02937d9b-ae92-4b2e-a749-0cb7c03242cb tempest-ProjectReaderTests-575974097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6ae86501-be19-425a-8da9-2ae2159cefbb 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:51 devstack sudo[106065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6ae86501-be19-425a-8da9-2ae2159cefbb 1073741824 Nov 03 07:49:51 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:52 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-02937d9b-ae92-4b2e-a749-0cb7c03242cb tempest-ProjectReaderTests-575974097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6ae86501-be19-425a-8da9-2ae2159cefbb 1073741824" returned: 0 in 0.389s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-02937d9b-ae92-4b2e-a749-0cb7c03242cb tempest-ProjectReaderTests-575974097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6ae86501-be19-425a-8da9-2ae2159cefbb {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:52 devstack sudo[106070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6ae86501-be19-425a-8da9-2ae2159cefbb Nov 03 07:49:52 devstack sudo[106070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:52 devstack sudo[106070]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-02937d9b-ae92-4b2e-a749-0cb7c03242cb tempest-ProjectReaderTests-575974097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6ae86501-be19-425a-8da9-2ae2159cefbb" returned: 0 in 0.229s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:52 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-02937d9b-ae92-4b2e-a749-0cb7c03242cb tempest-ProjectReaderTests-575974097 None] <== create_volume: return (654ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:49:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-02937d9b-ae92-4b2e-a749-0cb7c03242cb tempest-ProjectReaderTests-575974097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.656s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:49:52 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-02937d9b-ae92-4b2e-a749-0cb7c03242cb tempest-ProjectReaderTests-575974097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7c8d474-0342-4bc9-94ef-77f3b7938a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ae86501-be19-425a-8da9-2ae2159cefbb', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:52 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-02937d9b-ae92-4b2e-a749-0cb7c03242cb tempest-ProjectReaderTests-575974097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56976d4a-784c-4f88-8864-168c3f91cac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:49:52 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-02937d9b-ae92-4b2e-a749-0cb7c03242cb tempest-ProjectReaderTests-575974097 None] Volume volume-6ae86501-be19-425a-8da9-2ae2159cefbb (6ae86501-be19-425a-8da9-2ae2159cefbb): created successfully Nov 03 07:49:52 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-02937d9b-ae92-4b2e-a749-0cb7c03242cb tempest-ProjectReaderTests-575974097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56976d4a-784c-4f88-8864-168c3f91cac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:49:52 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-02937d9b-ae92-4b2e-a749-0cb7c03242cb tempest-ProjectReaderTests-575974097 None] Flow 'volume_create_manager' (ea63905c-793d-4f61-901e-3570e15aa75e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:49:52 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-02937d9b-ae92-4b2e-a749-0cb7c03242cb tempest-ProjectReaderTests-575974097 None] Created volume successfully. Nov 03 07:49:52 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-4aded0ef-409a-44f9-8b22-3f81daf33083 tempest-ProjectReaderTests-575974097 None] Acquiring lock "cinder-6ae86501-be19-425a-8da9-2ae2159cefbb-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:49:52 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-4aded0ef-409a-44f9-8b22-3f81daf33083 tempest-ProjectReaderTests-575974097 None] Lock "cinder-6ae86501-be19-425a-8da9-2ae2159cefbb-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:49:52 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-4aded0ef-409a-44f9-8b22-3f81daf33083 tempest-ProjectReaderTests-575974097 None] Acquiring lock "cinder-quobyte-6ae86501-be19-425a-8da9-2ae2159cefbb" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:49:52 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-4aded0ef-409a-44f9-8b22-3f81daf33083 tempest-ProjectReaderTests-575974097 None] Lock "cinder-quobyte-6ae86501-be19-425a-8da9-2ae2159cefbb" acquired by "delete_volume" :: waited 0.013s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:49:52 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80a4bb2-0c8f-44f4-b03c-2ca2f3553c00]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:49:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4aded0ef-409a-44f9-8b22-3f81daf33083 tempest-ProjectReaderTests-575974097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6ae86501-be19-425a-8da9-2ae2159cefbb {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:52 devstack sudo[106073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6ae86501-be19-425a-8da9-2ae2159cefbb Nov 03 07:49:52 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:53 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4aded0ef-409a-44f9-8b22-3f81daf33083 tempest-ProjectReaderTests-575974097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6ae86501-be19-425a-8da9-2ae2159cefbb" returned: 0 in 0.335s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4aded0ef-409a-44f9-8b22-3f81daf33083 tempest-ProjectReaderTests-575974097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6ae86501-be19-425a-8da9-2ae2159cefbb {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:53 devstack sudo[106078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6ae86501-be19-425a-8da9-2ae2159cefbb Nov 03 07:49:53 devstack sudo[106078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:53 devstack sudo[106078]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4aded0ef-409a-44f9-8b22-3f81daf33083 tempest-ProjectReaderTests-575974097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6ae86501-be19-425a-8da9-2ae2159cefbb" returned: 0 in 0.244s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:53 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-4aded0ef-409a-44f9-8b22-3f81daf33083 tempest-ProjectReaderTests-575974097 None] Lock "cinder-quobyte-6ae86501-be19-425a-8da9-2ae2159cefbb" released by "delete_volume" :: held 0.622s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:49:53 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-4aded0ef-409a-44f9-8b22-3f81daf33083 tempest-ProjectReaderTests-575974097 None] Created reservations ['1bb741ec-8ab5-42fd-89d9-615e88dcd936', '1eadaeea-3a84-41b4-a5d4-f1a120d36bc6', '991401b8-7001-44e7-a900-8127f68b99a2', '4c739520-5a31-4865-855d-2297786c61cd'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:49:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-4aded0ef-409a-44f9-8b22-3f81daf33083 tempest-ProjectReaderTests-575974097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:49:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-4aded0ef-409a-44f9-8b22-3f81daf33083 tempest-ProjectReaderTests-575974097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:49:53 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-4aded0ef-409a-44f9-8b22-3f81daf33083 tempest-ProjectReaderTests-575974097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:49:53 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-4aded0ef-409a-44f9-8b22-3f81daf33083 tempest-ProjectReaderTests-575974097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:49:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-4aded0ef-409a-44f9-8b22-3f81daf33083 tempest-ProjectReaderTests-575974097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:49:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4aded0ef-409a-44f9-8b22-3f81daf33083 tempest-ProjectReaderTests-575974097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:49:53 devstack sudo[106081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:49:53 devstack sudo[106081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:49:53 devstack sudo[106081]: pam_unix(sudo:session): session closed for user root Nov 03 07:49:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4aded0ef-409a-44f9-8b22-3f81daf33083 tempest-ProjectReaderTests-575974097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.227s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:49:53 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-4aded0ef-409a-44f9-8b22-3f81daf33083 tempest-ProjectReaderTests-575974097 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:49:53 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-4aded0ef-409a-44f9-8b22-3f81daf33083 tempest-ProjectReaderTests-575974097 None] Deleted volume successfully. Nov 03 07:49:53 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-4aded0ef-409a-44f9-8b22-3f81daf33083 tempest-ProjectReaderTests-575974097 None] Lock "cinder-6ae86501-be19-425a-8da9-2ae2159cefbb-delete_volume" released by "delete_volume" :: held 1.054s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:03 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:UPDATE=81,cinder:SELECT=50,cinder:INSERT=21,cinder:DELETE=7 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:50:03 devstack cinder-volume[86875]: DEBUG oslo_service.periodic_task [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86875) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:50:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:03 devstack sudo[106121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:50:03 devstack sudo[106121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:03 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:SELECT=60,cinder:INSERT=24,cinder:UPDATE=76,cinder:DELETE=7 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:50:03 devstack sudo[106121]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.282s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:03 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:50:03 devstack cinder-volume[86875]: DEBUG oslo_service.periodic_task [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running periodic task VolumeManager._thread_info {{(pid=86875) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:50:03 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] thread count: 28 {{(pid=86875) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:50:03 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] thread info: [<_MainThread(MainThread, started 125626325639296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86875) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:50:05 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-995acb8d-fce1-47d2-8e48-cf0321e8a805 tempest-CreateVolumesFromImageTest-1888949505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:50:05 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-995acb8d-fce1-47d2-8e48-cf0321e8a805 tempest-CreateVolumesFromImageTest-1888949505 None] Flow 'volume_create_manager' (28f7ffbe-4b15-4d86-a0c6-1ca60e745278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:05 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-995acb8d-fce1-47d2-8e48-cf0321e8a805 tempest-CreateVolumesFromImageTest-1888949505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccbbd106-8d87-4751-994e-f3aa6667fdf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:05 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-995acb8d-fce1-47d2-8e48-cf0321e8a805 tempest-CreateVolumesFromImageTest-1888949505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccbbd106-8d87-4751-994e-f3aa6667fdf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1289834607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f134d2c2-b3d6-452e-b104-68baae4eef1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c8f1dc58d2641ab8961f2ecc5e600fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:05Z,use_quota=True,user_id='2e559c1d88dc4dec8b5e76aa30037518',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:05 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-995acb8d-fce1-47d2-8e48-cf0321e8a805 tempest-CreateVolumesFromImageTest-1888949505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5673369f-dafa-4c2a-8b06-1a96d6b99b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:05 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-995acb8d-fce1-47d2-8e48-cf0321e8a805 tempest-CreateVolumesFromImageTest-1888949505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5673369f-dafa-4c2a-8b06-1a96d6b99b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:05 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-995acb8d-fce1-47d2-8e48-cf0321e8a805 tempest-CreateVolumesFromImageTest-1888949505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cce44858-d7ef-4991-b9c7-ebdae93a07de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:05 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-995acb8d-fce1-47d2-8e48-cf0321e8a805 tempest-CreateVolumesFromImageTest-1888949505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cce44858-d7ef-4991-b9c7-ebdae93a07de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f134d2c2-b3d6-452e-b104-68baae4eef1e', 'volume_name': 'volume-f134d2c2-b3d6-452e-b104-68baae4eef1e', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:05 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-995acb8d-fce1-47d2-8e48-cf0321e8a805 tempest-CreateVolumesFromImageTest-1888949505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9c85a75-f6f4-4ff4-a647-d82ee28a740e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:05 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-995acb8d-fce1-47d2-8e48-cf0321e8a805 tempest-CreateVolumesFromImageTest-1888949505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9c85a75-f6f4-4ff4-a647-d82ee28a740e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:05 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-995acb8d-fce1-47d2-8e48-cf0321e8a805 tempest-CreateVolumesFromImageTest-1888949505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daa267d4-b5ac-4c17-a343-a4c49c72113f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:05 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-995acb8d-fce1-47d2-8e48-cf0321e8a805 tempest-CreateVolumesFromImageTest-1888949505 None] Volume f134d2c2-b3d6-452e-b104-68baae4eef1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f134d2c2-b3d6-452e-b104-68baae4eef1e', 'volume_size': 1} Nov 03 07:50:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-995acb8d-fce1-47d2-8e48-cf0321e8a805 tempest-CreateVolumesFromImageTest-1888949505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-995acb8d-fce1-47d2-8e48-cf0321e8a805 tempest-CreateVolumesFromImageTest-1888949505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:05 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-995acb8d-fce1-47d2-8e48-cf0321e8a805 tempest-CreateVolumesFromImageTest-1888949505 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1289834607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f134d2c2-b3d6-452e-b104-68baae4eef1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c8f1dc58d2641ab8961f2ecc5e600fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:05Z,use_quota=True,user_id='2e559c1d88dc4dec8b5e76aa30037518',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:50:05 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-995acb8d-fce1-47d2-8e48-cf0321e8a805 tempest-CreateVolumesFromImageTest-1888949505 None] Creating volume f134d2c2-b3d6-452e-b104-68baae4eef1e {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:50:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-995acb8d-fce1-47d2-8e48-cf0321e8a805 tempest-CreateVolumesFromImageTest-1888949505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-995acb8d-fce1-47d2-8e48-cf0321e8a805 tempest-CreateVolumesFromImageTest-1888949505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:05 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-995acb8d-fce1-47d2-8e48-cf0321e8a805 tempest-CreateVolumesFromImageTest-1888949505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:05 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-995acb8d-fce1-47d2-8e48-cf0321e8a805 tempest-CreateVolumesFromImageTest-1888949505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-995acb8d-fce1-47d2-8e48-cf0321e8a805 tempest-CreateVolumesFromImageTest-1888949505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:05 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-995acb8d-fce1-47d2-8e48-cf0321e8a805 tempest-CreateVolumesFromImageTest-1888949505 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:50:05 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-995acb8d-fce1-47d2-8e48-cf0321e8a805 tempest-CreateVolumesFromImageTest-1888949505 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:50:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-995acb8d-fce1-47d2-8e48-cf0321e8a805 tempest-CreateVolumesFromImageTest-1888949505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f134d2c2-b3d6-452e-b104-68baae4eef1e 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:05 devstack sudo[106124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f134d2c2-b3d6-452e-b104-68baae4eef1e 1073741824 Nov 03 07:50:05 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:05 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-68fd5d9e-4e7a-45eb-923f-0dd191aafedd tempest-VolumeDependencyTests-1969615490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:50:05 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-68fd5d9e-4e7a-45eb-923f-0dd191aafedd tempest-VolumeDependencyTests-1969615490 None] Flow 'volume_create_manager' (bf299131-7b1e-40b9-bd40-fb74a32284fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:05 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-68fd5d9e-4e7a-45eb-923f-0dd191aafedd tempest-VolumeDependencyTests-1969615490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3b93216-f8c5-4ae7-aa13-31d510f8d5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-68fd5d9e-4e7a-45eb-923f-0dd191aafedd tempest-VolumeDependencyTests-1969615490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3b93216-f8c5-4ae7-aa13-31d510f8d5a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-329493031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff15a29f-c8df-4880-9a2b-43e4537ea992,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd4ee36b54e441718771f50f7070f351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:06Z,use_quota=True,user_id='f74c78eb3f3247e0a95fabfbb8c90818',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-68fd5d9e-4e7a-45eb-923f-0dd191aafedd tempest-VolumeDependencyTests-1969615490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a8b807b-7166-4c6f-827e-1c7239cc1b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-68fd5d9e-4e7a-45eb-923f-0dd191aafedd tempest-VolumeDependencyTests-1969615490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a8b807b-7166-4c6f-827e-1c7239cc1b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-68fd5d9e-4e7a-45eb-923f-0dd191aafedd tempest-VolumeDependencyTests-1969615490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d847573c-77a8-4cca-aeda-934c1a145268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:06 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-68fd5d9e-4e7a-45eb-923f-0dd191aafedd tempest-VolumeDependencyTests-1969615490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d847573c-77a8-4cca-aeda-934c1a145268) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff15a29f-c8df-4880-9a2b-43e4537ea992', 'volume_name': 'volume-ff15a29f-c8df-4880-9a2b-43e4537ea992', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-68fd5d9e-4e7a-45eb-923f-0dd191aafedd tempest-VolumeDependencyTests-1969615490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d155db5a-8a1c-4c18-a206-ba503ca9cd8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-68fd5d9e-4e7a-45eb-923f-0dd191aafedd tempest-VolumeDependencyTests-1969615490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d155db5a-8a1c-4c18-a206-ba503ca9cd8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-68fd5d9e-4e7a-45eb-923f-0dd191aafedd tempest-VolumeDependencyTests-1969615490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c84a3a9-7afd-4bdf-ad39-817f892e4370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:06 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-68fd5d9e-4e7a-45eb-923f-0dd191aafedd tempest-VolumeDependencyTests-1969615490 None] Volume ff15a29f-c8df-4880-9a2b-43e4537ea992: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff15a29f-c8df-4880-9a2b-43e4537ea992', 'volume_size': 1} Nov 03 07:50:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-68fd5d9e-4e7a-45eb-923f-0dd191aafedd tempest-VolumeDependencyTests-1969615490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-995acb8d-fce1-47d2-8e48-cf0321e8a805 tempest-CreateVolumesFromImageTest-1888949505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f134d2c2-b3d6-452e-b104-68baae4eef1e 1073741824" returned: 0 in 0.604s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:06 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-55d9450a-c71c-47e3-a422-eb3fb7a58f4b tempest-CreateVolumesFromImageTest-1888949505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:50:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-55d9450a-c71c-47e3-a422-eb3fb7a58f4b tempest-CreateVolumesFromImageTest-1888949505 None] Flow 'volume_create_manager' (d74998a5-fc40-4c86-9145-1327e5bb8e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-55d9450a-c71c-47e3-a422-eb3fb7a58f4b tempest-CreateVolumesFromImageTest-1888949505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85ef701e-ed62-4aa4-937d-bc155e58dc03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-55d9450a-c71c-47e3-a422-eb3fb7a58f4b tempest-CreateVolumesFromImageTest-1888949505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85ef701e-ed62-4aa4-937d-bc155e58dc03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1006469680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99ff2d8b-d460-49a5-8870-b3cb303f4757,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c8f1dc58d2641ab8961f2ecc5e600fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:06Z,use_quota=True,user_id='2e559c1d88dc4dec8b5e76aa30037518',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-55d9450a-c71c-47e3-a422-eb3fb7a58f4b tempest-CreateVolumesFromImageTest-1888949505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44de243c-54cf-4d71-8bf6-bdd8eb640fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-55d9450a-c71c-47e3-a422-eb3fb7a58f4b tempest-CreateVolumesFromImageTest-1888949505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44de243c-54cf-4d71-8bf6-bdd8eb640fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-55d9450a-c71c-47e3-a422-eb3fb7a58f4b tempest-CreateVolumesFromImageTest-1888949505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc358bd3-d592-4cf3-b386-30c68e458a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-55d9450a-c71c-47e3-a422-eb3fb7a58f4b tempest-CreateVolumesFromImageTest-1888949505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc358bd3-d592-4cf3-b386-30c68e458a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99ff2d8b-d460-49a5-8870-b3cb303f4757', 'volume_name': 'volume-99ff2d8b-d460-49a5-8870-b3cb303f4757', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-55d9450a-c71c-47e3-a422-eb3fb7a58f4b tempest-CreateVolumesFromImageTest-1888949505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (338b57b5-d27d-4213-91d9-44db936320b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-55d9450a-c71c-47e3-a422-eb3fb7a58f4b tempest-CreateVolumesFromImageTest-1888949505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (338b57b5-d27d-4213-91d9-44db936320b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-55d9450a-c71c-47e3-a422-eb3fb7a58f4b tempest-CreateVolumesFromImageTest-1888949505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e9a5cd2-1023-4623-9b58-c5de819e5db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:06 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-55d9450a-c71c-47e3-a422-eb3fb7a58f4b tempest-CreateVolumesFromImageTest-1888949505 None] Volume 99ff2d8b-d460-49a5-8870-b3cb303f4757: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99ff2d8b-d460-49a5-8870-b3cb303f4757', 'volume_size': 1} Nov 03 07:50:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-55d9450a-c71c-47e3-a422-eb3fb7a58f4b tempest-CreateVolumesFromImageTest-1888949505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-995acb8d-fce1-47d2-8e48-cf0321e8a805 tempest-CreateVolumesFromImageTest-1888949505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f134d2c2-b3d6-452e-b104-68baae4eef1e {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d0258a98-e10d-48a6-bd70-ca84a764bb33 tempest-ProjectAdminTests-610618047 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6651611328125, 'free_capacity_gb': 1773.6651611328125, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86875) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 03 07:50:06 devstack sudo[106132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f134d2c2-b3d6-452e-b104-68baae4eef1e Nov 03 07:50:06 devstack sudo[106132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:06 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ba75dc5-cdb3-4b27-98e2-3a9f9debcd54 tempest-CreateVolumesFromImageTest-1888949505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:50:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3ba75dc5-cdb3-4b27-98e2-3a9f9debcd54 tempest-CreateVolumesFromImageTest-1888949505 None] Flow 'volume_create_manager' (c412b755-75d1-47e7-b02f-86413c0bf37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3ba75dc5-cdb3-4b27-98e2-3a9f9debcd54 tempest-CreateVolumesFromImageTest-1888949505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dea4c6b5-2a98-4775-9e6e-ad11070de824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3ba75dc5-cdb3-4b27-98e2-3a9f9debcd54 tempest-CreateVolumesFromImageTest-1888949505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dea4c6b5-2a98-4775-9e6e-ad11070de824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1300267779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68190f86-b62c-4831-9353-9eff6dcc371e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c8f1dc58d2641ab8961f2ecc5e600fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:06Z,use_quota=True,user_id='2e559c1d88dc4dec8b5e76aa30037518',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3ba75dc5-cdb3-4b27-98e2-3a9f9debcd54 tempest-CreateVolumesFromImageTest-1888949505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5eb89d7-dd1f-4e3d-8854-4045ce240820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3ba75dc5-cdb3-4b27-98e2-3a9f9debcd54 tempest-CreateVolumesFromImageTest-1888949505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5eb89d7-dd1f-4e3d-8854-4045ce240820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3ba75dc5-cdb3-4b27-98e2-3a9f9debcd54 tempest-CreateVolumesFromImageTest-1888949505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a436f333-20e6-4628-9a26-92dcc02bdd5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3ba75dc5-cdb3-4b27-98e2-3a9f9debcd54 tempest-CreateVolumesFromImageTest-1888949505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a436f333-20e6-4628-9a26-92dcc02bdd5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68190f86-b62c-4831-9353-9eff6dcc371e', 'volume_name': 'volume-68190f86-b62c-4831-9353-9eff6dcc371e', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3ba75dc5-cdb3-4b27-98e2-3a9f9debcd54 tempest-CreateVolumesFromImageTest-1888949505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4c09989-d8e9-4e70-82c9-9d1f4d88063c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3ba75dc5-cdb3-4b27-98e2-3a9f9debcd54 tempest-CreateVolumesFromImageTest-1888949505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4c09989-d8e9-4e70-82c9-9d1f4d88063c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3ba75dc5-cdb3-4b27-98e2-3a9f9debcd54 tempest-CreateVolumesFromImageTest-1888949505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7743222d-9d2a-488b-846a-47de8e2dab09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:06 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-3ba75dc5-cdb3-4b27-98e2-3a9f9debcd54 tempest-CreateVolumesFromImageTest-1888949505 None] Volume 68190f86-b62c-4831-9353-9eff6dcc371e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68190f86-b62c-4831-9353-9eff6dcc371e', 'volume_size': 1} Nov 03 07:50:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3ba75dc5-cdb3-4b27-98e2-3a9f9debcd54 tempest-CreateVolumesFromImageTest-1888949505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:06 devstack sudo[106132]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-995acb8d-fce1-47d2-8e48-cf0321e8a805 tempest-CreateVolumesFromImageTest-1888949505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f134d2c2-b3d6-452e-b104-68baae4eef1e" returned: 0 in 0.370s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:06 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-995acb8d-fce1-47d2-8e48-cf0321e8a805 tempest-CreateVolumesFromImageTest-1888949505 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:50:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-995acb8d-fce1-47d2-8e48-cf0321e8a805 tempest-CreateVolumesFromImageTest-1888949505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-68fd5d9e-4e7a-45eb-923f-0dd191aafedd tempest-VolumeDependencyTests-1969615490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.520s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:06 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-68fd5d9e-4e7a-45eb-923f-0dd191aafedd tempest-VolumeDependencyTests-1969615490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-329493031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff15a29f-c8df-4880-9a2b-43e4537ea992,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd4ee36b54e441718771f50f7070f351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:06Z,use_quota=True,user_id='f74c78eb3f3247e0a95fabfbb8c90818',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:50:06 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-68fd5d9e-4e7a-45eb-923f-0dd191aafedd tempest-VolumeDependencyTests-1969615490 None] Creating volume ff15a29f-c8df-4880-9a2b-43e4537ea992 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:50:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-68fd5d9e-4e7a-45eb-923f-0dd191aafedd tempest-VolumeDependencyTests-1969615490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-68fd5d9e-4e7a-45eb-923f-0dd191aafedd tempest-VolumeDependencyTests-1969615490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:06 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-68fd5d9e-4e7a-45eb-923f-0dd191aafedd tempest-VolumeDependencyTests-1969615490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:06 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-68fd5d9e-4e7a-45eb-923f-0dd191aafedd tempest-VolumeDependencyTests-1969615490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-68fd5d9e-4e7a-45eb-923f-0dd191aafedd tempest-VolumeDependencyTests-1969615490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:06 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-68fd5d9e-4e7a-45eb-923f-0dd191aafedd tempest-VolumeDependencyTests-1969615490 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:50:06 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-68fd5d9e-4e7a-45eb-923f-0dd191aafedd tempest-VolumeDependencyTests-1969615490 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:50:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-68fd5d9e-4e7a-45eb-923f-0dd191aafedd tempest-VolumeDependencyTests-1969615490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ff15a29f-c8df-4880-9a2b-43e4537ea992 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-995acb8d-fce1-47d2-8e48-cf0321e8a805 tempest-CreateVolumesFromImageTest-1888949505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daa267d4-b5ac-4c17-a343-a4c49c72113f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f134d2c2-b3d6-452e-b104-68baae4eef1e', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:06 devstack sudo[106135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ff15a29f-c8df-4880-9a2b-43e4537ea992 1073741824 Nov 03 07:50:06 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-995acb8d-fce1-47d2-8e48-cf0321e8a805 tempest-CreateVolumesFromImageTest-1888949505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f61959c-f971-4c6f-9a9d-793319be291c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:06 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-995acb8d-fce1-47d2-8e48-cf0321e8a805 tempest-CreateVolumesFromImageTest-1888949505 None] Volume volume-f134d2c2-b3d6-452e-b104-68baae4eef1e (f134d2c2-b3d6-452e-b104-68baae4eef1e): created successfully Nov 03 07:50:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-995acb8d-fce1-47d2-8e48-cf0321e8a805 tempest-CreateVolumesFromImageTest-1888949505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f61959c-f971-4c6f-9a9d-793319be291c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-995acb8d-fce1-47d2-8e48-cf0321e8a805 tempest-CreateVolumesFromImageTest-1888949505 None] Flow 'volume_create_manager' (28f7ffbe-4b15-4d86-a0c6-1ca60e745278) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:06 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9b4bf58-c7bd-4ed3-bc79-69cd0ee9d3ef tempest-CreateVolumesFromImageTest-1888949505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:50:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e9b4bf58-c7bd-4ed3-bc79-69cd0ee9d3ef tempest-CreateVolumesFromImageTest-1888949505 None] Flow 'volume_create_manager' (d09049a8-b0e2-46a2-83bf-ab34ebf7efc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e9b4bf58-c7bd-4ed3-bc79-69cd0ee9d3ef tempest-CreateVolumesFromImageTest-1888949505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ed5591f-5a1f-45d0-bec7-e9d7c6cc951a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:06 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-995acb8d-fce1-47d2-8e48-cf0321e8a805 tempest-CreateVolumesFromImageTest-1888949505 None] Created volume successfully. Nov 03 07:50:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e9b4bf58-c7bd-4ed3-bc79-69cd0ee9d3ef tempest-CreateVolumesFromImageTest-1888949505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ed5591f-5a1f-45d0-bec7-e9d7c6cc951a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-122000095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb3dcb75-2e7a-44f5-a68f-235440641430,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c8f1dc58d2641ab8961f2ecc5e600fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:07Z,use_quota=True,user_id='2e559c1d88dc4dec8b5e76aa30037518',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e9b4bf58-c7bd-4ed3-bc79-69cd0ee9d3ef tempest-CreateVolumesFromImageTest-1888949505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8343b52-3d89-46ae-873d-575e593e8978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e9b4bf58-c7bd-4ed3-bc79-69cd0ee9d3ef tempest-CreateVolumesFromImageTest-1888949505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8343b52-3d89-46ae-873d-575e593e8978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e9b4bf58-c7bd-4ed3-bc79-69cd0ee9d3ef tempest-CreateVolumesFromImageTest-1888949505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (540e5c33-3180-4e7f-a561-2a28563ed6ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e9b4bf58-c7bd-4ed3-bc79-69cd0ee9d3ef tempest-CreateVolumesFromImageTest-1888949505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (540e5c33-3180-4e7f-a561-2a28563ed6ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb3dcb75-2e7a-44f5-a68f-235440641430', 'volume_name': 'volume-bb3dcb75-2e7a-44f5-a68f-235440641430', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e9b4bf58-c7bd-4ed3-bc79-69cd0ee9d3ef tempest-CreateVolumesFromImageTest-1888949505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6edc90c0-9574-4ad4-b4e3-3a8aed5960c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e9b4bf58-c7bd-4ed3-bc79-69cd0ee9d3ef tempest-CreateVolumesFromImageTest-1888949505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6edc90c0-9574-4ad4-b4e3-3a8aed5960c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e9b4bf58-c7bd-4ed3-bc79-69cd0ee9d3ef tempest-CreateVolumesFromImageTest-1888949505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4151713e-6f30-4263-8b1d-1750878abc10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:06 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-e9b4bf58-c7bd-4ed3-bc79-69cd0ee9d3ef tempest-CreateVolumesFromImageTest-1888949505 None] Volume bb3dcb75-2e7a-44f5-a68f-235440641430: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb3dcb75-2e7a-44f5-a68f-235440641430', 'volume_size': 1} Nov 03 07:50:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e9b4bf58-c7bd-4ed3-bc79-69cd0ee9d3ef tempest-CreateVolumesFromImageTest-1888949505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:07 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d202790-f412-4b06-8047-03f016d0994a tempest-CreateVolumesFromImageTest-1888949505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:50:07 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-6d202790-f412-4b06-8047-03f016d0994a tempest-CreateVolumesFromImageTest-1888949505 None] Flow 'volume_create_manager' (c9df7298-8609-4738-b17d-3ea412bf4708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:07 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-6d202790-f412-4b06-8047-03f016d0994a tempest-CreateVolumesFromImageTest-1888949505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7979bd1f-3055-4d42-a3b5-2c45e3f89e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:07 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-6d202790-f412-4b06-8047-03f016d0994a tempest-CreateVolumesFromImageTest-1888949505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7979bd1f-3055-4d42-a3b5-2c45e3f89e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-320237312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f2f1a51-0e33-4e68-9029-a2d651a4ea64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c8f1dc58d2641ab8961f2ecc5e600fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:07Z,use_quota=True,user_id='2e559c1d88dc4dec8b5e76aa30037518',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:07 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-6d202790-f412-4b06-8047-03f016d0994a tempest-CreateVolumesFromImageTest-1888949505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3cfe744-c1bd-452f-aea3-2e0331df302e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:07 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-6d202790-f412-4b06-8047-03f016d0994a tempest-CreateVolumesFromImageTest-1888949505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3cfe744-c1bd-452f-aea3-2e0331df302e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:07 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-6d202790-f412-4b06-8047-03f016d0994a tempest-CreateVolumesFromImageTest-1888949505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f7d2011-b2d3-4124-b74c-7e3a8ef32bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:07 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-6d202790-f412-4b06-8047-03f016d0994a tempest-CreateVolumesFromImageTest-1888949505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f7d2011-b2d3-4124-b74c-7e3a8ef32bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f2f1a51-0e33-4e68-9029-a2d651a4ea64', 'volume_name': 'volume-9f2f1a51-0e33-4e68-9029-a2d651a4ea64', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:07 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-6d202790-f412-4b06-8047-03f016d0994a tempest-CreateVolumesFromImageTest-1888949505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7aca7d6-1025-4f8f-802d-6b89b8bd1842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:07 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-6d202790-f412-4b06-8047-03f016d0994a tempest-CreateVolumesFromImageTest-1888949505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7aca7d6-1025-4f8f-802d-6b89b8bd1842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:07 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-6d202790-f412-4b06-8047-03f016d0994a tempest-CreateVolumesFromImageTest-1888949505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e4dcfc0-1de3-4caf-a422-b5e06bf2cd7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:07 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-6d202790-f412-4b06-8047-03f016d0994a tempest-CreateVolumesFromImageTest-1888949505 None] Volume 9f2f1a51-0e33-4e68-9029-a2d651a4ea64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f2f1a51-0e33-4e68-9029-a2d651a4ea64', 'volume_size': 1} Nov 03 07:50:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-6d202790-f412-4b06-8047-03f016d0994a tempest-CreateVolumesFromImageTest-1888949505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:07 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-68fd5d9e-4e7a-45eb-923f-0dd191aafedd tempest-VolumeDependencyTests-1969615490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ff15a29f-c8df-4880-9a2b-43e4537ea992 1073741824" returned: 0 in 0.705s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-68fd5d9e-4e7a-45eb-923f-0dd191aafedd tempest-VolumeDependencyTests-1969615490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ff15a29f-c8df-4880-9a2b-43e4537ea992 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:07 devstack sudo[106141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ff15a29f-c8df-4880-9a2b-43e4537ea992 Nov 03 07:50:07 devstack sudo[106141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:07 devstack sudo[106141]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-68fd5d9e-4e7a-45eb-923f-0dd191aafedd tempest-VolumeDependencyTests-1969615490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ff15a29f-c8df-4880-9a2b-43e4537ea992" returned: 0 in 0.264s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:07 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-68fd5d9e-4e7a-45eb-923f-0dd191aafedd tempest-VolumeDependencyTests-1969615490 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:50:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-68fd5d9e-4e7a-45eb-923f-0dd191aafedd tempest-VolumeDependencyTests-1969615490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-55d9450a-c71c-47e3-a422-eb3fb7a58f4b tempest-CreateVolumesFromImageTest-1888949505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.445s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:07 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-55d9450a-c71c-47e3-a422-eb3fb7a58f4b tempest-CreateVolumesFromImageTest-1888949505 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1006469680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99ff2d8b-d460-49a5-8870-b3cb303f4757,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c8f1dc58d2641ab8961f2ecc5e600fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:06Z,use_quota=True,user_id='2e559c1d88dc4dec8b5e76aa30037518',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:50:07 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-55d9450a-c71c-47e3-a422-eb3fb7a58f4b tempest-CreateVolumesFromImageTest-1888949505 None] Creating volume 99ff2d8b-d460-49a5-8870-b3cb303f4757 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:50:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-55d9450a-c71c-47e3-a422-eb3fb7a58f4b tempest-CreateVolumesFromImageTest-1888949505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-55d9450a-c71c-47e3-a422-eb3fb7a58f4b tempest-CreateVolumesFromImageTest-1888949505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:07 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-55d9450a-c71c-47e3-a422-eb3fb7a58f4b tempest-CreateVolumesFromImageTest-1888949505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:07 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-55d9450a-c71c-47e3-a422-eb3fb7a58f4b tempest-CreateVolumesFromImageTest-1888949505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-55d9450a-c71c-47e3-a422-eb3fb7a58f4b tempest-CreateVolumesFromImageTest-1888949505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:07 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-55d9450a-c71c-47e3-a422-eb3fb7a58f4b tempest-CreateVolumesFromImageTest-1888949505 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:50:07 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-55d9450a-c71c-47e3-a422-eb3fb7a58f4b tempest-CreateVolumesFromImageTest-1888949505 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:50:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-55d9450a-c71c-47e3-a422-eb3fb7a58f4b tempest-CreateVolumesFromImageTest-1888949505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-99ff2d8b-d460-49a5-8870-b3cb303f4757 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:07 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-68fd5d9e-4e7a-45eb-923f-0dd191aafedd tempest-VolumeDependencyTests-1969615490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c84a3a9-7afd-4bdf-ad39-817f892e4370) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff15a29f-c8df-4880-9a2b-43e4537ea992', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:07 devstack sudo[106144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-99ff2d8b-d460-49a5-8870-b3cb303f4757 1073741824 Nov 03 07:50:07 devstack sudo[106144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:07 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-68fd5d9e-4e7a-45eb-923f-0dd191aafedd tempest-VolumeDependencyTests-1969615490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36cefcc6-86ad-4ed2-88d2-273753428715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:07 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-68fd5d9e-4e7a-45eb-923f-0dd191aafedd tempest-VolumeDependencyTests-1969615490 None] Volume volume-ff15a29f-c8df-4880-9a2b-43e4537ea992 (ff15a29f-c8df-4880-9a2b-43e4537ea992): created successfully Nov 03 07:50:07 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-68fd5d9e-4e7a-45eb-923f-0dd191aafedd tempest-VolumeDependencyTests-1969615490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36cefcc6-86ad-4ed2-88d2-273753428715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:07 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-68fd5d9e-4e7a-45eb-923f-0dd191aafedd tempest-VolumeDependencyTests-1969615490 None] Flow 'volume_create_manager' (bf299131-7b1e-40b9-bd40-fb74a32284fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:07 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-68fd5d9e-4e7a-45eb-923f-0dd191aafedd tempest-VolumeDependencyTests-1969615490 None] Created volume successfully. Nov 03 07:50:08 devstack sudo[106144]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-55d9450a-c71c-47e3-a422-eb3fb7a58f4b tempest-CreateVolumesFromImageTest-1888949505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-99ff2d8b-d460-49a5-8870-b3cb303f4757 1073741824" returned: 0 in 0.554s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-55d9450a-c71c-47e3-a422-eb3fb7a58f4b tempest-CreateVolumesFromImageTest-1888949505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-99ff2d8b-d460-49a5-8870-b3cb303f4757 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:08 devstack sudo[106151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-99ff2d8b-d460-49a5-8870-b3cb303f4757 Nov 03 07:50:08 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:08 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-55d9450a-c71c-47e3-a422-eb3fb7a58f4b tempest-CreateVolumesFromImageTest-1888949505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-99ff2d8b-d460-49a5-8870-b3cb303f4757" returned: 0 in 0.319s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:08 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-55d9450a-c71c-47e3-a422-eb3fb7a58f4b tempest-CreateVolumesFromImageTest-1888949505 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:50:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-55d9450a-c71c-47e3-a422-eb3fb7a58f4b tempest-CreateVolumesFromImageTest-1888949505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3ba75dc5-cdb3-4b27-98e2-3a9f9debcd54 tempest-CreateVolumesFromImageTest-1888949505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.014s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:08 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-3ba75dc5-cdb3-4b27-98e2-3a9f9debcd54 tempest-CreateVolumesFromImageTest-1888949505 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1300267779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68190f86-b62c-4831-9353-9eff6dcc371e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c8f1dc58d2641ab8961f2ecc5e600fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:06Z,use_quota=True,user_id='2e559c1d88dc4dec8b5e76aa30037518',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:50:08 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-3ba75dc5-cdb3-4b27-98e2-3a9f9debcd54 tempest-CreateVolumesFromImageTest-1888949505 None] Creating volume 68190f86-b62c-4831-9353-9eff6dcc371e {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:50:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3ba75dc5-cdb3-4b27-98e2-3a9f9debcd54 tempest-CreateVolumesFromImageTest-1888949505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3ba75dc5-cdb3-4b27-98e2-3a9f9debcd54 tempest-CreateVolumesFromImageTest-1888949505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:08 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-3ba75dc5-cdb3-4b27-98e2-3a9f9debcd54 tempest-CreateVolumesFromImageTest-1888949505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:08 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-3ba75dc5-cdb3-4b27-98e2-3a9f9debcd54 tempest-CreateVolumesFromImageTest-1888949505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3ba75dc5-cdb3-4b27-98e2-3a9f9debcd54 tempest-CreateVolumesFromImageTest-1888949505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:08 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-3ba75dc5-cdb3-4b27-98e2-3a9f9debcd54 tempest-CreateVolumesFromImageTest-1888949505 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:50:08 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-3ba75dc5-cdb3-4b27-98e2-3a9f9debcd54 tempest-CreateVolumesFromImageTest-1888949505 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:50:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3ba75dc5-cdb3-4b27-98e2-3a9f9debcd54 tempest-CreateVolumesFromImageTest-1888949505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-68190f86-b62c-4831-9353-9eff6dcc371e 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:08 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-55d9450a-c71c-47e3-a422-eb3fb7a58f4b tempest-CreateVolumesFromImageTest-1888949505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e9a5cd2-1023-4623-9b58-c5de819e5db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99ff2d8b-d460-49a5-8870-b3cb303f4757', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:08 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-55d9450a-c71c-47e3-a422-eb3fb7a58f4b tempest-CreateVolumesFromImageTest-1888949505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e363c6bb-dfff-4446-b515-3d0d38627c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:08 devstack sudo[106154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-68190f86-b62c-4831-9353-9eff6dcc371e 1073741824 Nov 03 07:50:08 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:08 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-55d9450a-c71c-47e3-a422-eb3fb7a58f4b tempest-CreateVolumesFromImageTest-1888949505 None] Volume volume-99ff2d8b-d460-49a5-8870-b3cb303f4757 (99ff2d8b-d460-49a5-8870-b3cb303f4757): created successfully Nov 03 07:50:08 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-55d9450a-c71c-47e3-a422-eb3fb7a58f4b tempest-CreateVolumesFromImageTest-1888949505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e363c6bb-dfff-4446-b515-3d0d38627c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:08 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-55d9450a-c71c-47e3-a422-eb3fb7a58f4b tempest-CreateVolumesFromImageTest-1888949505 None] Flow 'volume_create_manager' (d74998a5-fc40-4c86-9145-1327e5bb8e4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:08 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-55d9450a-c71c-47e3-a422-eb3fb7a58f4b tempest-CreateVolumesFromImageTest-1888949505 None] Created volume successfully. Nov 03 07:50:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-04b852ac-ec2d-40cf-b386-bb6af2b27be0 tempest-VolumeDependencyTests-1969615490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:09 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3ba75dc5-cdb3-4b27-98e2-3a9f9debcd54 tempest-CreateVolumesFromImageTest-1888949505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-68190f86-b62c-4831-9353-9eff6dcc371e 1073741824" returned: 0 in 0.619s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3ba75dc5-cdb3-4b27-98e2-3a9f9debcd54 tempest-CreateVolumesFromImageTest-1888949505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-68190f86-b62c-4831-9353-9eff6dcc371e {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:09 devstack sudo[106160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-68190f86-b62c-4831-9353-9eff6dcc371e Nov 03 07:50:09 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:09 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3ba75dc5-cdb3-4b27-98e2-3a9f9debcd54 tempest-CreateVolumesFromImageTest-1888949505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-68190f86-b62c-4831-9353-9eff6dcc371e" returned: 0 in 0.266s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:09 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-3ba75dc5-cdb3-4b27-98e2-3a9f9debcd54 tempest-CreateVolumesFromImageTest-1888949505 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:50:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3ba75dc5-cdb3-4b27-98e2-3a9f9debcd54 tempest-CreateVolumesFromImageTest-1888949505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e9b4bf58-c7bd-4ed3-bc79-69cd0ee9d3ef tempest-CreateVolumesFromImageTest-1888949505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.657s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:09 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-e9b4bf58-c7bd-4ed3-bc79-69cd0ee9d3ef tempest-CreateVolumesFromImageTest-1888949505 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-122000095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb3dcb75-2e7a-44f5-a68f-235440641430,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c8f1dc58d2641ab8961f2ecc5e600fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:07Z,use_quota=True,user_id='2e559c1d88dc4dec8b5e76aa30037518',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:50:09 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-e9b4bf58-c7bd-4ed3-bc79-69cd0ee9d3ef tempest-CreateVolumesFromImageTest-1888949505 None] Creating volume bb3dcb75-2e7a-44f5-a68f-235440641430 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:50:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e9b4bf58-c7bd-4ed3-bc79-69cd0ee9d3ef tempest-CreateVolumesFromImageTest-1888949505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e9b4bf58-c7bd-4ed3-bc79-69cd0ee9d3ef tempest-CreateVolumesFromImageTest-1888949505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:09 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-e9b4bf58-c7bd-4ed3-bc79-69cd0ee9d3ef tempest-CreateVolumesFromImageTest-1888949505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:09 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-e9b4bf58-c7bd-4ed3-bc79-69cd0ee9d3ef tempest-CreateVolumesFromImageTest-1888949505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e9b4bf58-c7bd-4ed3-bc79-69cd0ee9d3ef tempest-CreateVolumesFromImageTest-1888949505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:09 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-e9b4bf58-c7bd-4ed3-bc79-69cd0ee9d3ef tempest-CreateVolumesFromImageTest-1888949505 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:50:09 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-e9b4bf58-c7bd-4ed3-bc79-69cd0ee9d3ef tempest-CreateVolumesFromImageTest-1888949505 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:50:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e9b4bf58-c7bd-4ed3-bc79-69cd0ee9d3ef tempest-CreateVolumesFromImageTest-1888949505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bb3dcb75-2e7a-44f5-a68f-235440641430 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:09 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3ba75dc5-cdb3-4b27-98e2-3a9f9debcd54 tempest-CreateVolumesFromImageTest-1888949505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7743222d-9d2a-488b-846a-47de8e2dab09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68190f86-b62c-4831-9353-9eff6dcc371e', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:09 devstack sudo[106163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bb3dcb75-2e7a-44f5-a68f-235440641430 1073741824 Nov 03 07:50:09 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3ba75dc5-cdb3-4b27-98e2-3a9f9debcd54 tempest-CreateVolumesFromImageTest-1888949505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7756d886-959f-4758-aa33-70833e015831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:09 devstack sudo[106163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:09 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-3ba75dc5-cdb3-4b27-98e2-3a9f9debcd54 tempest-CreateVolumesFromImageTest-1888949505 None] Volume volume-68190f86-b62c-4831-9353-9eff6dcc371e (68190f86-b62c-4831-9353-9eff6dcc371e): created successfully Nov 03 07:50:09 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3ba75dc5-cdb3-4b27-98e2-3a9f9debcd54 tempest-CreateVolumesFromImageTest-1888949505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7756d886-959f-4758-aa33-70833e015831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:09 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-3ba75dc5-cdb3-4b27-98e2-3a9f9debcd54 tempest-CreateVolumesFromImageTest-1888949505 None] Flow 'volume_create_manager' (c412b755-75d1-47e7-b02f-86413c0bf37e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:09 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-3ba75dc5-cdb3-4b27-98e2-3a9f9debcd54 tempest-CreateVolumesFromImageTest-1888949505 None] Created volume successfully. Nov 03 07:50:10 devstack sudo[106163]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e9b4bf58-c7bd-4ed3-bc79-69cd0ee9d3ef tempest-CreateVolumesFromImageTest-1888949505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bb3dcb75-2e7a-44f5-a68f-235440641430 1073741824" returned: 0 in 0.540s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e9b4bf58-c7bd-4ed3-bc79-69cd0ee9d3ef tempest-CreateVolumesFromImageTest-1888949505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bb3dcb75-2e7a-44f5-a68f-235440641430 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:10 devstack sudo[106169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bb3dcb75-2e7a-44f5-a68f-235440641430 Nov 03 07:50:10 devstack sudo[106169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:10 devstack sudo[106169]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e9b4bf58-c7bd-4ed3-bc79-69cd0ee9d3ef tempest-CreateVolumesFromImageTest-1888949505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bb3dcb75-2e7a-44f5-a68f-235440641430" returned: 0 in 0.296s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:10 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-e9b4bf58-c7bd-4ed3-bc79-69cd0ee9d3ef tempest-CreateVolumesFromImageTest-1888949505 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:50:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e9b4bf58-c7bd-4ed3-bc79-69cd0ee9d3ef tempest-CreateVolumesFromImageTest-1888949505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-6d202790-f412-4b06-8047-03f016d0994a tempest-CreateVolumesFromImageTest-1888949505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.260s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:10 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-6d202790-f412-4b06-8047-03f016d0994a tempest-CreateVolumesFromImageTest-1888949505 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-320237312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f2f1a51-0e33-4e68-9029-a2d651a4ea64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c8f1dc58d2641ab8961f2ecc5e600fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:07Z,use_quota=True,user_id='2e559c1d88dc4dec8b5e76aa30037518',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:50:10 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-6d202790-f412-4b06-8047-03f016d0994a tempest-CreateVolumesFromImageTest-1888949505 None] Creating volume 9f2f1a51-0e33-4e68-9029-a2d651a4ea64 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:50:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-6d202790-f412-4b06-8047-03f016d0994a tempest-CreateVolumesFromImageTest-1888949505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-6d202790-f412-4b06-8047-03f016d0994a tempest-CreateVolumesFromImageTest-1888949505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:10 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-6d202790-f412-4b06-8047-03f016d0994a tempest-CreateVolumesFromImageTest-1888949505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:10 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-6d202790-f412-4b06-8047-03f016d0994a tempest-CreateVolumesFromImageTest-1888949505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-6d202790-f412-4b06-8047-03f016d0994a tempest-CreateVolumesFromImageTest-1888949505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:10 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-6d202790-f412-4b06-8047-03f016d0994a tempest-CreateVolumesFromImageTest-1888949505 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:50:10 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-6d202790-f412-4b06-8047-03f016d0994a tempest-CreateVolumesFromImageTest-1888949505 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:50:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6d202790-f412-4b06-8047-03f016d0994a tempest-CreateVolumesFromImageTest-1888949505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f2f1a51-0e33-4e68-9029-a2d651a4ea64 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:10 devstack sudo[106172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f2f1a51-0e33-4e68-9029-a2d651a4ea64 1073741824 Nov 03 07:50:10 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:10 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e9b4bf58-c7bd-4ed3-bc79-69cd0ee9d3ef tempest-CreateVolumesFromImageTest-1888949505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4151713e-6f30-4263-8b1d-1750878abc10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb3dcb75-2e7a-44f5-a68f-235440641430', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:10 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e9b4bf58-c7bd-4ed3-bc79-69cd0ee9d3ef tempest-CreateVolumesFromImageTest-1888949505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b2ad83d-c247-406b-9e33-8325bab96d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:10 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:50:10 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Flow 'volume_create_manager' (10a29196-f4ea-42be-8ca1-23fcc453fa3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:10 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28509048-4875-471d-b849-29c09b501eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:10 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-e9b4bf58-c7bd-4ed3-bc79-69cd0ee9d3ef tempest-CreateVolumesFromImageTest-1888949505 None] Volume volume-bb3dcb75-2e7a-44f5-a68f-235440641430 (bb3dcb75-2e7a-44f5-a68f-235440641430): created successfully Nov 03 07:50:10 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e9b4bf58-c7bd-4ed3-bc79-69cd0ee9d3ef tempest-CreateVolumesFromImageTest-1888949505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b2ad83d-c247-406b-9e33-8325bab96d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:10 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e9b4bf58-c7bd-4ed3-bc79-69cd0ee9d3ef tempest-CreateVolumesFromImageTest-1888949505 None] Flow 'volume_create_manager' (d09049a8-b0e2-46a2-83bf-ab34ebf7efc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:10 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28509048-4875-471d-b849-29c09b501eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24dc16e9-ab31-4d83-8042-7a56fb08b7fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1b809cb231346788a35642edf0f82da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:10Z,use_quota=True,user_id='3cdf2ad6a5454c34ae1a0e12b4688e78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7302a617-e457-4482-b4ec-f087ad934e1b),volume_type_id=7302a617-e457-4482-b4ec-f087ad934e1b)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:10 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf73d93c-dbe0-4ba9-93d8-488ba8bffc8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:10 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf73d93c-dbe0-4ba9-93d8-488ba8bffc8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:10 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc15f779-5f70-4faf-84e5-a8688aed9274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:10 devstack cinder-volume[86875]: DEBUG cinder.image.glance [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Creating Keystone auth plugin from conf {{(pid=86875) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 07:50:10 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-e9b4bf58-c7bd-4ed3-bc79-69cd0ee9d3ef tempest-CreateVolumesFromImageTest-1888949505 None] Created volume successfully. Nov 03 07:50:10 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc15f779-5f70-4faf-84e5-a8688aed9274) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '24dc16e9-ab31-4d83-8042-7a56fb08b7fa', 'volume_name': 'volume-24dc16e9-ab31-4d83-8042-7a56fb08b7fa', 'volume_size': 1, 'image_id': '04892d14-e7a1-4270-a38b-5655c45e4d22', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/04892d14-e7a1-4270-a38b-5655c45e4d22', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '70fe5695b53370b4fd67b168d45095a7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b1b809cb231346788a35642edf0f82da', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '79a1645dc7c93083f02d94c5dca4d7770d680b7a6f8758a987faddf39213cd14d5f5b615cfffaf196e95607d9c92a9fdf16c3b67e5e4a321c9da87f69e61081c', 'id': '04892d14-e7a1-4270-a38b-5655c45e4d22', 'created_at': datetime.datetime(2026, 11, 3, 6, 50, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 50, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/04892d14-e7a1-4270-a38b-5655c45e4d22/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:10 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23387108-a3a3-4895-b1f8-111a269737f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:10 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23387108-a3a3-4895-b1f8-111a269737f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:10 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cad6def1-4cb5-4c50-9ef1-a2bf94dc0b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:10 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Volume 24dc16e9-ab31-4d83-8042-7a56fb08b7fa: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-24dc16e9-ab31-4d83-8042-7a56fb08b7fa', 'volume_size': 1, 'image_id': '04892d14-e7a1-4270-a38b-5655c45e4d22', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/04892d14-e7a1-4270-a38b-5655c45e4d22', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '70fe5695b53370b4fd67b168d45095a7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b1b809cb231346788a35642edf0f82da', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '79a1645dc7c93083f02d94c5dca4d7770d680b7a6f8758a987faddf39213cd14d5f5b615cfffaf196e95607d9c92a9fdf16c3b67e5e4a321c9da87f69e61081c', 'id': '04892d14-e7a1-4270-a38b-5655c45e4d22', 'created_at': datetime.datetime(2026, 11, 3, 6, 50, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 50, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/04892d14-e7a1-4270-a38b-5655c45e4d22/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 03 07:50:10 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Trying to clone 24dc16e9-ab31-4d83-8042-7a56fb08b7fa from image 04892d14-e7a1-4270-a38b-5655c45e4d22 at location (None, [{'url': 'file:///opt/stack/data/glance/images/04892d14-e7a1-4270-a38b-5655c45e4d22', 'metadata': {}}]). {{(pid=86875) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 07:50:10 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6d202790-f412-4b06-8047-03f016d0994a tempest-CreateVolumesFromImageTest-1888949505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f2f1a51-0e33-4e68-9029-a2d651a4ea64 1073741824" returned: 0 in 0.529s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6d202790-f412-4b06-8047-03f016d0994a tempest-CreateVolumesFromImageTest-1888949505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f2f1a51-0e33-4e68-9029-a2d651a4ea64 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:11 devstack sudo[106178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f2f1a51-0e33-4e68-9029-a2d651a4ea64 Nov 03 07:50:11 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:11 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_04892d14-e7a1-4270-a38b-5655c45e4d22_oznecww7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86875) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 07:50:11 devstack cinder-volume[86875]: INFO cinder.image.image_utils [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Image download 0.00 MB at 0.00 MB/s Nov 03 07:50:11 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[9834eb80-7e77-445f-805b-6eb9c4c2f77b]: (4, 'raw') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_04892d14-e7a1-4270-a38b-5655c45e4d22_oznecww7devstack@QuobyteHD {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:11 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6d202790-f412-4b06-8047-03f016d0994a tempest-CreateVolumesFromImageTest-1888949505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f2f1a51-0e33-4e68-9029-a2d651a4ea64" returned: 0 in 0.249s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:11 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-6d202790-f412-4b06-8047-03f016d0994a tempest-CreateVolumesFromImageTest-1888949505 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:50:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-6d202790-f412-4b06-8047-03f016d0994a tempest-CreateVolumesFromImageTest-1888949505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-04b852ac-ec2d-40cf-b386-bb6af2b27be0 tempest-VolumeDependencyTests-1969615490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.439s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:11 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-6d202790-f412-4b06-8047-03f016d0994a tempest-CreateVolumesFromImageTest-1888949505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e4dcfc0-1de3-4caf-a422-b5e06bf2cd7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f2f1a51-0e33-4e68-9029-a2d651a4ea64', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:11 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-6d202790-f412-4b06-8047-03f016d0994a tempest-CreateVolumesFromImageTest-1888949505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc2f77c5-2e97-418f-a081-ccc6b841b0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:11 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-04b852ac-ec2d-40cf-b386-bb6af2b27be0 tempest-VolumeDependencyTests-1969615490 None] Creating offline snapshot 17fe0d43-ec81-4dfb-ac7b-4afb5a40d1e0 of volume ff15a29f-c8df-4880-9a2b-43e4537ea992 {{(pid=86875) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:50:11 devstack sudo[106180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_04892d14-e7a1-4270-a38b-5655c45e4d22_oznecww7devstack@QuobyteHD Nov 03 07:50:11 devstack sudo[106180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:11 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-6d202790-f412-4b06-8047-03f016d0994a tempest-CreateVolumesFromImageTest-1888949505 None] Volume volume-9f2f1a51-0e33-4e68-9029-a2d651a4ea64 (9f2f1a51-0e33-4e68-9029-a2d651a4ea64): created successfully Nov 03 07:50:11 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-6d202790-f412-4b06-8047-03f016d0994a tempest-CreateVolumesFromImageTest-1888949505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc2f77c5-2e97-418f-a081-ccc6b841b0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:11 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-6d202790-f412-4b06-8047-03f016d0994a tempest-CreateVolumesFromImageTest-1888949505 None] Flow 'volume_create_manager' (c9df7298-8609-4738-b17d-3ea412bf4708) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:11 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a6c46d-1a54-4bdc-be19-eeab4ba9fedf]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-04b852ac-ec2d-40cf-b386-bb6af2b27be0 tempest-VolumeDependencyTests-1969615490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ff15a29f-c8df-4880-9a2b-43e4537ea992 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:11 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-6d202790-f412-4b06-8047-03f016d0994a tempest-CreateVolumesFromImageTest-1888949505 None] Created volume successfully. Nov 03 07:50:11 devstack sudo[106187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ff15a29f-c8df-4880-9a2b-43e4537ea992 Nov 03 07:50:11 devstack sudo[106187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:11 devstack sudo[106180]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_04892d14-e7a1-4270-a38b-5655c45e4d22_oznecww7devstack@QuobyteHD" returned: 0 in 0.411s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04892d14-e7a1-4270-a38b-5655c45e4d22_oznecww7devstack@QuobyteHD {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:11 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-2120f977-aa80-4674-9969-fc391abb87c8 tempest-CreateVolumesFromImageTest-1888949505 None] Acquiring lock "cinder-9f2f1a51-0e33-4e68-9029-a2d651a4ea64-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:11 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-2120f977-aa80-4674-9969-fc391abb87c8 tempest-CreateVolumesFromImageTest-1888949505 None] Lock "cinder-9f2f1a51-0e33-4e68-9029-a2d651a4ea64-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:11 devstack sudo[106191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04892d14-e7a1-4270-a38b-5655c45e4d22_oznecww7devstack@QuobyteHD Nov 03 07:50:11 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:11 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-2120f977-aa80-4674-9969-fc391abb87c8 tempest-CreateVolumesFromImageTest-1888949505 None] Acquiring lock "cinder-quobyte-9f2f1a51-0e33-4e68-9029-a2d651a4ea64" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:11 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-2120f977-aa80-4674-9969-fc391abb87c8 tempest-CreateVolumesFromImageTest-1888949505 None] Lock "cinder-quobyte-9f2f1a51-0e33-4e68-9029-a2d651a4ea64" acquired by "delete_volume" :: waited 0.013s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:11 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[356fa171-bb2c-41a3-81ae-e47f9e7554ee]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2120f977-aa80-4674-9969-fc391abb87c8 tempest-CreateVolumesFromImageTest-1888949505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f2f1a51-0e33-4e68-9029-a2d651a4ea64 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:11 devstack sudo[106187]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-04b852ac-ec2d-40cf-b386-bb6af2b27be0 tempest-VolumeDependencyTests-1969615490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ff15a29f-c8df-4880-9a2b-43e4537ea992" returned: 0 in 0.507s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-04b852ac-ec2d-40cf-b386-bb6af2b27be0 tempest-VolumeDependencyTests-1969615490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ff15a29f-c8df-4880-9a2b-43e4537ea992,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ff15a29f-c8df-4880-9a2b-43e4537ea992.17fe0d43-ec81-4dfb-ac7b-4afb5a40d1e0 1G {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:11 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ff15a29f-c8df-4880-9a2b-43e4537ea992,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ff15a29f-c8df-4880-9a2b-43e4537ea992.17fe0d43-ec81-4dfb-ac7b-4afb5a40d1e0 1G Nov 03 07:50:11 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:11 devstack sudo[106196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f2f1a51-0e33-4e68-9029-a2d651a4ea64 Nov 03 07:50:11 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:12 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:12 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04892d14-e7a1-4270-a38b-5655c45e4d22_oznecww7devstack@QuobyteHD" returned: 1 in 0.430s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:12 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04892d14-e7a1-4270-a38b-5655c45e4d22_oznecww7devstack@QuobyteHD' failed. Not Retrying. {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:50:12 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Temporary image 04892d14-e7a1-4270-a38b-5655c45e4d22 is fetched for user 3cdf2ad6a5454c34ae1a0e12b4688e78. {{(pid=86875) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 07:50:12 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd02af63-263d-4e31-9ba3-c9568f27d1aa]: (4, 'raw') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:12 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_04892d14-e7a1-4270-a38b-5655c45e4d22_oznecww7devstack@QuobyteHD {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:12 devstack sudo[106206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_04892d14-e7a1-4270-a38b-5655c45e4d22_oznecww7devstack@QuobyteHD Nov 03 07:50:12 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:12 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:12 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2120f977-aa80-4674-9969-fc391abb87c8 tempest-CreateVolumesFromImageTest-1888949505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f2f1a51-0e33-4e68-9029-a2d651a4ea64" returned: 0 in 0.438s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:12 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2120f977-aa80-4674-9969-fc391abb87c8 tempest-CreateVolumesFromImageTest-1888949505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f2f1a51-0e33-4e68-9029-a2d651a4ea64 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:12 devstack sudo[106214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f2f1a51-0e33-4e68-9029-a2d651a4ea64 Nov 03 07:50:12 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:12 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:12 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-04b852ac-ec2d-40cf-b386-bb6af2b27be0 tempest-VolumeDependencyTests-1969615490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ff15a29f-c8df-4880-9a2b-43e4537ea992,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ff15a29f-c8df-4880-9a2b-43e4537ea992.17fe0d43-ec81-4dfb-ac7b-4afb5a40d1e0 1G" returned: 0 in 0.528s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:12 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-04b852ac-ec2d-40cf-b386-bb6af2b27be0 tempest-VolumeDependencyTests-1969615490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff15a29f-c8df-4880-9a2b-43e4537ea992 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ff15a29f-c8df-4880-9a2b-43e4537ea992.17fe0d43-ec81-4dfb-ac7b-4afb5a40d1e0 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:12 devstack sudo[106216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff15a29f-c8df-4880-9a2b-43e4537ea992 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ff15a29f-c8df-4880-9a2b-43e4537ea992.17fe0d43-ec81-4dfb-ac7b-4afb5a40d1e0 Nov 03 07:50:12 devstack sudo[106216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:12 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:12 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2120f977-aa80-4674-9969-fc391abb87c8 tempest-CreateVolumesFromImageTest-1888949505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9f2f1a51-0e33-4e68-9029-a2d651a4ea64" returned: 0 in 0.282s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:12 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-2120f977-aa80-4674-9969-fc391abb87c8 tempest-CreateVolumesFromImageTest-1888949505 None] Lock "cinder-quobyte-9f2f1a51-0e33-4e68-9029-a2d651a4ea64" released by "delete_volume" :: held 0.771s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:12 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:12 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_04892d14-e7a1-4270-a38b-5655c45e4d22_oznecww7devstack@QuobyteHD" returned: 0 in 0.491s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:12 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04892d14-e7a1-4270-a38b-5655c45e4d22_oznecww7devstack@QuobyteHD {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:12 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-2120f977-aa80-4674-9969-fc391abb87c8 tempest-CreateVolumesFromImageTest-1888949505 None] Created reservations ['05268898-67ef-444b-9f92-878c269ac1f1', '9cd1a4a8-5999-4d73-b6d2-521b9d665120', '8f5660ee-8a3e-4b0e-aad9-e6e528fdf986', 'd2b78d90-81b3-4841-ba62-4d57f1c2643c'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:50:12 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-2120f977-aa80-4674-9969-fc391abb87c8 tempest-CreateVolumesFromImageTest-1888949505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:12 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-2120f977-aa80-4674-9969-fc391abb87c8 tempest-CreateVolumesFromImageTest-1888949505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:12 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-2120f977-aa80-4674-9969-fc391abb87c8 tempest-CreateVolumesFromImageTest-1888949505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:12 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-2120f977-aa80-4674-9969-fc391abb87c8 tempest-CreateVolumesFromImageTest-1888949505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:12 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-2120f977-aa80-4674-9969-fc391abb87c8 tempest-CreateVolumesFromImageTest-1888949505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:12 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2120f977-aa80-4674-9969-fc391abb87c8 tempest-CreateVolumesFromImageTest-1888949505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:12 devstack sudo[106225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:50:12 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:12 devstack sudo[106221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04892d14-e7a1-4270-a38b-5655c45e4d22_oznecww7devstack@QuobyteHD Nov 03 07:50:12 devstack sudo[106221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:12 devstack sudo[106216]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:12 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-04b852ac-ec2d-40cf-b386-bb6af2b27be0 tempest-VolumeDependencyTests-1969615490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff15a29f-c8df-4880-9a2b-43e4537ea992 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ff15a29f-c8df-4880-9a2b-43e4537ea992.17fe0d43-ec81-4dfb-ac7b-4afb5a40d1e0" returned: 0 in 0.414s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:12 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-04b852ac-ec2d-40cf-b386-bb6af2b27be0 tempest-VolumeDependencyTests-1969615490 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ff15a29f-c8df-4880-9a2b-43e4537ea992.17fe0d43-ec81-4dfb-ac7b-4afb5a40d1e0 is being set with open permissions: ugo+rw Nov 03 07:50:12 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-04b852ac-ec2d-40cf-b386-bb6af2b27be0 tempest-VolumeDependencyTests-1969615490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ff15a29f-c8df-4880-9a2b-43e4537ea992.17fe0d43-ec81-4dfb-ac7b-4afb5a40d1e0 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:12 devstack sudo[106228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ff15a29f-c8df-4880-9a2b-43e4537ea992.17fe0d43-ec81-4dfb-ac7b-4afb5a40d1e0 Nov 03 07:50:12 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:12 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-2be7807a-96e4-4610-8696-1226c1b8abd5 tempest-CreateVolumesFromImageTest-1888949505 None] Acquiring lock "cinder-bb3dcb75-2e7a-44f5-a68f-235440641430-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:13 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-2be7807a-96e4-4610-8696-1226c1b8abd5 tempest-CreateVolumesFromImageTest-1888949505 None] Lock "cinder-bb3dcb75-2e7a-44f5-a68f-235440641430-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:13 devstack sudo[106221]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04892d14-e7a1-4270-a38b-5655c45e4d22_oznecww7devstack@QuobyteHD" returned: 1 in 0.438s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04892d14-e7a1-4270-a38b-5655c45e4d22_oznecww7devstack@QuobyteHD' failed. Not Retrying. {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:50:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:13 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-2be7807a-96e4-4610-8696-1226c1b8abd5 tempest-CreateVolumesFromImageTest-1888949505 None] Acquiring lock "cinder-quobyte-bb3dcb75-2e7a-44f5-a68f-235440641430" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:13 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2120f977-aa80-4674-9969-fc391abb87c8 tempest-CreateVolumesFromImageTest-1888949505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.374s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:13 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-2120f977-aa80-4674-9969-fc391abb87c8 tempest-CreateVolumesFromImageTest-1888949505 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:50:13 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-2120f977-aa80-4674-9969-fc391abb87c8 tempest-CreateVolumesFromImageTest-1888949505 None] Deleted volume successfully. Nov 03 07:50:13 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-2be7807a-96e4-4610-8696-1226c1b8abd5 tempest-CreateVolumesFromImageTest-1888949505 None] Lock "cinder-quobyte-bb3dcb75-2e7a-44f5-a68f-235440641430" acquired by "delete_volume" :: waited 0.035s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:13 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-04b852ac-ec2d-40cf-b386-bb6af2b27be0 tempest-VolumeDependencyTests-1969615490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ff15a29f-c8df-4880-9a2b-43e4537ea992.17fe0d43-ec81-4dfb-ac7b-4afb5a40d1e0" returned: 0 in 0.356s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:13 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-2120f977-aa80-4674-9969-fc391abb87c8 tempest-CreateVolumesFromImageTest-1888949505 None] Lock "cinder-9f2f1a51-0e33-4e68-9029-a2d651a4ea64-delete_volume" released by "delete_volume" :: held 1.418s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:13 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3102f02-1bba-4741-b0e4-40269a655046]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2be7807a-96e4-4610-8696-1226c1b8abd5 tempest-CreateVolumesFromImageTest-1888949505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bb3dcb75-2e7a-44f5-a68f-235440641430 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-04b852ac-ec2d-40cf-b386-bb6af2b27be0 tempest-VolumeDependencyTests-1969615490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ff15a29f-c8df-4880-9a2b-43e4537ea992.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:13 devstack sudo[106236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ff15a29f-c8df-4880-9a2b-43e4537ea992.info Nov 03 07:50:13 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:13 devstack sudo[106235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bb3dcb75-2e7a-44f5-a68f-235440641430 Nov 03 07:50:13 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:13 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-04b852ac-ec2d-40cf-b386-bb6af2b27be0 tempest-VolumeDependencyTests-1969615490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ff15a29f-c8df-4880-9a2b-43e4537ea992.info" returned: 0 in 0.266s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:13 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-04b852ac-ec2d-40cf-b386-bb6af2b27be0 tempest-VolumeDependencyTests-1969615490 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ff15a29f-c8df-4880-9a2b-43e4537ea992.info is being set with open permissions: ugo+rw Nov 03 07:50:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-04b852ac-ec2d-40cf-b386-bb6af2b27be0 tempest-VolumeDependencyTests-1969615490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ff15a29f-c8df-4880-9a2b-43e4537ea992.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:13 devstack sudo[106242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ff15a29f-c8df-4880-9a2b-43e4537ea992.info Nov 03 07:50:13 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:13 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2be7807a-96e4-4610-8696-1226c1b8abd5 tempest-CreateVolumesFromImageTest-1888949505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bb3dcb75-2e7a-44f5-a68f-235440641430" returned: 0 in 0.406s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2be7807a-96e4-4610-8696-1226c1b8abd5 tempest-CreateVolumesFromImageTest-1888949505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bb3dcb75-2e7a-44f5-a68f-235440641430 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:13 devstack sudo[106245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bb3dcb75-2e7a-44f5-a68f-235440641430 Nov 03 07:50:13 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:13 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-04b852ac-ec2d-40cf-b386-bb6af2b27be0 tempest-VolumeDependencyTests-1969615490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ff15a29f-c8df-4880-9a2b-43e4537ea992.info" returned: 0 in 0.256s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-04b852ac-ec2d-40cf-b386-bb6af2b27be0 tempest-VolumeDependencyTests-1969615490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.487s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.690s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:13 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24dc16e9-ab31-4d83-8042-7a56fb08b7fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1b809cb231346788a35642edf0f82da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:10Z,use_quota=True,user_id='3cdf2ad6a5454c34ae1a0e12b4688e78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7302a617-e457-4482-b4ec-f087ad934e1b),volume_type_id=7302a617-e457-4482-b4ec-f087ad934e1b)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:50:13 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Creating volume 24dc16e9-ab31-4d83-8042-7a56fb08b7fa {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:50:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:13 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:13 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:13 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:50:13 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:50:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-24dc16e9-ab31-4d83-8042-7a56fb08b7fa 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:13 devstack sudo[106249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-24dc16e9-ab31-4d83-8042-7a56fb08b7fa 1073741824 Nov 03 07:50:13 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:13 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-04b852ac-ec2d-40cf-b386-bb6af2b27be0 tempest-VolumeDependencyTests-1969615490 None] Create snapshot completed successfully Nov 03 07:50:13 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2be7807a-96e4-4610-8696-1226c1b8abd5 tempest-CreateVolumesFromImageTest-1888949505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bb3dcb75-2e7a-44f5-a68f-235440641430" returned: 0 in 0.252s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:13 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-2be7807a-96e4-4610-8696-1226c1b8abd5 tempest-CreateVolumesFromImageTest-1888949505 None] Lock "cinder-quobyte-bb3dcb75-2e7a-44f5-a68f-235440641430" released by "delete_volume" :: held 0.714s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:13 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-2be7807a-96e4-4610-8696-1226c1b8abd5 tempest-CreateVolumesFromImageTest-1888949505 None] Created reservations ['f6256654-b3fe-4beb-99ea-f15b78fd0aad', '3e29da82-2450-4f03-9864-d2b376c8d841', '4aeb1ec8-cec7-4ba9-a7ea-58cec12b95be', 'ca28f503-06d1-45ea-b133-f198d9819fc0'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:50:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-2be7807a-96e4-4610-8696-1226c1b8abd5 tempest-CreateVolumesFromImageTest-1888949505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-2be7807a-96e4-4610-8696-1226c1b8abd5 tempest-CreateVolumesFromImageTest-1888949505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:13 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-2be7807a-96e4-4610-8696-1226c1b8abd5 tempest-CreateVolumesFromImageTest-1888949505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:13 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-2be7807a-96e4-4610-8696-1226c1b8abd5 tempest-CreateVolumesFromImageTest-1888949505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-2be7807a-96e4-4610-8696-1226c1b8abd5 tempest-CreateVolumesFromImageTest-1888949505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2be7807a-96e4-4610-8696-1226c1b8abd5 tempest-CreateVolumesFromImageTest-1888949505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:13 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:50:13 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:14 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a9f60408-8566-4920-ae52-e1b3376696f5 tempest-CreateVolumesFromImageTest-1888949505 None] Acquiring lock "cinder-68190f86-b62c-4831-9353-9eff6dcc371e-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:14 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a9f60408-8566-4920-ae52-e1b3376696f5 tempest-CreateVolumesFromImageTest-1888949505 None] Lock "cinder-68190f86-b62c-4831-9353-9eff6dcc371e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:14 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:14 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2be7807a-96e4-4610-8696-1226c1b8abd5 tempest-CreateVolumesFromImageTest-1888949505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.273s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:14 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-2be7807a-96e4-4610-8696-1226c1b8abd5 tempest-CreateVolumesFromImageTest-1888949505 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:50:14 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-2be7807a-96e4-4610-8696-1226c1b8abd5 tempest-CreateVolumesFromImageTest-1888949505 None] Deleted volume successfully. Nov 03 07:50:14 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a9f60408-8566-4920-ae52-e1b3376696f5 tempest-CreateVolumesFromImageTest-1888949505 None] Acquiring lock "cinder-quobyte-68190f86-b62c-4831-9353-9eff6dcc371e" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:14 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-2be7807a-96e4-4610-8696-1226c1b8abd5 tempest-CreateVolumesFromImageTest-1888949505 None] Lock "cinder-bb3dcb75-2e7a-44f5-a68f-235440641430-delete_volume" released by "delete_volume" :: held 1.264s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:14 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a9f60408-8566-4920-ae52-e1b3376696f5 tempest-CreateVolumesFromImageTest-1888949505 None] Lock "cinder-quobyte-68190f86-b62c-4831-9353-9eff6dcc371e" acquired by "delete_volume" :: waited 0.024s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:14 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:14 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-24dc16e9-ab31-4d83-8042-7a56fb08b7fa 1073741824" returned: 0 in 0.555s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:14 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[46952f11-97c4-49da-ab84-ce8521ce2eae]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:14 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a9f60408-8566-4920-ae52-e1b3376696f5 tempest-CreateVolumesFromImageTest-1888949505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-68190f86-b62c-4831-9353-9eff6dcc371e {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:14 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-24dc16e9-ab31-4d83-8042-7a56fb08b7fa {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:14 devstack sudo[106259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-24dc16e9-ab31-4d83-8042-7a56fb08b7fa Nov 03 07:50:14 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:14 devstack sudo[106258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-68190f86-b62c-4831-9353-9eff6dcc371e Nov 03 07:50:14 devstack sudo[106258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:14 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:14 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-24dc16e9-ab31-4d83-8042-7a56fb08b7fa" returned: 0 in 0.369s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:14 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:50:14 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:14 devstack cinder-volume[86875]: DEBUG cinder.volume.volume_utils [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Attempting download of 04892d14-e7a1-4270-a38b-5655c45e4d22 ((None, [{'url': 'file:///opt/stack/data/glance/images/04892d14-e7a1-4270-a38b-5655c45e4d22', 'metadata': {}}])) to volume 24dc16e9-ab31-4d83-8042-7a56fb08b7fa. {{(pid=86875) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 07:50:14 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcd0881d-6d32-42b6-9f5c-644248c30b37 tempest-VolumeDependencyTests-1969615490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:50:14 devstack sudo[106258]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:14 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a9f60408-8566-4920-ae52-e1b3376696f5 tempest-CreateVolumesFromImageTest-1888949505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-68190f86-b62c-4831-9353-9eff6dcc371e" returned: 0 in 0.512s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:14 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a9f60408-8566-4920-ae52-e1b3376696f5 tempest-CreateVolumesFromImageTest-1888949505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-68190f86-b62c-4831-9353-9eff6dcc371e {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:14 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a3128fd-f829-466e-afbd-49c85ec6f747]: (4, 'raw') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:14 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_04892d14-e7a1-4270-a38b-5655c45e4d22_z4hpn_s6 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:14 devstack sudo[106266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-68190f86-b62c-4831-9353-9eff6dcc371e Nov 03 07:50:14 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:14 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-dcd0881d-6d32-42b6-9f5c-644248c30b37 tempest-VolumeDependencyTests-1969615490 None] Flow 'volume_create_manager' (ca3cd867-6916-47cf-95f2-b73ee33ef069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:14 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-dcd0881d-6d32-42b6-9f5c-644248c30b37 tempest-VolumeDependencyTests-1969615490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7217bc6a-1214-494e-a12b-290a39fd66fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:14 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-dcd0881d-6d32-42b6-9f5c-644248c30b37 tempest-VolumeDependencyTests-1969615490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7217bc6a-1214-494e-a12b-290a39fd66fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-227196376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6903590e-9319-4fff-84b7-d5f37f7532cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd4ee36b54e441718771f50f7070f351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=17fe0d43-ec81-4dfb-ac7b-4afb5a40d1e0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:15Z,use_quota=True,user_id='f74c78eb3f3247e0a95fabfbb8c90818',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:14 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-dcd0881d-6d32-42b6-9f5c-644248c30b37 tempest-VolumeDependencyTests-1969615490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (003d4abc-6529-466f-8920-be4bebad4559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:14 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-dcd0881d-6d32-42b6-9f5c-644248c30b37 tempest-VolumeDependencyTests-1969615490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (003d4abc-6529-466f-8920-be4bebad4559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:14 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-dcd0881d-6d32-42b6-9f5c-644248c30b37 tempest-VolumeDependencyTests-1969615490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (069df863-1ac1-417d-b062-d7379299fd03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:14 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-dcd0881d-6d32-42b6-9f5c-644248c30b37 tempest-VolumeDependencyTests-1969615490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (069df863-1ac1-417d-b062-d7379299fd03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6903590e-9319-4fff-84b7-d5f37f7532cf', 'volume_name': 'volume-6903590e-9319-4fff-84b7-d5f37f7532cf', 'volume_size': 1, 'snapshot_id': '17fe0d43-ec81-4dfb-ac7b-4afb5a40d1e0'}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:14 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-dcd0881d-6d32-42b6-9f5c-644248c30b37 tempest-VolumeDependencyTests-1969615490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91f00baa-a89a-48f3-826c-f416872df0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:14 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-dcd0881d-6d32-42b6-9f5c-644248c30b37 tempest-VolumeDependencyTests-1969615490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91f00baa-a89a-48f3-826c-f416872df0a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:14 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-dcd0881d-6d32-42b6-9f5c-644248c30b37 tempest-VolumeDependencyTests-1969615490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f42a73e-ea3c-481a-9a5e-3d8fd7321230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:14 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-dcd0881d-6d32-42b6-9f5c-644248c30b37 tempest-VolumeDependencyTests-1969615490 None] Volume 6903590e-9319-4fff-84b7-d5f37f7532cf: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6903590e-9319-4fff-84b7-d5f37f7532cf', 'volume_size': 1, 'snapshot_id': '17fe0d43-ec81-4dfb-ac7b-4afb5a40d1e0'} Nov 03 07:50:14 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-dcd0881d-6d32-42b6-9f5c-644248c30b37 tempest-VolumeDependencyTests-1969615490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:14 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-dcd0881d-6d32-42b6-9f5c-644248c30b37 tempest-VolumeDependencyTests-1969615490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:14 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-dcd0881d-6d32-42b6-9f5c-644248c30b37 tempest-VolumeDependencyTests-1969615490 None] Acquiring lock "cinder-quobyte-17fe0d43-ec81-4dfb-ac7b-4afb5a40d1e0-6903590e-9319-4fff-84b7-d5f37f7532cf" by "_create_volume_from_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:15 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-dcd0881d-6d32-42b6-9f5c-644248c30b37 tempest-VolumeDependencyTests-1969615490 None] Lock "cinder-quobyte-17fe0d43-ec81-4dfb-ac7b-4afb5a40d1e0-6903590e-9319-4fff-84b7-d5f37f7532cf" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:15 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-dcd0881d-6d32-42b6-9f5c-644248c30b37 tempest-VolumeDependencyTests-1969615490 None] Creating volume 6903590e-9319-4fff-84b7-d5f37f7532cf from snapshot 17fe0d43-ec81-4dfb-ac7b-4afb5a40d1e0 {{(pid=86875) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 07:50:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-dcd0881d-6d32-42b6-9f5c-644248c30b37 tempest-VolumeDependencyTests-1969615490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-dcd0881d-6d32-42b6-9f5c-644248c30b37 tempest-VolumeDependencyTests-1969615490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:15 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-dcd0881d-6d32-42b6-9f5c-644248c30b37 tempest-VolumeDependencyTests-1969615490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:15 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-dcd0881d-6d32-42b6-9f5c-644248c30b37 tempest-VolumeDependencyTests-1969615490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-dcd0881d-6d32-42b6-9f5c-644248c30b37 tempest-VolumeDependencyTests-1969615490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:15 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-dcd0881d-6d32-42b6-9f5c-644248c30b37 tempest-VolumeDependencyTests-1969615490 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:50:15 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-dcd0881d-6d32-42b6-9f5c-644248c30b37 tempest-VolumeDependencyTests-1969615490 None] Acquiring lock "cinder-quobyte-6903590e-9319-4fff-84b7-d5f37f7532cf" by "_copy_volume_from_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:15 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-dcd0881d-6d32-42b6-9f5c-644248c30b37 tempest-VolumeDependencyTests-1969615490 None] Lock "cinder-quobyte-6903590e-9319-4fff-84b7-d5f37f7532cf" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:15 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-dcd0881d-6d32-42b6-9f5c-644248c30b37 tempest-VolumeDependencyTests-1969615490 None] snapshot: 17fe0d43-ec81-4dfb-ac7b-4afb5a40d1e0, volume: 6903590e-9319-4fff-84b7-d5f37f7532cf, {{(pid=86875) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 07:50:15 devstack sudo[106267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_04892d14-e7a1-4270-a38b-5655c45e4d22_z4hpn_s6 Nov 03 07:50:15 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-dcd0881d-6d32-42b6-9f5c-644248c30b37 tempest-VolumeDependencyTests-1969615490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-dcd0881d-6d32-42b6-9f5c-644248c30b37 tempest-VolumeDependencyTests-1969615490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:15 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-dcd0881d-6d32-42b6-9f5c-644248c30b37 tempest-VolumeDependencyTests-1969615490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:15 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-dcd0881d-6d32-42b6-9f5c-644248c30b37 tempest-VolumeDependencyTests-1969615490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-dcd0881d-6d32-42b6-9f5c-644248c30b37 tempest-VolumeDependencyTests-1969615490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:15 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5507794-90af-4197-af36-3db4ada4a70b]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-dcd0881d-6d32-42b6-9f5c-644248c30b37 tempest-VolumeDependencyTests-1969615490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ff15a29f-c8df-4880-9a2b-43e4537ea992.17fe0d43-ec81-4dfb-ac7b-4afb5a40d1e0 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:15 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a9f60408-8566-4920-ae52-e1b3376696f5 tempest-CreateVolumesFromImageTest-1888949505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-68190f86-b62c-4831-9353-9eff6dcc371e" returned: 0 in 0.276s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:15 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a9f60408-8566-4920-ae52-e1b3376696f5 tempest-CreateVolumesFromImageTest-1888949505 None] Lock "cinder-quobyte-68190f86-b62c-4831-9353-9eff6dcc371e" released by "delete_volume" :: held 0.847s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:15 devstack sudo[106271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ff15a29f-c8df-4880-9a2b-43e4537ea992.17fe0d43-ec81-4dfb-ac7b-4afb5a40d1e0 Nov 03 07:50:15 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:15 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-a9f60408-8566-4920-ae52-e1b3376696f5 tempest-CreateVolumesFromImageTest-1888949505 None] Created reservations ['7bd6a449-4d53-4462-b019-8eb0907b671a', '6aae8a0c-7bc7-4e08-bfbd-3835662f3ec3', '8b2fe7fc-3f70-4356-8746-45f1a28d87ac', '03dc248b-5f57-464d-8673-eb5d4d0fd4ef'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:50:15 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a9f60408-8566-4920-ae52-e1b3376696f5 tempest-CreateVolumesFromImageTest-1888949505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a9f60408-8566-4920-ae52-e1b3376696f5 tempest-CreateVolumesFromImageTest-1888949505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:15 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a9f60408-8566-4920-ae52-e1b3376696f5 tempest-CreateVolumesFromImageTest-1888949505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:15 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a9f60408-8566-4920-ae52-e1b3376696f5 tempest-CreateVolumesFromImageTest-1888949505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a9f60408-8566-4920-ae52-e1b3376696f5 tempest-CreateVolumesFromImageTest-1888949505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a9f60408-8566-4920-ae52-e1b3376696f5 tempest-CreateVolumesFromImageTest-1888949505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_04892d14-e7a1-4270-a38b-5655c45e4d22_z4hpn_s6" returned: 0 in 0.458s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04892d14-e7a1-4270-a38b-5655c45e4d22_z4hpn_s6 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:15 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:50:15 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:15 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a67afef3-8ef8-473a-a04c-0e277684b3f6 tempest-CreateVolumesFromImageTest-1888949505 None] Acquiring lock "cinder-99ff2d8b-d460-49a5-8870-b3cb303f4757-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:15 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a67afef3-8ef8-473a-a04c-0e277684b3f6 tempest-CreateVolumesFromImageTest-1888949505 None] Lock "cinder-99ff2d8b-d460-49a5-8870-b3cb303f4757-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:15 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a67afef3-8ef8-473a-a04c-0e277684b3f6 tempest-CreateVolumesFromImageTest-1888949505 None] Acquiring lock "cinder-quobyte-99ff2d8b-d460-49a5-8870-b3cb303f4757" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:15 devstack sudo[106276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04892d14-e7a1-4270-a38b-5655c45e4d22_z4hpn_s6 Nov 03 07:50:15 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a67afef3-8ef8-473a-a04c-0e277684b3f6 tempest-CreateVolumesFromImageTest-1888949505 None] Lock "cinder-quobyte-99ff2d8b-d460-49a5-8870-b3cb303f4757" acquired by "delete_volume" :: waited 0.016s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:15 devstack sudo[106276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:15 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ac97d9-b397-4357-936b-65624898ff64]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a67afef3-8ef8-473a-a04c-0e277684b3f6 tempest-CreateVolumesFromImageTest-1888949505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-99ff2d8b-d460-49a5-8870-b3cb303f4757 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:15 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-dcd0881d-6d32-42b6-9f5c-644248c30b37 tempest-VolumeDependencyTests-1969615490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ff15a29f-c8df-4880-9a2b-43e4537ea992.17fe0d43-ec81-4dfb-ac7b-4afb5a40d1e0" returned: 0 in 0.526s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:15 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-dcd0881d-6d32-42b6-9f5c-644248c30b37 tempest-VolumeDependencyTests-1969615490 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff15a29f-c8df-4880-9a2b-43e4537ea992(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:50:15 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c0eb1e-f549-4a71-aa29-3c542317a0bf]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-dcd0881d-6d32-42b6-9f5c-644248c30b37 tempest-VolumeDependencyTests-1969615490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ff15a29f-c8df-4880-9a2b-43e4537ea992 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:15 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a9f60408-8566-4920-ae52-e1b3376696f5 tempest-CreateVolumesFromImageTest-1888949505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.350s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:15 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-a9f60408-8566-4920-ae52-e1b3376696f5 tempest-CreateVolumesFromImageTest-1888949505 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:50:15 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-a9f60408-8566-4920-ae52-e1b3376696f5 tempest-CreateVolumesFromImageTest-1888949505 None] Deleted volume successfully. Nov 03 07:50:15 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a9f60408-8566-4920-ae52-e1b3376696f5 tempest-CreateVolumesFromImageTest-1888949505 None] Lock "cinder-68190f86-b62c-4831-9353-9eff6dcc371e-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:15 devstack sudo[106282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-99ff2d8b-d460-49a5-8870-b3cb303f4757 Nov 03 07:50:15 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:15 devstack sudo[106284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ff15a29f-c8df-4880-9a2b-43e4537ea992 Nov 03 07:50:15 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:15 devstack sudo[106276]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04892d14-e7a1-4270-a38b-5655c45e4d22_z4hpn_s6" returned: 1 in 0.485s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04892d14-e7a1-4270-a38b-5655c45e4d22_z4hpn_s6' failed. Not Retrying. {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:50:15 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d119cb-9a82-4955-b9bd-b5c9d4684a3d]: (4, 'raw') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_04892d14-e7a1-4270-a38b-5655c45e4d22_oznecww7devstack@QuobyteHD {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:15 devstack sudo[106289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_04892d14-e7a1-4270-a38b-5655c45e4d22_oznecww7devstack@QuobyteHD Nov 03 07:50:15 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:16 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a67afef3-8ef8-473a-a04c-0e277684b3f6 tempest-CreateVolumesFromImageTest-1888949505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-99ff2d8b-d460-49a5-8870-b3cb303f4757" returned: 0 in 0.488s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a67afef3-8ef8-473a-a04c-0e277684b3f6 tempest-CreateVolumesFromImageTest-1888949505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-99ff2d8b-d460-49a5-8870-b3cb303f4757 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:16 devstack sudo[106297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-99ff2d8b-d460-49a5-8870-b3cb303f4757 Nov 03 07:50:16 devstack sudo[106297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:16 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-dcd0881d-6d32-42b6-9f5c-644248c30b37 tempest-VolumeDependencyTests-1969615490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ff15a29f-c8df-4880-9a2b-43e4537ea992" returned: 0 in 0.499s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:16 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-dcd0881d-6d32-42b6-9f5c-644248c30b37 tempest-VolumeDependencyTests-1969615490 None] will copy from snapshot at /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ff15a29f-c8df-4880-9a2b-43e4537ea992 {{(pid=86875) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 07:50:16 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-dcd0881d-6d32-42b6-9f5c-644248c30b37 tempest-VolumeDependencyTests-1969615490 None] Creating direct copy from snapshot {{(pid=86875) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 07:50:16 devstack cinder-volume[86875]: DEBUG cinder.utils [None req-dcd0881d-6d32-42b6-9f5c-644248c30b37 tempest-VolumeDependencyTests-1969615490 None] Path /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6903590e-9319-4fff-84b7-d5f37f7532cf not found in is_blk_device check {{(pid=86875) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 07:50:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-dcd0881d-6d32-42b6-9f5c-644248c30b37 tempest-VolumeDependencyTests-1969615490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ff15a29f-c8df-4880-9a2b-43e4537ea992 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6903590e-9319-4fff-84b7-d5f37f7532cf {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:16 devstack sudo[106300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ff15a29f-c8df-4880-9a2b-43e4537ea992 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6903590e-9319-4fff-84b7-d5f37f7532cf Nov 03 07:50:16 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:16 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_04892d14-e7a1-4270-a38b-5655c45e4d22_oznecww7devstack@QuobyteHD" returned: 0 in 0.403s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04892d14-e7a1-4270-a38b-5655c45e4d22_oznecww7devstack@QuobyteHD {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:16 devstack sudo[106297]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a67afef3-8ef8-473a-a04c-0e277684b3f6 tempest-CreateVolumesFromImageTest-1888949505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-99ff2d8b-d460-49a5-8870-b3cb303f4757" returned: 0 in 0.348s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:16 devstack sudo[106304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04892d14-e7a1-4270-a38b-5655c45e4d22_oznecww7devstack@QuobyteHD Nov 03 07:50:16 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:16 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a67afef3-8ef8-473a-a04c-0e277684b3f6 tempest-CreateVolumesFromImageTest-1888949505 None] Lock "cinder-quobyte-99ff2d8b-d460-49a5-8870-b3cb303f4757" released by "delete_volume" :: held 0.907s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:16 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-a67afef3-8ef8-473a-a04c-0e277684b3f6 tempest-CreateVolumesFromImageTest-1888949505 None] Created reservations ['84a9774a-5ef8-4f31-8b87-cc5cc1e48f37', '18a788e0-f8db-4781-b991-8a414af87923', 'd8c12c5a-02bd-4003-99a3-909dd3bb63cd', '8d226dac-764e-47ce-9281-6fcc4aba947d'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:50:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a67afef3-8ef8-473a-a04c-0e277684b3f6 tempest-CreateVolumesFromImageTest-1888949505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a67afef3-8ef8-473a-a04c-0e277684b3f6 tempest-CreateVolumesFromImageTest-1888949505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:16 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a67afef3-8ef8-473a-a04c-0e277684b3f6 tempest-CreateVolumesFromImageTest-1888949505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:16 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a67afef3-8ef8-473a-a04c-0e277684b3f6 tempest-CreateVolumesFromImageTest-1888949505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a67afef3-8ef8-473a-a04c-0e277684b3f6 tempest-CreateVolumesFromImageTest-1888949505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a67afef3-8ef8-473a-a04c-0e277684b3f6 tempest-CreateVolumesFromImageTest-1888949505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:16 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:50:16 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:16 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-059e4bd4-5282-47d4-bc58-2f0b406cec27 tempest-CreateVolumesFromImageTest-1888949505 None] Acquiring lock "cinder-f134d2c2-b3d6-452e-b104-68baae4eef1e-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:16 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-059e4bd4-5282-47d4-bc58-2f0b406cec27 tempest-CreateVolumesFromImageTest-1888949505 None] Lock "cinder-f134d2c2-b3d6-452e-b104-68baae4eef1e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:16 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04892d14-e7a1-4270-a38b-5655c45e4d22_oznecww7devstack@QuobyteHD" returned: 1 in 0.594s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04892d14-e7a1-4270-a38b-5655c45e4d22_oznecww7devstack@QuobyteHD' failed. Not Retrying. {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:50:16 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] 04892d14-e7a1-4270-a38b-5655c45e4d22 was raw, converting to qcow2 {{(pid=86875) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 07:50:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_04892d14-e7a1-4270-a38b-5655c45e4d22_oznecww7devstack@QuobyteHD /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-24dc16e9-ab31-4d83-8042-7a56fb08b7fa {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:16 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-059e4bd4-5282-47d4-bc58-2f0b406cec27 tempest-CreateVolumesFromImageTest-1888949505 None] Acquiring lock "cinder-quobyte-f134d2c2-b3d6-452e-b104-68baae4eef1e" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:16 devstack sudo[106317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_04892d14-e7a1-4270-a38b-5655c45e4d22_oznecww7devstack@QuobyteHD /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-24dc16e9-ab31-4d83-8042-7a56fb08b7fa Nov 03 07:50:16 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:16 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-059e4bd4-5282-47d4-bc58-2f0b406cec27 tempest-CreateVolumesFromImageTest-1888949505 None] Lock "cinder-quobyte-f134d2c2-b3d6-452e-b104-68baae4eef1e" acquired by "delete_volume" :: waited 0.030s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:16 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5072351-2de7-4f24-8dee-7637b49498b8]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-059e4bd4-5282-47d4-bc58-2f0b406cec27 tempest-CreateVolumesFromImageTest-1888949505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f134d2c2-b3d6-452e-b104-68baae4eef1e {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:17 devstack sudo[106322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f134d2c2-b3d6-452e-b104-68baae4eef1e Nov 03 07:50:17 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:17 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a67afef3-8ef8-473a-a04c-0e277684b3f6 tempest-CreateVolumesFromImageTest-1888949505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.669s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:17 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-a67afef3-8ef8-473a-a04c-0e277684b3f6 tempest-CreateVolumesFromImageTest-1888949505 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:50:17 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-a67afef3-8ef8-473a-a04c-0e277684b3f6 tempest-CreateVolumesFromImageTest-1888949505 None] Deleted volume successfully. Nov 03 07:50:17 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a67afef3-8ef8-473a-a04c-0e277684b3f6 tempest-CreateVolumesFromImageTest-1888949505 None] Lock "cinder-99ff2d8b-d460-49a5-8870-b3cb303f4757-delete_volume" released by "delete_volume" :: held 1.851s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:17 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-059e4bd4-5282-47d4-bc58-2f0b406cec27 tempest-CreateVolumesFromImageTest-1888949505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f134d2c2-b3d6-452e-b104-68baae4eef1e" returned: 0 in 0.625s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-059e4bd4-5282-47d4-bc58-2f0b406cec27 tempest-CreateVolumesFromImageTest-1888949505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f134d2c2-b3d6-452e-b104-68baae4eef1e {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:17 devstack sudo[106337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f134d2c2-b3d6-452e-b104-68baae4eef1e Nov 03 07:50:17 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:17 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_04892d14-e7a1-4270-a38b-5655c45e4d22_oznecww7devstack@QuobyteHD /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-24dc16e9-ab31-4d83-8042-7a56fb08b7fa" returned: 0 in 1.151s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:18 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_04892d14-e7a1-4270-a38b-5655c45e4d22_oznecww7devstack@QuobyteHD, size 0.00 MB, duration 1.15 sec, destination /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-24dc16e9-ab31-4d83-8042-7a56fb08b7fa {{(pid=86875) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:50:18 devstack cinder-volume[86875]: INFO cinder.image.image_utils [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Converted 0.00 MB image at 0.00 MB/s Nov 03 07:50:18 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-24dc16e9-ab31-4d83-8042-7a56fb08b7fa 1G {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:18 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:18 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-059e4bd4-5282-47d4-bc58-2f0b406cec27 tempest-CreateVolumesFromImageTest-1888949505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-f134d2c2-b3d6-452e-b104-68baae4eef1e" returned: 0 in 0.434s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:18 devstack sudo[106343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-24dc16e9-ab31-4d83-8042-7a56fb08b7fa 1G Nov 03 07:50:18 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:18 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-059e4bd4-5282-47d4-bc58-2f0b406cec27 tempest-CreateVolumesFromImageTest-1888949505 None] Lock "cinder-quobyte-f134d2c2-b3d6-452e-b104-68baae4eef1e" released by "delete_volume" :: held 1.181s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:18 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-059e4bd4-5282-47d4-bc58-2f0b406cec27 tempest-CreateVolumesFromImageTest-1888949505 None] Created reservations ['07932258-5528-4461-a043-3b22ceaf9b69', '041ed1b9-c822-4434-902d-6980a1a099df', 'd215b6b3-42b7-49d0-b443-7d64b8fb483c', '14ab152e-7bcd-4e9f-8189-ef2fe7f60dfe'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:50:18 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-059e4bd4-5282-47d4-bc58-2f0b406cec27 tempest-CreateVolumesFromImageTest-1888949505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:18 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-059e4bd4-5282-47d4-bc58-2f0b406cec27 tempest-CreateVolumesFromImageTest-1888949505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:18 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-059e4bd4-5282-47d4-bc58-2f0b406cec27 tempest-CreateVolumesFromImageTest-1888949505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:18 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-059e4bd4-5282-47d4-bc58-2f0b406cec27 tempest-CreateVolumesFromImageTest-1888949505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:18 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-059e4bd4-5282-47d4-bc58-2f0b406cec27 tempest-CreateVolumesFromImageTest-1888949505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:18 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-059e4bd4-5282-47d4-bc58-2f0b406cec27 tempest-CreateVolumesFromImageTest-1888949505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:18 devstack sudo[106346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:50:18 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:18 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:18 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-24dc16e9-ab31-4d83-8042-7a56fb08b7fa 1G" returned: 0 in 0.886s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:18 devstack cinder-volume[86875]: DEBUG cinder.volume.volume_utils [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Downloaded image 04892d14-e7a1-4270-a38b-5655c45e4d22 ((None, [{'url': 'file:///opt/stack/data/glance/images/04892d14-e7a1-4270-a38b-5655c45e4d22', 'metadata': {}}])) to volume 24dc16e9-ab31-4d83-8042-7a56fb08b7fa successfully. {{(pid=86875) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 07:50:18 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Temporary image 04892d14-e7a1-4270-a38b-5655c45e4d22 for user 3cdf2ad6a5454c34ae1a0e12b4688e78 is deleted. {{(pid=86875) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 07:50:18 devstack cinder-volume[86875]: DEBUG cinder.volume.volume_utils [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Marking volume 24dc16e9-ab31-4d83-8042-7a56fb08b7fa as bootable. {{(pid=86875) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 07:50:18 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Copying metadata from image 04892d14-e7a1-4270-a38b-5655c45e4d22 to 24dc16e9-ab31-4d83-8042-7a56fb08b7fa. {{(pid=86875) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 07:50:18 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Creating volume glance metadata for volume 24dc16e9-ab31-4d83-8042-7a56fb08b7fa backed by image 04892d14-e7a1-4270-a38b-5655c45e4d22 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '04892d14-e7a1-4270-a38b-5655c45e4d22', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '70fe5695b53370b4fd67b168d45095a7', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86875) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 07:50:19 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:19 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-059e4bd4-5282-47d4-bc58-2f0b406cec27 tempest-CreateVolumesFromImageTest-1888949505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.645s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:19 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-059e4bd4-5282-47d4-bc58-2f0b406cec27 tempest-CreateVolumesFromImageTest-1888949505 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:50:19 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-059e4bd4-5282-47d4-bc58-2f0b406cec27 tempest-CreateVolumesFromImageTest-1888949505 None] Deleted volume successfully. Nov 03 07:50:19 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-059e4bd4-5282-47d4-bc58-2f0b406cec27 tempest-CreateVolumesFromImageTest-1888949505 None] Lock "cinder-f134d2c2-b3d6-452e-b104-68baae4eef1e-delete_volume" released by "delete_volume" :: held 2.404s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:19 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cad6def1-4cb5-4c50-9ef1-a2bf94dc0b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24dc16e9-ab31-4d83-8042-7a56fb08b7fa', 'volume_size': 1, 'image_id': '04892d14-e7a1-4270-a38b-5655c45e4d22', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/04892d14-e7a1-4270-a38b-5655c45e4d22', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '70fe5695b53370b4fd67b168d45095a7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b1b809cb231346788a35642edf0f82da', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '79a1645dc7c93083f02d94c5dca4d7770d680b7a6f8758a987faddf39213cd14d5f5b615cfffaf196e95607d9c92a9fdf16c3b67e5e4a321c9da87f69e61081c', 'id': '04892d14-e7a1-4270-a38b-5655c45e4d22', 'created_at': datetime.datetime(2026, 11, 3, 6, 50, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 50, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/04892d14-e7a1-4270-a38b-5655c45e4d22/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:19 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11269946-82f9-48e4-a01c-f6891c04ddc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:19 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Volume volume-24dc16e9-ab31-4d83-8042-7a56fb08b7fa (24dc16e9-ab31-4d83-8042-7a56fb08b7fa): created successfully Nov 03 07:50:19 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11269946-82f9-48e4-a01c-f6891c04ddc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:19 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Flow 'volume_create_manager' (10a29196-f4ea-42be-8ca1-23fcc453fa3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:19 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-707caaab-300e-4768-8925-2dc5bdc18949 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Created volume successfully. Nov 03 07:50:20 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-6cd6036b-1f9f-4838-ac5b-78a10b58b691 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Acquiring lock "cinder-24dc16e9-ab31-4d83-8042-7a56fb08b7fa-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:20 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-6cd6036b-1f9f-4838-ac5b-78a10b58b691 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Lock "cinder-24dc16e9-ab31-4d83-8042-7a56fb08b7fa-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:20 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-6cd6036b-1f9f-4838-ac5b-78a10b58b691 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Acquiring lock "cinder-quobyte-24dc16e9-ab31-4d83-8042-7a56fb08b7fa" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:20 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-6cd6036b-1f9f-4838-ac5b-78a10b58b691 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Lock "cinder-quobyte-24dc16e9-ab31-4d83-8042-7a56fb08b7fa" acquired by "delete_volume" :: waited 0.040s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:20 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef107c2-442d-4779-b2c6-2d68d17d248e]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6cd6036b-1f9f-4838-ac5b-78a10b58b691 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-24dc16e9-ab31-4d83-8042-7a56fb08b7fa {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:21 devstack sudo[106357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-24dc16e9-ab31-4d83-8042-7a56fb08b7fa Nov 03 07:50:21 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:21 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6cd6036b-1f9f-4838-ac5b-78a10b58b691 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-24dc16e9-ab31-4d83-8042-7a56fb08b7fa" returned: 0 in 0.712s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6cd6036b-1f9f-4838-ac5b-78a10b58b691 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-24dc16e9-ab31-4d83-8042-7a56fb08b7fa {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:21 devstack sudo[106362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-24dc16e9-ab31-4d83-8042-7a56fb08b7fa Nov 03 07:50:21 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:22 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6cd6036b-1f9f-4838-ac5b-78a10b58b691 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-24dc16e9-ab31-4d83-8042-7a56fb08b7fa" returned: 0 in 0.546s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:22 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-6cd6036b-1f9f-4838-ac5b-78a10b58b691 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Lock "cinder-quobyte-24dc16e9-ab31-4d83-8042-7a56fb08b7fa" released by "delete_volume" :: held 1.379s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:22 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-6cd6036b-1f9f-4838-ac5b-78a10b58b691 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Created reservations ['1bcedbe6-bc95-406d-8c9a-a3088ce4ef43', 'b12474c4-9e74-464d-8870-410a4db9e694', '25b5877f-3891-4a46-800b-329743910a31', 'a6849607-bebf-4801-87b4-e91354e82898'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:50:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-6cd6036b-1f9f-4838-ac5b-78a10b58b691 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-6cd6036b-1f9f-4838-ac5b-78a10b58b691 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:22 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-6cd6036b-1f9f-4838-ac5b-78a10b58b691 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:22 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-6cd6036b-1f9f-4838-ac5b-78a10b58b691 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-6cd6036b-1f9f-4838-ac5b-78a10b58b691 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6cd6036b-1f9f-4838-ac5b-78a10b58b691 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:22 devstack sudo[106366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:50:22 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:22 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a74d983-bedf-4edd-adbd-4502c0a24cd2 tempest-ProjectReaderTests-502528571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:50:22 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-1a74d983-bedf-4edd-adbd-4502c0a24cd2 tempest-ProjectReaderTests-502528571 None] Flow 'volume_create_manager' (75f6fa82-bed6-4e37-920c-1e5fa36dfab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:22 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-1a74d983-bedf-4edd-adbd-4502c0a24cd2 tempest-ProjectReaderTests-502528571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc9003ce-96e8-42e6-b40c-939d14591cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:22 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-1a74d983-bedf-4edd-adbd-4502c0a24cd2 tempest-ProjectReaderTests-502528571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc9003ce-96e8-42e6-b40c-939d14591cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-525984823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dafe1d2b-9c4e-49d4-be93-5f11817b2e7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8add37b5fee54b3b86fd2c461f733a93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:23Z,use_quota=True,user_id='f6a2a55bfa844c998456e9021f775e22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:22 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-1a74d983-bedf-4edd-adbd-4502c0a24cd2 tempest-ProjectReaderTests-502528571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b61a02a0-fbc7-4f23-ae7f-a53889a25c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:22 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-1a74d983-bedf-4edd-adbd-4502c0a24cd2 tempest-ProjectReaderTests-502528571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b61a02a0-fbc7-4f23-ae7f-a53889a25c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:22 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-1a74d983-bedf-4edd-adbd-4502c0a24cd2 tempest-ProjectReaderTests-502528571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd2b90e2-0752-4b37-9a50-c310ddb4ddc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:23 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-1a74d983-bedf-4edd-adbd-4502c0a24cd2 tempest-ProjectReaderTests-502528571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd2b90e2-0752-4b37-9a50-c310ddb4ddc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dafe1d2b-9c4e-49d4-be93-5f11817b2e7d', 'volume_name': 'volume-dafe1d2b-9c4e-49d4-be93-5f11817b2e7d', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:23 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-1a74d983-bedf-4edd-adbd-4502c0a24cd2 tempest-ProjectReaderTests-502528571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a911f1ae-ba29-48d2-9002-addf22b718ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:23 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-1a74d983-bedf-4edd-adbd-4502c0a24cd2 tempest-ProjectReaderTests-502528571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a911f1ae-ba29-48d2-9002-addf22b718ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:23 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-1a74d983-bedf-4edd-adbd-4502c0a24cd2 tempest-ProjectReaderTests-502528571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0b90732-23e3-4331-8504-169cb44761ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:23 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-1a74d983-bedf-4edd-adbd-4502c0a24cd2 tempest-ProjectReaderTests-502528571 None] Volume dafe1d2b-9c4e-49d4-be93-5f11817b2e7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dafe1d2b-9c4e-49d4-be93-5f11817b2e7d', 'volume_size': 1} Nov 03 07:50:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-1a74d983-bedf-4edd-adbd-4502c0a24cd2 tempest-ProjectReaderTests-502528571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:23 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6cd6036b-1f9f-4838-ac5b-78a10b58b691 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.637s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:23 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-6cd6036b-1f9f-4838-ac5b-78a10b58b691 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:50:23 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-6cd6036b-1f9f-4838-ac5b-78a10b58b691 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Deleted volume successfully. Nov 03 07:50:23 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-6cd6036b-1f9f-4838-ac5b-78a10b58b691 tempest-VolumeAndVolumeTypeFromImageTest-1381821802 None] Lock "cinder-24dc16e9-ab31-4d83-8042-7a56fb08b7fa-delete_volume" released by "delete_volume" :: held 2.509s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:25 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-dcd0881d-6d32-42b6-9f5c-644248c30b37 tempest-VolumeDependencyTests-1969615490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ff15a29f-c8df-4880-9a2b-43e4537ea992 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6903590e-9319-4fff-84b7-d5f37f7532cf" returned: 0 in 8.928s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:25 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-dcd0881d-6d32-42b6-9f5c-644248c30b37 tempest-VolumeDependencyTests-1969615490 None] Image conversion details: src /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ff15a29f-c8df-4880-9a2b-43e4537ea992, size 1024.00 MB, duration 8.93 sec, destination /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6903590e-9319-4fff-84b7-d5f37f7532cf {{(pid=86875) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:50:25 devstack cinder-volume[86875]: INFO cinder.image.image_utils [None req-dcd0881d-6d32-42b6-9f5c-644248c30b37 tempest-VolumeDependencyTests-1969615490 None] Converted 1024.00 MB image at 114.69 MB/s Nov 03 07:50:25 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-dcd0881d-6d32-42b6-9f5c-644248c30b37 tempest-VolumeDependencyTests-1969615490 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6903590e-9319-4fff-84b7-d5f37f7532cf is being set with open permissions: ugo+rw Nov 03 07:50:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-dcd0881d-6d32-42b6-9f5c-644248c30b37 tempest-VolumeDependencyTests-1969615490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6903590e-9319-4fff-84b7-d5f37f7532cf {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:25 devstack sudo[106369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6903590e-9319-4fff-84b7-d5f37f7532cf Nov 03 07:50:25 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:25 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-dcd0881d-6d32-42b6-9f5c-644248c30b37 tempest-VolumeDependencyTests-1969615490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6903590e-9319-4fff-84b7-d5f37f7532cf" returned: 0 in 0.262s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:25 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-dcd0881d-6d32-42b6-9f5c-644248c30b37 tempest-VolumeDependencyTests-1969615490 None] Lock "cinder-quobyte-6903590e-9319-4fff-84b7-d5f37f7532cf" released by "_copy_volume_from_snapshot" :: held 10.334s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:25 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-dcd0881d-6d32-42b6-9f5c-644248c30b37 tempest-VolumeDependencyTests-1969615490 None] Lock "cinder-quobyte-17fe0d43-ec81-4dfb-ac7b-4afb5a40d1e0-6903590e-9319-4fff-84b7-d5f37f7532cf" released by "_create_volume_from_snapshot" :: held 10.402s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-dcd0881d-6d32-42b6-9f5c-644248c30b37 tempest-VolumeDependencyTests-1969615490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.426s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-1a74d983-bedf-4edd-adbd-4502c0a24cd2 tempest-ProjectReaderTests-502528571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.365s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:25 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-1a74d983-bedf-4edd-adbd-4502c0a24cd2 tempest-ProjectReaderTests-502528571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-525984823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dafe1d2b-9c4e-49d4-be93-5f11817b2e7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8add37b5fee54b3b86fd2c461f733a93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:23Z,use_quota=True,user_id='f6a2a55bfa844c998456e9021f775e22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:50:25 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-1a74d983-bedf-4edd-adbd-4502c0a24cd2 tempest-ProjectReaderTests-502528571 None] Creating volume dafe1d2b-9c4e-49d4-be93-5f11817b2e7d {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:50:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-1a74d983-bedf-4edd-adbd-4502c0a24cd2 tempest-ProjectReaderTests-502528571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-1a74d983-bedf-4edd-adbd-4502c0a24cd2 tempest-ProjectReaderTests-502528571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:25 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-1a74d983-bedf-4edd-adbd-4502c0a24cd2 tempest-ProjectReaderTests-502528571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:25 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-1a74d983-bedf-4edd-adbd-4502c0a24cd2 tempest-ProjectReaderTests-502528571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-1a74d983-bedf-4edd-adbd-4502c0a24cd2 tempest-ProjectReaderTests-502528571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:25 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-1a74d983-bedf-4edd-adbd-4502c0a24cd2 tempest-ProjectReaderTests-502528571 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:50:25 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-1a74d983-bedf-4edd-adbd-4502c0a24cd2 tempest-ProjectReaderTests-502528571 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:50:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1a74d983-bedf-4edd-adbd-4502c0a24cd2 tempest-ProjectReaderTests-502528571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-dafe1d2b-9c4e-49d4-be93-5f11817b2e7d 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:25 devstack sudo[106372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-dafe1d2b-9c4e-49d4-be93-5f11817b2e7d 1073741824 Nov 03 07:50:25 devstack sudo[106372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:25 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-dcd0881d-6d32-42b6-9f5c-644248c30b37 tempest-VolumeDependencyTests-1969615490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f42a73e-ea3c-481a-9a5e-3d8fd7321230) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6903590e-9319-4fff-84b7-d5f37f7532cf', 'volume_size': 1, 'snapshot_id': '17fe0d43-ec81-4dfb-ac7b-4afb5a40d1e0'}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:25 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-dcd0881d-6d32-42b6-9f5c-644248c30b37 tempest-VolumeDependencyTests-1969615490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (270ded13-e6fb-45b8-835b-50ad4a168c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:25 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-dcd0881d-6d32-42b6-9f5c-644248c30b37 tempest-VolumeDependencyTests-1969615490 None] Volume volume-6903590e-9319-4fff-84b7-d5f37f7532cf (6903590e-9319-4fff-84b7-d5f37f7532cf): created successfully Nov 03 07:50:25 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-dcd0881d-6d32-42b6-9f5c-644248c30b37 tempest-VolumeDependencyTests-1969615490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (270ded13-e6fb-45b8-835b-50ad4a168c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:25 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-dcd0881d-6d32-42b6-9f5c-644248c30b37 tempest-VolumeDependencyTests-1969615490 None] Flow 'volume_create_manager' (ca3cd867-6916-47cf-95f2-b73ee33ef069) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:25 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-dcd0881d-6d32-42b6-9f5c-644248c30b37 tempest-VolumeDependencyTests-1969615490 None] Created volume successfully. Nov 03 07:50:25 devstack sudo[106372]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1a74d983-bedf-4edd-adbd-4502c0a24cd2 tempest-ProjectReaderTests-502528571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-dafe1d2b-9c4e-49d4-be93-5f11817b2e7d 1073741824" returned: 0 in 0.577s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:26 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-926f9ae1-384d-4df2-beae-9e894216d3f1 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:50:26 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-926f9ae1-384d-4df2-beae-9e894216d3f1 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Flow 'volume_create_manager' (f48e7b4a-f97b-45a0-92f3-f543e773ab3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:26 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-926f9ae1-384d-4df2-beae-9e894216d3f1 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (977b1394-b21b-4a7d-a936-b4d7e69ede7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:26 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-926f9ae1-384d-4df2-beae-9e894216d3f1 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (977b1394-b21b-4a7d-a936-b4d7e69ede7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1308104416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e72f94b1-f1db-4742-8b98-7b77499b6d0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb1730d50a9249af9db23fb7e793a2f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:26Z,use_quota=True,user_id='f21b7781126a4a6d8c5c58a237a6395e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:26 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-926f9ae1-384d-4df2-beae-9e894216d3f1 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (794334ce-080d-4ab0-b120-43e5f20f62c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:26 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-926f9ae1-384d-4df2-beae-9e894216d3f1 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (794334ce-080d-4ab0-b120-43e5f20f62c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:26 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-926f9ae1-384d-4df2-beae-9e894216d3f1 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6f64a28-037e-4148-96ba-622baf2b1e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:26 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-926f9ae1-384d-4df2-beae-9e894216d3f1 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6f64a28-037e-4148-96ba-622baf2b1e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e72f94b1-f1db-4742-8b98-7b77499b6d0f', 'volume_name': 'volume-e72f94b1-f1db-4742-8b98-7b77499b6d0f', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:26 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-926f9ae1-384d-4df2-beae-9e894216d3f1 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ea4ee89-6447-478b-bdb5-0b29efbd06f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:26 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-926f9ae1-384d-4df2-beae-9e894216d3f1 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ea4ee89-6447-478b-bdb5-0b29efbd06f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:26 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-926f9ae1-384d-4df2-beae-9e894216d3f1 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (113cc9e7-6e32-44ab-b39b-b4e9ae8afe9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:26 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-926f9ae1-384d-4df2-beae-9e894216d3f1 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Volume e72f94b1-f1db-4742-8b98-7b77499b6d0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e72f94b1-f1db-4742-8b98-7b77499b6d0f', 'volume_size': 1} Nov 03 07:50:26 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-926f9ae1-384d-4df2-beae-9e894216d3f1 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:26 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-c1d9fe4a-f886-41c1-8ad7-d119479b0af4 tempest-VolumeDependencyTests-1969615490 None] Acquiring lock "cinder-17fe0d43-ec81-4dfb-ac7b-4afb5a40d1e0-delete_snapshot" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:26 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-c1d9fe4a-f886-41c1-8ad7-d119479b0af4 tempest-VolumeDependencyTests-1969615490 None] Lock "cinder-17fe0d43-ec81-4dfb-ac7b-4afb5a40d1e0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:26 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-c1d9fe4a-f886-41c1-8ad7-d119479b0af4 tempest-VolumeDependencyTests-1969615490 None] Acquiring lock "cinder-quobyte-ff15a29f-c8df-4880-9a2b-43e4537ea992" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:26 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1a74d983-bedf-4edd-adbd-4502c0a24cd2 tempest-ProjectReaderTests-502528571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-dafe1d2b-9c4e-49d4-be93-5f11817b2e7d {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:26 devstack sudo[106378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-dafe1d2b-9c4e-49d4-be93-5f11817b2e7d Nov 03 07:50:26 devstack sudo[106378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:26 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-c1d9fe4a-f886-41c1-8ad7-d119479b0af4 tempest-VolumeDependencyTests-1969615490 None] Lock "cinder-quobyte-ff15a29f-c8df-4880-9a2b-43e4537ea992" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:26 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-c1d9fe4a-f886-41c1-8ad7-d119479b0af4 tempest-VolumeDependencyTests-1969615490 None] Acquiring lock "cinder-quobyte-17fe0d43-ec81-4dfb-ac7b-4afb5a40d1e0" by "_delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:26 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-c1d9fe4a-f886-41c1-8ad7-d119479b0af4 tempest-VolumeDependencyTests-1969615490 None] Lock "cinder-quobyte-17fe0d43-ec81-4dfb-ac7b-4afb5a40d1e0" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:26 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-c1d9fe4a-f886-41c1-8ad7-d119479b0af4 tempest-VolumeDependencyTests-1969615490 None] Deleting offline snapshot 17fe0d43-ec81-4dfb-ac7b-4afb5a40d1e0 of volume ff15a29f-c8df-4880-9a2b-43e4537ea992 {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:50:26 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-c1d9fe4a-f886-41c1-8ad7-d119479b0af4 tempest-VolumeDependencyTests-1969615490 None] snapshot_file for this snap is: volume-ff15a29f-c8df-4880-9a2b-43e4537ea992.17fe0d43-ec81-4dfb-ac7b-4afb5a40d1e0 {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:50:26 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7c5ec8-1276-4f97-a418-16440b1adaf7]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:26 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c1d9fe4a-f886-41c1-8ad7-d119479b0af4 tempest-VolumeDependencyTests-1969615490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ff15a29f-c8df-4880-9a2b-43e4537ea992.17fe0d43-ec81-4dfb-ac7b-4afb5a40d1e0 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:26 devstack sudo[106380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ff15a29f-c8df-4880-9a2b-43e4537ea992.17fe0d43-ec81-4dfb-ac7b-4afb5a40d1e0 Nov 03 07:50:26 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:26 devstack sudo[106378]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:26 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-1a74d983-bedf-4edd-adbd-4502c0a24cd2 tempest-ProjectReaderTests-502528571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-dafe1d2b-9c4e-49d4-be93-5f11817b2e7d" returned: 0 in 0.281s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:26 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-1a74d983-bedf-4edd-adbd-4502c0a24cd2 tempest-ProjectReaderTests-502528571 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:50:26 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-1a74d983-bedf-4edd-adbd-4502c0a24cd2 tempest-ProjectReaderTests-502528571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:26 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-926f9ae1-384d-4df2-beae-9e894216d3f1 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.327s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:26 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-926f9ae1-384d-4df2-beae-9e894216d3f1 tempest-CreateVolumesFromSnapshotTest-1905686095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1308104416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e72f94b1-f1db-4742-8b98-7b77499b6d0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb1730d50a9249af9db23fb7e793a2f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:26Z,use_quota=True,user_id='f21b7781126a4a6d8c5c58a237a6395e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:50:26 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-926f9ae1-384d-4df2-beae-9e894216d3f1 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Creating volume e72f94b1-f1db-4742-8b98-7b77499b6d0f {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:50:26 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-926f9ae1-384d-4df2-beae-9e894216d3f1 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:26 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-926f9ae1-384d-4df2-beae-9e894216d3f1 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:26 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-926f9ae1-384d-4df2-beae-9e894216d3f1 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:26 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-926f9ae1-384d-4df2-beae-9e894216d3f1 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:26 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-926f9ae1-384d-4df2-beae-9e894216d3f1 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:26 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-926f9ae1-384d-4df2-beae-9e894216d3f1 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:50:26 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-926f9ae1-384d-4df2-beae-9e894216d3f1 tempest-CreateVolumesFromSnapshotTest-1905686095 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:50:26 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-926f9ae1-384d-4df2-beae-9e894216d3f1 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e72f94b1-f1db-4742-8b98-7b77499b6d0f 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:26 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-1a74d983-bedf-4edd-adbd-4502c0a24cd2 tempest-ProjectReaderTests-502528571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0b90732-23e3-4331-8504-169cb44761ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dafe1d2b-9c4e-49d4-be93-5f11817b2e7d', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:26 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-1a74d983-bedf-4edd-adbd-4502c0a24cd2 tempest-ProjectReaderTests-502528571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6105741-f76b-4abf-9626-8d7cac344430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:26 devstack sudo[106383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e72f94b1-f1db-4742-8b98-7b77499b6d0f 1073741824 Nov 03 07:50:26 devstack sudo[106383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:26 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-1a74d983-bedf-4edd-adbd-4502c0a24cd2 tempest-ProjectReaderTests-502528571 None] Volume volume-dafe1d2b-9c4e-49d4-be93-5f11817b2e7d (dafe1d2b-9c4e-49d4-be93-5f11817b2e7d): created successfully Nov 03 07:50:26 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-1a74d983-bedf-4edd-adbd-4502c0a24cd2 tempest-ProjectReaderTests-502528571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6105741-f76b-4abf-9626-8d7cac344430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:26 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-1a74d983-bedf-4edd-adbd-4502c0a24cd2 tempest-ProjectReaderTests-502528571 None] Flow 'volume_create_manager' (75f6fa82-bed6-4e37-920c-1e5fa36dfab1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:26 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-1a74d983-bedf-4edd-adbd-4502c0a24cd2 tempest-ProjectReaderTests-502528571 None] Created volume successfully. Nov 03 07:50:26 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:26 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c1d9fe4a-f886-41c1-8ad7-d119479b0af4 tempest-VolumeDependencyTests-1969615490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ff15a29f-c8df-4880-9a2b-43e4537ea992.17fe0d43-ec81-4dfb-ac7b-4afb5a40d1e0" returned: 0 in 0.427s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:26 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-c1d9fe4a-f886-41c1-8ad7-d119479b0af4 tempest-VolumeDependencyTests-1969615490 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff15a29f-c8df-4880-9a2b-43e4537ea992(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:50:26 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ba6dbf-b796-4fdd-b5a2-a4d349f9461f]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:26 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c1d9fe4a-f886-41c1-8ad7-d119479b0af4 tempest-VolumeDependencyTests-1969615490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ff15a29f-c8df-4880-9a2b-43e4537ea992 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:26 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ff15a29f-c8df-4880-9a2b-43e4537ea992 Nov 03 07:50:26 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:27 devstack sudo[106383]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-926f9ae1-384d-4df2-beae-9e894216d3f1 tempest-CreateVolumesFromSnapshotTest-1905686095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e72f94b1-f1db-4742-8b98-7b77499b6d0f 1073741824" returned: 0 in 0.563s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-926f9ae1-384d-4df2-beae-9e894216d3f1 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e72f94b1-f1db-4742-8b98-7b77499b6d0f {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:27 devstack sudo[106395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e72f94b1-f1db-4742-8b98-7b77499b6d0f Nov 03 07:50:27 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:27 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-86946cd0-e5d3-4167-95ec-c4f6296bb8f6 tempest-ProjectReaderTests-502528571 None] Acquiring lock "cinder-dafe1d2b-9c4e-49d4-be93-5f11817b2e7d-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:27 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-86946cd0-e5d3-4167-95ec-c4f6296bb8f6 tempest-ProjectReaderTests-502528571 None] Lock "cinder-dafe1d2b-9c4e-49d4-be93-5f11817b2e7d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:27 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-86946cd0-e5d3-4167-95ec-c4f6296bb8f6 tempest-ProjectReaderTests-502528571 None] Acquiring lock "cinder-quobyte-dafe1d2b-9c4e-49d4-be93-5f11817b2e7d" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:27 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-86946cd0-e5d3-4167-95ec-c4f6296bb8f6 tempest-ProjectReaderTests-502528571 None] Lock "cinder-quobyte-dafe1d2b-9c4e-49d4-be93-5f11817b2e7d" acquired by "delete_volume" :: waited 0.019s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:27 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c1d9fe4a-f886-41c1-8ad7-d119479b0af4 tempest-VolumeDependencyTests-1969615490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ff15a29f-c8df-4880-9a2b-43e4537ea992" returned: 0 in 0.672s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c1d9fe4a-f886-41c1-8ad7-d119479b0af4 tempest-VolumeDependencyTests-1969615490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ff15a29f-c8df-4880-9a2b-43e4537ea992.17fe0d43-ec81-4dfb-ac7b-4afb5a40d1e0 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:27 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[1798a002-ec3e-48ac-b104-0ec78b52773b]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:27 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-86946cd0-e5d3-4167-95ec-c4f6296bb8f6 tempest-ProjectReaderTests-502528571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-dafe1d2b-9c4e-49d4-be93-5f11817b2e7d {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-926f9ae1-384d-4df2-beae-9e894216d3f1 tempest-CreateVolumesFromSnapshotTest-1905686095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e72f94b1-f1db-4742-8b98-7b77499b6d0f" returned: 0 in 0.355s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:27 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-926f9ae1-384d-4df2-beae-9e894216d3f1 tempest-CreateVolumesFromSnapshotTest-1905686095 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:50:27 devstack sudo[106399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ff15a29f-c8df-4880-9a2b-43e4537ea992.17fe0d43-ec81-4dfb-ac7b-4afb5a40d1e0 Nov 03 07:50:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-926f9ae1-384d-4df2-beae-9e894216d3f1 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:27 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:27 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-926f9ae1-384d-4df2-beae-9e894216d3f1 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (113cc9e7-6e32-44ab-b39b-b4e9ae8afe9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e72f94b1-f1db-4742-8b98-7b77499b6d0f', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:27 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-926f9ae1-384d-4df2-beae-9e894216d3f1 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cb17340-5d70-4353-ad84-31d958834631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:27 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-926f9ae1-384d-4df2-beae-9e894216d3f1 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Volume volume-e72f94b1-f1db-4742-8b98-7b77499b6d0f (e72f94b1-f1db-4742-8b98-7b77499b6d0f): created successfully Nov 03 07:50:27 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-926f9ae1-384d-4df2-beae-9e894216d3f1 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cb17340-5d70-4353-ad84-31d958834631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:27 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-926f9ae1-384d-4df2-beae-9e894216d3f1 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Flow 'volume_create_manager' (f48e7b4a-f97b-45a0-92f3-f543e773ab3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:27 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-926f9ae1-384d-4df2-beae-9e894216d3f1 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Created volume successfully. Nov 03 07:50:27 devstack sudo[106400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-dafe1d2b-9c4e-49d4-be93-5f11817b2e7d Nov 03 07:50:27 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:27 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c1d9fe4a-f886-41c1-8ad7-d119479b0af4 tempest-VolumeDependencyTests-1969615490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ff15a29f-c8df-4880-9a2b-43e4537ea992.17fe0d43-ec81-4dfb-ac7b-4afb5a40d1e0" returned: 0 in 0.352s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c1d9fe4a-f886-41c1-8ad7-d119479b0af4 tempest-VolumeDependencyTests-1969615490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ff15a29f-c8df-4880-9a2b-43e4537ea992.17fe0d43-ec81-4dfb-ac7b-4afb5a40d1e0 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:27 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ff15a29f-c8df-4880-9a2b-43e4537ea992.17fe0d43-ec81-4dfb-ac7b-4afb5a40d1e0 Nov 03 07:50:27 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:27 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-86946cd0-e5d3-4167-95ec-c4f6296bb8f6 tempest-ProjectReaderTests-502528571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-dafe1d2b-9c4e-49d4-be93-5f11817b2e7d" returned: 0 in 0.418s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-86946cd0-e5d3-4167-95ec-c4f6296bb8f6 tempest-ProjectReaderTests-502528571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-dafe1d2b-9c4e-49d4-be93-5f11817b2e7d {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:27 devstack sudo[106412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-dafe1d2b-9c4e-49d4-be93-5f11817b2e7d Nov 03 07:50:27 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:28 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c1d9fe4a-f886-41c1-8ad7-d119479b0af4 tempest-VolumeDependencyTests-1969615490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ff15a29f-c8df-4880-9a2b-43e4537ea992.17fe0d43-ec81-4dfb-ac7b-4afb5a40d1e0" returned: 0 in 0.280s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:28 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-c1d9fe4a-f886-41c1-8ad7-d119479b0af4 tempest-VolumeDependencyTests-1969615490 None] Lock "cinder-quobyte-17fe0d43-ec81-4dfb-ac7b-4afb5a40d1e0" released by "_delete_snapshot" :: held 1.884s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:28 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:28 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-c1d9fe4a-f886-41c1-8ad7-d119479b0af4 tempest-VolumeDependencyTests-1969615490 None] Lock "cinder-quobyte-ff15a29f-c8df-4880-9a2b-43e4537ea992" released by "delete_snapshot" :: held 1.919s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-86946cd0-e5d3-4167-95ec-c4f6296bb8f6 tempest-ProjectReaderTests-502528571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-dafe1d2b-9c4e-49d4-be93-5f11817b2e7d" returned: 0 in 0.287s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:28 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-86946cd0-e5d3-4167-95ec-c4f6296bb8f6 tempest-ProjectReaderTests-502528571 None] Lock "cinder-quobyte-dafe1d2b-9c4e-49d4-be93-5f11817b2e7d" released by "delete_volume" :: held 0.767s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:28 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-c1d9fe4a-f886-41c1-8ad7-d119479b0af4 tempest-VolumeDependencyTests-1969615490 None] Created reservations ['698a3a76-6c88-4232-a9ee-b300602501c1', '97308478-2e3a-4f2d-868c-e791d89439bf', '15a06ff5-c3fb-4a28-b285-8db426562df4', '2917a879-8e5b-45cf-a8a8-d06f5faa6436'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:50:28 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-c1d9fe4a-f886-41c1-8ad7-d119479b0af4 tempest-VolumeDependencyTests-1969615490 None] Delete snapshot completed successfully. Nov 03 07:50:28 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-c1d9fe4a-f886-41c1-8ad7-d119479b0af4 tempest-VolumeDependencyTests-1969615490 None] Lock "cinder-17fe0d43-ec81-4dfb-ac7b-4afb5a40d1e0-delete_snapshot" released by "delete_snapshot" :: held 2.150s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:28 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-86946cd0-e5d3-4167-95ec-c4f6296bb8f6 tempest-ProjectReaderTests-502528571 None] Created reservations ['a1227a51-5eee-4569-ba01-b068680ef718', '16d6b22f-00de-4620-8a10-b8852a09d2ef', '2a33e977-48ed-4cbb-a521-9cf01f0b6434', '5c48406c-5774-478d-808d-2d59eb23e96f'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:50:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-71e44537-b4f3-4681-aaec-41801e1680bc tempest-CreateVolumesFromSnapshotTest-1905686095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-71e44537-b4f3-4681-aaec-41801e1680bc tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:28 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-71e44537-b4f3-4681-aaec-41801e1680bc tempest-CreateVolumesFromSnapshotTest-1905686095 None] Creating offline snapshot 30252a61-e54c-4774-8824-3036f827c992 of volume e72f94b1-f1db-4742-8b98-7b77499b6d0f {{(pid=86875) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:50:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-86946cd0-e5d3-4167-95ec-c4f6296bb8f6 tempest-ProjectReaderTests-502528571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-86946cd0-e5d3-4167-95ec-c4f6296bb8f6 tempest-ProjectReaderTests-502528571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:28 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-86946cd0-e5d3-4167-95ec-c4f6296bb8f6 tempest-ProjectReaderTests-502528571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:28 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-86946cd0-e5d3-4167-95ec-c4f6296bb8f6 tempest-ProjectReaderTests-502528571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-86946cd0-e5d3-4167-95ec-c4f6296bb8f6 tempest-ProjectReaderTests-502528571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-86946cd0-e5d3-4167-95ec-c4f6296bb8f6 tempest-ProjectReaderTests-502528571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:28 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d52876-8c88-451b-883f-da2eda40d331]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-71e44537-b4f3-4681-aaec-41801e1680bc tempest-CreateVolumesFromSnapshotTest-1905686095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e72f94b1-f1db-4742-8b98-7b77499b6d0f {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:28 devstack sudo[106431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:50:28 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:28 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e72f94b1-f1db-4742-8b98-7b77499b6d0f Nov 03 07:50:28 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:28 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-86946cd0-e5d3-4167-95ec-c4f6296bb8f6 tempest-ProjectReaderTests-502528571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.327s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:28 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-86946cd0-e5d3-4167-95ec-c4f6296bb8f6 tempest-ProjectReaderTests-502528571 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:50:28 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-86946cd0-e5d3-4167-95ec-c4f6296bb8f6 tempest-ProjectReaderTests-502528571 None] Deleted volume successfully. Nov 03 07:50:28 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-86946cd0-e5d3-4167-95ec-c4f6296bb8f6 tempest-ProjectReaderTests-502528571 None] Lock "cinder-dafe1d2b-9c4e-49d4-be93-5f11817b2e7d-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:28 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-71e44537-b4f3-4681-aaec-41801e1680bc tempest-CreateVolumesFromSnapshotTest-1905686095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e72f94b1-f1db-4742-8b98-7b77499b6d0f" returned: 0 in 0.485s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-71e44537-b4f3-4681-aaec-41801e1680bc tempest-CreateVolumesFromSnapshotTest-1905686095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e72f94b1-f1db-4742-8b98-7b77499b6d0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e72f94b1-f1db-4742-8b98-7b77499b6d0f.30252a61-e54c-4774-8824-3036f827c992 1G {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:28 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e72f94b1-f1db-4742-8b98-7b77499b6d0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e72f94b1-f1db-4742-8b98-7b77499b6d0f.30252a61-e54c-4774-8824-3036f827c992 1G Nov 03 07:50:28 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:29 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c6ff27c-373f-47f8-997d-fc3d7565f1d8 tempest-ProjectReaderTests-502528571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:50:29 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5c6ff27c-373f-47f8-997d-fc3d7565f1d8 tempest-ProjectReaderTests-502528571 None] Flow 'volume_create_manager' (10863db9-cdff-498c-9c9e-8b2ac965f10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:29 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5c6ff27c-373f-47f8-997d-fc3d7565f1d8 tempest-ProjectReaderTests-502528571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25b27326-19e2-42fd-b88a-3cc6eecb6059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:29 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5c6ff27c-373f-47f8-997d-fc3d7565f1d8 tempest-ProjectReaderTests-502528571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25b27326-19e2-42fd-b88a-3cc6eecb6059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-235274418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49164781-a740-4169-8ceb-97294ab13045,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8add37b5fee54b3b86fd2c461f733a93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:29Z,use_quota=True,user_id='f6a2a55bfa844c998456e9021f775e22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:29 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5c6ff27c-373f-47f8-997d-fc3d7565f1d8 tempest-ProjectReaderTests-502528571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45352fe4-cb39-47cd-bddc-090bc397de9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:29 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5c6ff27c-373f-47f8-997d-fc3d7565f1d8 tempest-ProjectReaderTests-502528571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45352fe4-cb39-47cd-bddc-090bc397de9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:29 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5c6ff27c-373f-47f8-997d-fc3d7565f1d8 tempest-ProjectReaderTests-502528571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e26e5c1e-27cc-48e8-8e59-9a2a1c43947d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:29 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5c6ff27c-373f-47f8-997d-fc3d7565f1d8 tempest-ProjectReaderTests-502528571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e26e5c1e-27cc-48e8-8e59-9a2a1c43947d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49164781-a740-4169-8ceb-97294ab13045', 'volume_name': 'volume-49164781-a740-4169-8ceb-97294ab13045', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:29 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5c6ff27c-373f-47f8-997d-fc3d7565f1d8 tempest-ProjectReaderTests-502528571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5596cf79-d033-4594-9274-8aeeac8118fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:29 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5c6ff27c-373f-47f8-997d-fc3d7565f1d8 tempest-ProjectReaderTests-502528571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5596cf79-d033-4594-9274-8aeeac8118fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:29 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5c6ff27c-373f-47f8-997d-fc3d7565f1d8 tempest-ProjectReaderTests-502528571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01a2a159-469f-4d6e-abe6-ec85a542a7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:29 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-5c6ff27c-373f-47f8-997d-fc3d7565f1d8 tempest-ProjectReaderTests-502528571 None] Volume 49164781-a740-4169-8ceb-97294ab13045: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49164781-a740-4169-8ceb-97294ab13045', 'volume_size': 1} Nov 03 07:50:29 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-5c6ff27c-373f-47f8-997d-fc3d7565f1d8 tempest-ProjectReaderTests-502528571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:29 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-cf4ec520-36b6-4c40-8b67-a72e86ec33c6 tempest-VolumeDependencyTests-1969615490 None] Acquiring lock "cinder-ff15a29f-c8df-4880-9a2b-43e4537ea992-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:29 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-cf4ec520-36b6-4c40-8b67-a72e86ec33c6 tempest-VolumeDependencyTests-1969615490 None] Lock "cinder-ff15a29f-c8df-4880-9a2b-43e4537ea992-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:29 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-cf4ec520-36b6-4c40-8b67-a72e86ec33c6 tempest-VolumeDependencyTests-1969615490 None] Acquiring lock "cinder-quobyte-ff15a29f-c8df-4880-9a2b-43e4537ea992" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:29 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:29 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-71e44537-b4f3-4681-aaec-41801e1680bc tempest-CreateVolumesFromSnapshotTest-1905686095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e72f94b1-f1db-4742-8b98-7b77499b6d0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e72f94b1-f1db-4742-8b98-7b77499b6d0f.30252a61-e54c-4774-8824-3036f827c992 1G" returned: 0 in 0.526s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:29 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-71e44537-b4f3-4681-aaec-41801e1680bc tempest-CreateVolumesFromSnapshotTest-1905686095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e72f94b1-f1db-4742-8b98-7b77499b6d0f -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e72f94b1-f1db-4742-8b98-7b77499b6d0f.30252a61-e54c-4774-8824-3036f827c992 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:29 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-cf4ec520-36b6-4c40-8b67-a72e86ec33c6 tempest-VolumeDependencyTests-1969615490 None] Lock "cinder-quobyte-ff15a29f-c8df-4880-9a2b-43e4537ea992" acquired by "delete_volume" :: waited 0.040s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:29 devstack sudo[106467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e72f94b1-f1db-4742-8b98-7b77499b6d0f -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e72f94b1-f1db-4742-8b98-7b77499b6d0f.30252a61-e54c-4774-8824-3036f827c992 Nov 03 07:50:29 devstack sudo[106467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:29 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e68d4b-5fb1-48a8-9282-2b75d032612d]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:29 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-cf4ec520-36b6-4c40-8b67-a72e86ec33c6 tempest-VolumeDependencyTests-1969615490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ff15a29f-c8df-4880-9a2b-43e4537ea992 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:29 devstack sudo[106469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ff15a29f-c8df-4880-9a2b-43e4537ea992 Nov 03 07:50:29 devstack sudo[106469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:29 devstack sudo[106467]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:29 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-71e44537-b4f3-4681-aaec-41801e1680bc tempest-CreateVolumesFromSnapshotTest-1905686095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e72f94b1-f1db-4742-8b98-7b77499b6d0f -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e72f94b1-f1db-4742-8b98-7b77499b6d0f.30252a61-e54c-4774-8824-3036f827c992" returned: 0 in 0.322s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:29 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-71e44537-b4f3-4681-aaec-41801e1680bc tempest-CreateVolumesFromSnapshotTest-1905686095 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e72f94b1-f1db-4742-8b98-7b77499b6d0f.30252a61-e54c-4774-8824-3036f827c992 is being set with open permissions: ugo+rw Nov 03 07:50:29 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-71e44537-b4f3-4681-aaec-41801e1680bc tempest-CreateVolumesFromSnapshotTest-1905686095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e72f94b1-f1db-4742-8b98-7b77499b6d0f.30252a61-e54c-4774-8824-3036f827c992 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:29 devstack sudo[106474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e72f94b1-f1db-4742-8b98-7b77499b6d0f.30252a61-e54c-4774-8824-3036f827c992 Nov 03 07:50:29 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:29 devstack sudo[106469]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:29 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-cf4ec520-36b6-4c40-8b67-a72e86ec33c6 tempest-VolumeDependencyTests-1969615490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ff15a29f-c8df-4880-9a2b-43e4537ea992" returned: 0 in 0.393s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:29 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-cf4ec520-36b6-4c40-8b67-a72e86ec33c6 tempest-VolumeDependencyTests-1969615490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ff15a29f-c8df-4880-9a2b-43e4537ea992 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:29 devstack sudo[106479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ff15a29f-c8df-4880-9a2b-43e4537ea992 Nov 03 07:50:29 devstack sudo[106479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:30 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-71e44537-b4f3-4681-aaec-41801e1680bc tempest-CreateVolumesFromSnapshotTest-1905686095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e72f94b1-f1db-4742-8b98-7b77499b6d0f.30252a61-e54c-4774-8824-3036f827c992" returned: 0 in 0.262s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-71e44537-b4f3-4681-aaec-41801e1680bc tempest-CreateVolumesFromSnapshotTest-1905686095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e72f94b1-f1db-4742-8b98-7b77499b6d0f.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:30 devstack sudo[106482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e72f94b1-f1db-4742-8b98-7b77499b6d0f.info Nov 03 07:50:30 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:30 devstack sudo[106479]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-cf4ec520-36b6-4c40-8b67-a72e86ec33c6 tempest-VolumeDependencyTests-1969615490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-ff15a29f-c8df-4880-9a2b-43e4537ea992" returned: 0 in 0.258s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:30 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-cf4ec520-36b6-4c40-8b67-a72e86ec33c6 tempest-VolumeDependencyTests-1969615490 None] Lock "cinder-quobyte-ff15a29f-c8df-4880-9a2b-43e4537ea992" released by "delete_volume" :: held 0.741s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:30 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-cf4ec520-36b6-4c40-8b67-a72e86ec33c6 tempest-VolumeDependencyTests-1969615490 None] Created reservations ['5da2fba0-c376-4340-8f27-beb77f5617f9', '18fdb060-4000-4233-ba0c-da9a3c7cc802', '4f26c1c7-88ec-4eba-9f48-867f15352b48', '7f462c6f-f0e2-4aa4-b26c-889467f7bdb5'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:50:30 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-cf4ec520-36b6-4c40-8b67-a72e86ec33c6 tempest-VolumeDependencyTests-1969615490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-cf4ec520-36b6-4c40-8b67-a72e86ec33c6 tempest-VolumeDependencyTests-1969615490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:30 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-cf4ec520-36b6-4c40-8b67-a72e86ec33c6 tempest-VolumeDependencyTests-1969615490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:30 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-cf4ec520-36b6-4c40-8b67-a72e86ec33c6 tempest-VolumeDependencyTests-1969615490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-cf4ec520-36b6-4c40-8b67-a72e86ec33c6 tempest-VolumeDependencyTests-1969615490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-cf4ec520-36b6-4c40-8b67-a72e86ec33c6 tempest-VolumeDependencyTests-1969615490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-71e44537-b4f3-4681-aaec-41801e1680bc tempest-CreateVolumesFromSnapshotTest-1905686095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e72f94b1-f1db-4742-8b98-7b77499b6d0f.info" returned: 0 in 0.284s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:30 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-71e44537-b4f3-4681-aaec-41801e1680bc tempest-CreateVolumesFromSnapshotTest-1905686095 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e72f94b1-f1db-4742-8b98-7b77499b6d0f.info is being set with open permissions: ugo+rw Nov 03 07:50:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-71e44537-b4f3-4681-aaec-41801e1680bc tempest-CreateVolumesFromSnapshotTest-1905686095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e72f94b1-f1db-4742-8b98-7b77499b6d0f.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:30 devstack sudo[106486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:50:30 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:30 devstack sudo[106487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e72f94b1-f1db-4742-8b98-7b77499b6d0f.info Nov 03 07:50:30 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:30 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:30 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-4f54205e-9046-4342-ad8f-cabaea85c91b tempest-VolumeDependencyTests-1969615490 None] Acquiring lock "cinder-6903590e-9319-4fff-84b7-d5f37f7532cf-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-cf4ec520-36b6-4c40-8b67-a72e86ec33c6 tempest-VolumeDependencyTests-1969615490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.263s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:30 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-cf4ec520-36b6-4c40-8b67-a72e86ec33c6 tempest-VolumeDependencyTests-1969615490 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:50:30 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-cf4ec520-36b6-4c40-8b67-a72e86ec33c6 tempest-VolumeDependencyTests-1969615490 None] Deleted volume successfully. Nov 03 07:50:30 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-4f54205e-9046-4342-ad8f-cabaea85c91b tempest-VolumeDependencyTests-1969615490 None] Lock "cinder-6903590e-9319-4fff-84b7-d5f37f7532cf-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:30 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-71e44537-b4f3-4681-aaec-41801e1680bc tempest-CreateVolumesFromSnapshotTest-1905686095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e72f94b1-f1db-4742-8b98-7b77499b6d0f.info" returned: 0 in 0.294s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-71e44537-b4f3-4681-aaec-41801e1680bc tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.300s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-5c6ff27c-373f-47f8-997d-fc3d7565f1d8 tempest-ProjectReaderTests-502528571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.522s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:30 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-5c6ff27c-373f-47f8-997d-fc3d7565f1d8 tempest-ProjectReaderTests-502528571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-235274418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49164781-a740-4169-8ceb-97294ab13045,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8add37b5fee54b3b86fd2c461f733a93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:29Z,use_quota=True,user_id='f6a2a55bfa844c998456e9021f775e22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:50:30 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-5c6ff27c-373f-47f8-997d-fc3d7565f1d8 tempest-ProjectReaderTests-502528571 None] Creating volume 49164781-a740-4169-8ceb-97294ab13045 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:50:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-5c6ff27c-373f-47f8-997d-fc3d7565f1d8 tempest-ProjectReaderTests-502528571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-5c6ff27c-373f-47f8-997d-fc3d7565f1d8 tempest-ProjectReaderTests-502528571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:30 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-5c6ff27c-373f-47f8-997d-fc3d7565f1d8 tempest-ProjectReaderTests-502528571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:30 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-5c6ff27c-373f-47f8-997d-fc3d7565f1d8 tempest-ProjectReaderTests-502528571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-5c6ff27c-373f-47f8-997d-fc3d7565f1d8 tempest-ProjectReaderTests-502528571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:30 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-5c6ff27c-373f-47f8-997d-fc3d7565f1d8 tempest-ProjectReaderTests-502528571 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:50:30 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-5c6ff27c-373f-47f8-997d-fc3d7565f1d8 tempest-ProjectReaderTests-502528571 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:50:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5c6ff27c-373f-47f8-997d-fc3d7565f1d8 tempest-ProjectReaderTests-502528571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-49164781-a740-4169-8ceb-97294ab13045 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:30 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-cf4ec520-36b6-4c40-8b67-a72e86ec33c6 tempest-VolumeDependencyTests-1969615490 None] Lock "cinder-ff15a29f-c8df-4880-9a2b-43e4537ea992-delete_volume" released by "delete_volume" :: held 1.318s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:30 devstack sudo[106492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-49164781-a740-4169-8ceb-97294ab13045 1073741824 Nov 03 07:50:30 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:30 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-71e44537-b4f3-4681-aaec-41801e1680bc tempest-CreateVolumesFromSnapshotTest-1905686095 None] Create snapshot completed successfully Nov 03 07:50:30 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-4f54205e-9046-4342-ad8f-cabaea85c91b tempest-VolumeDependencyTests-1969615490 None] Acquiring lock "cinder-quobyte-6903590e-9319-4fff-84b7-d5f37f7532cf" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:30 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-4f54205e-9046-4342-ad8f-cabaea85c91b tempest-VolumeDependencyTests-1969615490 None] Lock "cinder-quobyte-6903590e-9319-4fff-84b7-d5f37f7532cf" acquired by "delete_volume" :: waited 0.021s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:30 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[8808a760-b972-4013-b860-a01ba2a0959a]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4f54205e-9046-4342-ad8f-cabaea85c91b tempest-VolumeDependencyTests-1969615490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6903590e-9319-4fff-84b7-d5f37f7532cf {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:30 devstack sudo[106494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6903590e-9319-4fff-84b7-d5f37f7532cf Nov 03 07:50:30 devstack sudo[106494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:31 devstack sudo[106494]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:31 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4f54205e-9046-4342-ad8f-cabaea85c91b tempest-VolumeDependencyTests-1969615490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6903590e-9319-4fff-84b7-d5f37f7532cf" returned: 0 in 0.397s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5c6ff27c-373f-47f8-997d-fc3d7565f1d8 tempest-ProjectReaderTests-502528571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-49164781-a740-4169-8ceb-97294ab13045 1073741824" returned: 0 in 0.501s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4f54205e-9046-4342-ad8f-cabaea85c91b tempest-VolumeDependencyTests-1969615490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6903590e-9319-4fff-84b7-d5f37f7532cf {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:31 devstack sudo[106503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6903590e-9319-4fff-84b7-d5f37f7532cf Nov 03 07:50:31 devstack sudo[106503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5c6ff27c-373f-47f8-997d-fc3d7565f1d8 tempest-ProjectReaderTests-502528571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-49164781-a740-4169-8ceb-97294ab13045 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:31 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-49164781-a740-4169-8ceb-97294ab13045 Nov 03 07:50:31 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:31 devstack sudo[106503]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4f54205e-9046-4342-ad8f-cabaea85c91b tempest-VolumeDependencyTests-1969615490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6903590e-9319-4fff-84b7-d5f37f7532cf" returned: 0 in 0.271s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:31 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-4f54205e-9046-4342-ad8f-cabaea85c91b tempest-VolumeDependencyTests-1969615490 None] Lock "cinder-quobyte-6903590e-9319-4fff-84b7-d5f37f7532cf" released by "delete_volume" :: held 0.720s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:31 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5c6ff27c-373f-47f8-997d-fc3d7565f1d8 tempest-ProjectReaderTests-502528571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-49164781-a740-4169-8ceb-97294ab13045" returned: 0 in 0.280s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:31 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-5c6ff27c-373f-47f8-997d-fc3d7565f1d8 tempest-ProjectReaderTests-502528571 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:50:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-5c6ff27c-373f-47f8-997d-fc3d7565f1d8 tempest-ProjectReaderTests-502528571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:31 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5c6ff27c-373f-47f8-997d-fc3d7565f1d8 tempest-ProjectReaderTests-502528571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01a2a159-469f-4d6e-abe6-ec85a542a7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49164781-a740-4169-8ceb-97294ab13045', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:31 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5c6ff27c-373f-47f8-997d-fc3d7565f1d8 tempest-ProjectReaderTests-502528571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e66c1a8-af11-4722-9207-97828fd2b119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:31 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-4f54205e-9046-4342-ad8f-cabaea85c91b tempest-VolumeDependencyTests-1969615490 None] Created reservations ['0ffc3d20-dbea-4ab1-a2bf-96fbcbaaadc6', '7c446579-f8a7-4b66-a696-3ab38b0fb82a', '543a6731-b8d8-42cb-b59a-762a643572e5', '894f1a15-6242-4f07-8dab-978b2bb3c53d'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:50:31 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-5c6ff27c-373f-47f8-997d-fc3d7565f1d8 tempest-ProjectReaderTests-502528571 None] Volume volume-49164781-a740-4169-8ceb-97294ab13045 (49164781-a740-4169-8ceb-97294ab13045): created successfully Nov 03 07:50:31 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5c6ff27c-373f-47f8-997d-fc3d7565f1d8 tempest-ProjectReaderTests-502528571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e66c1a8-af11-4722-9207-97828fd2b119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:31 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5c6ff27c-373f-47f8-997d-fc3d7565f1d8 tempest-ProjectReaderTests-502528571 None] Flow 'volume_create_manager' (10863db9-cdff-498c-9c9e-8b2ac965f10f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:31 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-5c6ff27c-373f-47f8-997d-fc3d7565f1d8 tempest-ProjectReaderTests-502528571 None] Created volume successfully. Nov 03 07:50:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-4f54205e-9046-4342-ad8f-cabaea85c91b tempest-VolumeDependencyTests-1969615490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-4f54205e-9046-4342-ad8f-cabaea85c91b tempest-VolumeDependencyTests-1969615490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:31 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-4f54205e-9046-4342-ad8f-cabaea85c91b tempest-VolumeDependencyTests-1969615490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:31 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-4f54205e-9046-4342-ad8f-cabaea85c91b tempest-VolumeDependencyTests-1969615490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-4f54205e-9046-4342-ad8f-cabaea85c91b tempest-VolumeDependencyTests-1969615490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4f54205e-9046-4342-ad8f-cabaea85c91b tempest-VolumeDependencyTests-1969615490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:31 devstack sudo[106509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:50:31 devstack sudo[106509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:31 devstack sudo[106509]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4f54205e-9046-4342-ad8f-cabaea85c91b tempest-VolumeDependencyTests-1969615490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.300s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:31 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-4f54205e-9046-4342-ad8f-cabaea85c91b tempest-VolumeDependencyTests-1969615490 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:50:31 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-4f54205e-9046-4342-ad8f-cabaea85c91b tempest-VolumeDependencyTests-1969615490 None] Deleted volume successfully. Nov 03 07:50:32 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-4f54205e-9046-4342-ad8f-cabaea85c91b tempest-VolumeDependencyTests-1969615490 None] Lock "cinder-6903590e-9319-4fff-84b7-d5f37f7532cf-delete_volume" released by "delete_volume" :: held 1.378s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:32 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-430cdae7-48a2-4dfd-bae4-16bd347e53d3 tempest-ProjectReaderTests-502528571 None] Acquiring lock "cinder-49164781-a740-4169-8ceb-97294ab13045-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:32 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-430cdae7-48a2-4dfd-bae4-16bd347e53d3 tempest-ProjectReaderTests-502528571 None] Lock "cinder-49164781-a740-4169-8ceb-97294ab13045-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:32 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:50:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] Flow 'volume_create_manager' (d5649587-8601-4493-8b70-610d2e8b7675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1db6381-ca94-4c8b-87a2-2847e9e922a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1db6381-ca94-4c8b-87a2-2847e9e922a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be4a58ff-2d0b-4901-a195-010ce513be5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a51c0f5dde54233848cf77d6f5e8ffb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:32Z,use_quota=True,user_id='0591b4506a94453c87bbd5a4a637ade0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94d08e1c-ccc8-43a8-be29-92ff1a72fcff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94d08e1c-ccc8-43a8-be29-92ff1a72fcff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5553b836-bed6-4eff-9a10-99d9b1eb829b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:32 devstack cinder-volume[86875]: DEBUG cinder.image.glance [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] Creating Keystone auth plugin from conf {{(pid=86875) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 07:50:32 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-430cdae7-48a2-4dfd-bae4-16bd347e53d3 tempest-ProjectReaderTests-502528571 None] Acquiring lock "cinder-quobyte-49164781-a740-4169-8ceb-97294ab13045" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:32 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bd658a5-4407-4e80-b7a0-95e1fcb1c6c4 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:50:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5bd658a5-4407-4e80-b7a0-95e1fcb1c6c4 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Flow 'volume_create_manager' (6c54a442-ef76-4dfc-b38d-dd5162fb4195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5bd658a5-4407-4e80-b7a0-95e1fcb1c6c4 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5e3e8cc-8bcd-44a8-9d6e-b99757e727ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5bd658a5-4407-4e80-b7a0-95e1fcb1c6c4 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5e3e8cc-8bcd-44a8-9d6e-b99757e727ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1797869963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9e26e15-b756-4ac0-860f-ffed3270f1b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb1730d50a9249af9db23fb7e793a2f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:32Z,use_quota=True,user_id='f21b7781126a4a6d8c5c58a237a6395e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5bd658a5-4407-4e80-b7a0-95e1fcb1c6c4 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb34a94e-6738-4454-94f3-53a8b80bfb62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5bd658a5-4407-4e80-b7a0-95e1fcb1c6c4 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb34a94e-6738-4454-94f3-53a8b80bfb62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5bd658a5-4407-4e80-b7a0-95e1fcb1c6c4 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6a92840-780b-4e09-aef2-876843d991b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5bd658a5-4407-4e80-b7a0-95e1fcb1c6c4 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6a92840-780b-4e09-aef2-876843d991b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9e26e15-b756-4ac0-860f-ffed3270f1b2', 'volume_name': 'volume-c9e26e15-b756-4ac0-860f-ffed3270f1b2', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5bd658a5-4407-4e80-b7a0-95e1fcb1c6c4 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47f4f7a3-7ff3-4263-8092-9021438c1386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5bd658a5-4407-4e80-b7a0-95e1fcb1c6c4 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47f4f7a3-7ff3-4263-8092-9021438c1386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5bd658a5-4407-4e80-b7a0-95e1fcb1c6c4 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54c400e9-fd56-4296-8ac1-b3cf87ac5c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:32 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-5bd658a5-4407-4e80-b7a0-95e1fcb1c6c4 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Volume c9e26e15-b756-4ac0-860f-ffed3270f1b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9e26e15-b756-4ac0-860f-ffed3270f1b2', 'volume_size': 1} Nov 03 07:50:32 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-5bd658a5-4407-4e80-b7a0-95e1fcb1c6c4 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:32 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-5bd658a5-4407-4e80-b7a0-95e1fcb1c6c4 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:32 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-5bd658a5-4407-4e80-b7a0-95e1fcb1c6c4 tempest-CreateVolumesFromSnapshotTest-1905686095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1797869963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9e26e15-b756-4ac0-860f-ffed3270f1b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb1730d50a9249af9db23fb7e793a2f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:32Z,use_quota=True,user_id='f21b7781126a4a6d8c5c58a237a6395e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:50:32 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-5bd658a5-4407-4e80-b7a0-95e1fcb1c6c4 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Creating volume c9e26e15-b756-4ac0-860f-ffed3270f1b2 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:50:32 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-5bd658a5-4407-4e80-b7a0-95e1fcb1c6c4 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:32 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-5bd658a5-4407-4e80-b7a0-95e1fcb1c6c4 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:32 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-5bd658a5-4407-4e80-b7a0-95e1fcb1c6c4 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:32 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-5bd658a5-4407-4e80-b7a0-95e1fcb1c6c4 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:32 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-5bd658a5-4407-4e80-b7a0-95e1fcb1c6c4 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:32 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-5bd658a5-4407-4e80-b7a0-95e1fcb1c6c4 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:50:32 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-5bd658a5-4407-4e80-b7a0-95e1fcb1c6c4 tempest-CreateVolumesFromSnapshotTest-1905686095 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:50:32 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5bd658a5-4407-4e80-b7a0-95e1fcb1c6c4 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c9e26e15-b756-4ac0-860f-ffed3270f1b2 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:32 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-430cdae7-48a2-4dfd-bae4-16bd347e53d3 tempest-ProjectReaderTests-502528571 None] Lock "cinder-quobyte-49164781-a740-4169-8ceb-97294ab13045" acquired by "delete_volume" :: waited 0.196s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:32 devstack sudo[106512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c9e26e15-b756-4ac0-860f-ffed3270f1b2 1073741824 Nov 03 07:50:32 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:32 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[69047425-139c-4ee4-b129-dfadd3c47d76]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:32 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-430cdae7-48a2-4dfd-bae4-16bd347e53d3 tempest-ProjectReaderTests-502528571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-49164781-a740-4169-8ceb-97294ab13045 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:32 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4ab933f-3747-4e80-86d5-8660b5a70f39 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:50:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a4ab933f-3747-4e80-86d5-8660b5a70f39 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Flow 'volume_create_manager' (66c1d3f2-8857-4741-a908-f29a68883f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a4ab933f-3747-4e80-86d5-8660b5a70f39 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bcdb888-24bd-4b6c-b1b0-323f50a1b77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a4ab933f-3747-4e80-86d5-8660b5a70f39 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bcdb888-24bd-4b6c-b1b0-323f50a1b77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-767747885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b56efea-b171-45dd-98ab-3db2adc479f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb1730d50a9249af9db23fb7e793a2f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:33Z,use_quota=True,user_id='f21b7781126a4a6d8c5c58a237a6395e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a4ab933f-3747-4e80-86d5-8660b5a70f39 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63fe2e51-c7af-45a6-84b6-9563e5d8745c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a4ab933f-3747-4e80-86d5-8660b5a70f39 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63fe2e51-c7af-45a6-84b6-9563e5d8745c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a4ab933f-3747-4e80-86d5-8660b5a70f39 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c70c7b76-0814-4702-b7d3-1f6a9c3fb80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a4ab933f-3747-4e80-86d5-8660b5a70f39 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c70c7b76-0814-4702-b7d3-1f6a9c3fb80e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b56efea-b171-45dd-98ab-3db2adc479f5', 'volume_name': 'volume-3b56efea-b171-45dd-98ab-3db2adc479f5', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a4ab933f-3747-4e80-86d5-8660b5a70f39 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f5a5fcd-e3af-4185-8529-3d82a5737325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a4ab933f-3747-4e80-86d5-8660b5a70f39 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f5a5fcd-e3af-4185-8529-3d82a5737325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:32 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a4ab933f-3747-4e80-86d5-8660b5a70f39 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d10c84a8-c62b-4e22-8c64-eeea85a6a9d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:32 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-a4ab933f-3747-4e80-86d5-8660b5a70f39 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Volume 3b56efea-b171-45dd-98ab-3db2adc479f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b56efea-b171-45dd-98ab-3db2adc479f5', 'volume_size': 1} Nov 03 07:50:32 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a4ab933f-3747-4e80-86d5-8660b5a70f39 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:32 devstack sudo[106514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-49164781-a740-4169-8ceb-97294ab13045 Nov 03 07:50:32 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:33 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5553b836-bed6-4eff-9a10-99d9b1eb829b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'be4a58ff-2d0b-4901-a195-010ce513be5c', 'volume_name': 'volume-be4a58ff-2d0b-4901-a195-010ce513be5c', 'volume_size': 1, 'image_id': 'bdd4d0e6-c2cf-4c3c-bd69-66875a4101dd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bdd4d0e6-c2cf-4c3c-bd69-66875a4101dd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f6ddec0052b46a28ffa489fceaa1e838', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6a51c0f5dde54233848cf77d6f5e8ffb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '527278357b166857a3e40f6110f45f9aa883db11fc71527ed636106bf83d7c07812c84c11000d7f079b7efb60e61f3ff0b8eea18a0b4d9f9dac02bb0d4e90880', 'id': 'bdd4d0e6-c2cf-4c3c-bd69-66875a4101dd', 'created_at': datetime.datetime(2026, 11, 3, 6, 50, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 50, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bdd4d0e6-c2cf-4c3c-bd69-66875a4101dd/file', 'properties': {}}, 'image_service': }' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:33 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e64da849-d4b4-4c65-957e-53dc9aa52d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:33 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e64da849-d4b4-4c65-957e-53dc9aa52d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:33 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf1da10f-4ad0-469b-91cd-aaa73b85f084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:33 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] Volume be4a58ff-2d0b-4901-a195-010ce513be5c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-be4a58ff-2d0b-4901-a195-010ce513be5c', 'volume_size': 1, 'image_id': 'bdd4d0e6-c2cf-4c3c-bd69-66875a4101dd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bdd4d0e6-c2cf-4c3c-bd69-66875a4101dd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f6ddec0052b46a28ffa489fceaa1e838', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6a51c0f5dde54233848cf77d6f5e8ffb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '527278357b166857a3e40f6110f45f9aa883db11fc71527ed636106bf83d7c07812c84c11000d7f079b7efb60e61f3ff0b8eea18a0b4d9f9dac02bb0d4e90880', 'id': 'bdd4d0e6-c2cf-4c3c-bd69-66875a4101dd', 'created_at': datetime.datetime(2026, 11, 3, 6, 50, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 50, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bdd4d0e6-c2cf-4c3c-bd69-66875a4101dd/file', 'properties': {}}, 'image_service': } Nov 03 07:50:33 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] Trying to clone be4a58ff-2d0b-4901-a195-010ce513be5c from image bdd4d0e6-c2cf-4c3c-bd69-66875a4101dd at location (None, [{'url': 'file:///opt/stack/data/glance/images/bdd4d0e6-c2cf-4c3c-bd69-66875a4101dd', 'metadata': {}}]). {{(pid=86875) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 07:50:33 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e5de37c-e2b2-4232-882b-58214d98fc76 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:50:33 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-2e5de37c-e2b2-4232-882b-58214d98fc76 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Flow 'volume_create_manager' (9342dc4b-87f3-4801-86cf-c0272cab0266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:33 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-2e5de37c-e2b2-4232-882b-58214d98fc76 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2b5a23a-757d-46bf-9a6f-9054898d79a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:33 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-2e5de37c-e2b2-4232-882b-58214d98fc76 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2b5a23a-757d-46bf-9a6f-9054898d79a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-740726465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=879adc44-dd69-4934-8c5c-d80d809654a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb1730d50a9249af9db23fb7e793a2f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:33Z,use_quota=True,user_id='f21b7781126a4a6d8c5c58a237a6395e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:33 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-2e5de37c-e2b2-4232-882b-58214d98fc76 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96adba8e-c15f-4327-bbfb-e3a915e0f93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:33 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-2e5de37c-e2b2-4232-882b-58214d98fc76 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96adba8e-c15f-4327-bbfb-e3a915e0f93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:33 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-2e5de37c-e2b2-4232-882b-58214d98fc76 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ac87c3e-a59c-4f12-9b79-d22718b0ba4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:33 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-2e5de37c-e2b2-4232-882b-58214d98fc76 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ac87c3e-a59c-4f12-9b79-d22718b0ba4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '879adc44-dd69-4934-8c5c-d80d809654a3', 'volume_name': 'volume-879adc44-dd69-4934-8c5c-d80d809654a3', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:33 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-2e5de37c-e2b2-4232-882b-58214d98fc76 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcbac403-a490-463b-b7f8-19877590dc88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:33 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-2e5de37c-e2b2-4232-882b-58214d98fc76 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcbac403-a490-463b-b7f8-19877590dc88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:33 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-2e5de37c-e2b2-4232-882b-58214d98fc76 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f0374d1-6dfc-495c-9471-70f68808d4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:33 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-2e5de37c-e2b2-4232-882b-58214d98fc76 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Volume 879adc44-dd69-4934-8c5c-d80d809654a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-879adc44-dd69-4934-8c5c-d80d809654a3', 'volume_size': 1} Nov 03 07:50:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-2e5de37c-e2b2-4232-882b-58214d98fc76 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:33 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bdd4d0e6-c2cf-4c3c-bd69-66875a4101dd_3vpxg7frdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86875) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 07:50:33 devstack cinder-volume[86875]: INFO cinder.image.image_utils [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] Image download 0.00 MB at 0.00 MB/s Nov 03 07:50:33 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-430cdae7-48a2-4dfd-bae4-16bd347e53d3 tempest-ProjectReaderTests-502528571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-49164781-a740-4169-8ceb-97294ab13045" returned: 0 in 0.667s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-430cdae7-48a2-4dfd-bae4-16bd347e53d3 tempest-ProjectReaderTests-502528571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-49164781-a740-4169-8ceb-97294ab13045 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:33 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5bd658a5-4407-4e80-b7a0-95e1fcb1c6c4 tempest-CreateVolumesFromSnapshotTest-1905686095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c9e26e15-b756-4ac0-860f-ffed3270f1b2 1073741824" returned: 0 in 0.773s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:33 devstack sudo[106523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-49164781-a740-4169-8ceb-97294ab13045 Nov 03 07:50:33 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:33 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df285c1-e736-4e5f-890b-a078b3ce67f8]: (4, 'raw') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5bd658a5-4407-4e80-b7a0-95e1fcb1c6c4 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c9e26e15-b756-4ac0-860f-ffed3270f1b2 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bdd4d0e6-c2cf-4c3c-bd69-66875a4101dd_3vpxg7frdevstack@QuobyteHD {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:33 devstack sudo[106525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c9e26e15-b756-4ac0-860f-ffed3270f1b2 Nov 03 07:50:33 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:33 devstack sudo[106526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bdd4d0e6-c2cf-4c3c-bd69-66875a4101dd_3vpxg7frdevstack@QuobyteHD Nov 03 07:50:33 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:33 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5bd658a5-4407-4e80-b7a0-95e1fcb1c6c4 tempest-CreateVolumesFromSnapshotTest-1905686095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c9e26e15-b756-4ac0-860f-ffed3270f1b2" returned: 0 in 0.330s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:33 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-5bd658a5-4407-4e80-b7a0-95e1fcb1c6c4 tempest-CreateVolumesFromSnapshotTest-1905686095 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:50:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-5bd658a5-4407-4e80-b7a0-95e1fcb1c6c4 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.205s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a4ab933f-3747-4e80-86d5-8660b5a70f39 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.892s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:33 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a4ab933f-3747-4e80-86d5-8660b5a70f39 tempest-CreateVolumesFromSnapshotTest-1905686095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-767747885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b56efea-b171-45dd-98ab-3db2adc479f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb1730d50a9249af9db23fb7e793a2f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:33Z,use_quota=True,user_id='f21b7781126a4a6d8c5c58a237a6395e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:50:33 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-a4ab933f-3747-4e80-86d5-8660b5a70f39 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Creating volume 3b56efea-b171-45dd-98ab-3db2adc479f5 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:50:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a4ab933f-3747-4e80-86d5-8660b5a70f39 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a4ab933f-3747-4e80-86d5-8660b5a70f39 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:33 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a4ab933f-3747-4e80-86d5-8660b5a70f39 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:33 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a4ab933f-3747-4e80-86d5-8660b5a70f39 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a4ab933f-3747-4e80-86d5-8660b5a70f39 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:33 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a4ab933f-3747-4e80-86d5-8660b5a70f39 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:50:33 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-a4ab933f-3747-4e80-86d5-8660b5a70f39 tempest-CreateVolumesFromSnapshotTest-1905686095 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:50:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a4ab933f-3747-4e80-86d5-8660b5a70f39 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3b56efea-b171-45dd-98ab-3db2adc479f5 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:33 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:33 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0fbc83b-3b42-4cce-b30f-971c9c2b9eb6 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:50:33 devstack sudo[106531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3b56efea-b171-45dd-98ab-3db2adc479f5 1073741824 Nov 03 07:50:33 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:33 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f0fbc83b-3b42-4cce-b30f-971c9c2b9eb6 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Flow 'volume_create_manager' (acec4139-17c3-4fde-a6b5-23661f652465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:33 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f0fbc83b-3b42-4cce-b30f-971c9c2b9eb6 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b2b00eb-3085-452c-8b67-897512c05a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:33 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-430cdae7-48a2-4dfd-bae4-16bd347e53d3 tempest-ProjectReaderTests-502528571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-49164781-a740-4169-8ceb-97294ab13045" returned: 0 in 0.581s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bdd4d0e6-c2cf-4c3c-bd69-66875a4101dd_3vpxg7frdevstack@QuobyteHD" returned: 0 in 0.468s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:33 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5bd658a5-4407-4e80-b7a0-95e1fcb1c6c4 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54c400e9-fd56-4296-8ac1-b3cf87ac5c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9e26e15-b756-4ac0-860f-ffed3270f1b2', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:34 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5bd658a5-4407-4e80-b7a0-95e1fcb1c6c4 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d04b56d5-5bff-49a3-9ee9-0d55a7875e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdd4d0e6-c2cf-4c3c-bd69-66875a4101dd_3vpxg7frdevstack@QuobyteHD {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:34 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-430cdae7-48a2-4dfd-bae4-16bd347e53d3 tempest-ProjectReaderTests-502528571 None] Lock "cinder-quobyte-49164781-a740-4169-8ceb-97294ab13045" released by "delete_volume" :: held 1.360s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:34 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f0fbc83b-3b42-4cce-b30f-971c9c2b9eb6 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b2b00eb-3085-452c-8b67-897512c05a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2114931124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d97b3ae-e12e-4150-886f-47b0f37e6b47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb1730d50a9249af9db23fb7e793a2f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:34Z,use_quota=True,user_id='f21b7781126a4a6d8c5c58a237a6395e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:34 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f0fbc83b-3b42-4cce-b30f-971c9c2b9eb6 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96d5354c-163e-420f-9bc5-62ad30966c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:34 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f0fbc83b-3b42-4cce-b30f-971c9c2b9eb6 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96d5354c-163e-420f-9bc5-62ad30966c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:34 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f0fbc83b-3b42-4cce-b30f-971c9c2b9eb6 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f381e01a-96da-4d3e-ac50-fd2aad0352e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:34 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f0fbc83b-3b42-4cce-b30f-971c9c2b9eb6 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f381e01a-96da-4d3e-ac50-fd2aad0352e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d97b3ae-e12e-4150-886f-47b0f37e6b47', 'volume_name': 'volume-6d97b3ae-e12e-4150-886f-47b0f37e6b47', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:34 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f0fbc83b-3b42-4cce-b30f-971c9c2b9eb6 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fd027c9-0be8-4db5-a125-473140bf7412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:34 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f0fbc83b-3b42-4cce-b30f-971c9c2b9eb6 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fd027c9-0be8-4db5-a125-473140bf7412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:34 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f0fbc83b-3b42-4cce-b30f-971c9c2b9eb6 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcc6a436-bdf7-4969-b89a-326bb1321e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:34 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-f0fbc83b-3b42-4cce-b30f-971c9c2b9eb6 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Volume 6d97b3ae-e12e-4150-886f-47b0f37e6b47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d97b3ae-e12e-4150-886f-47b0f37e6b47', 'volume_size': 1} Nov 03 07:50:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-f0fbc83b-3b42-4cce-b30f-971c9c2b9eb6 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:34 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-5bd658a5-4407-4e80-b7a0-95e1fcb1c6c4 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Volume volume-c9e26e15-b756-4ac0-860f-ffed3270f1b2 (c9e26e15-b756-4ac0-860f-ffed3270f1b2): created successfully Nov 03 07:50:34 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5bd658a5-4407-4e80-b7a0-95e1fcb1c6c4 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d04b56d5-5bff-49a3-9ee9-0d55a7875e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:34 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-5bd658a5-4407-4e80-b7a0-95e1fcb1c6c4 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Flow 'volume_create_manager' (6c54a442-ef76-4dfc-b38d-dd5162fb4195) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:34 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-5bd658a5-4407-4e80-b7a0-95e1fcb1c6c4 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Created volume successfully. Nov 03 07:50:34 devstack sudo[106535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdd4d0e6-c2cf-4c3c-bd69-66875a4101dd_3vpxg7frdevstack@QuobyteHD Nov 03 07:50:34 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:34 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-430cdae7-48a2-4dfd-bae4-16bd347e53d3 tempest-ProjectReaderTests-502528571 None] Created reservations ['3093d0bd-76fd-4c4d-af71-35fabf3e48ea', '13798e55-68f1-4e48-b2c2-543e7e894f23', '51f76fbb-5450-41fd-8cf5-d7d493306378', 'df8dd27f-b205-48f5-97e5-b410f14cf151'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:50:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-430cdae7-48a2-4dfd-bae4-16bd347e53d3 tempest-ProjectReaderTests-502528571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-430cdae7-48a2-4dfd-bae4-16bd347e53d3 tempest-ProjectReaderTests-502528571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:34 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-430cdae7-48a2-4dfd-bae4-16bd347e53d3 tempest-ProjectReaderTests-502528571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:34 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-430cdae7-48a2-4dfd-bae4-16bd347e53d3 tempest-ProjectReaderTests-502528571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-430cdae7-48a2-4dfd-bae4-16bd347e53d3 tempest-ProjectReaderTests-502528571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-430cdae7-48a2-4dfd-bae4-16bd347e53d3 tempest-ProjectReaderTests-502528571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:34 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c6d0f15-4f5f-4878-a2b9-6f8cc0f73d4d tempest-CreateVolumesFromSnapshotTest-1905686095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:50:34 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:50:34 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:34 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7c6d0f15-4f5f-4878-a2b9-6f8cc0f73d4d tempest-CreateVolumesFromSnapshotTest-1905686095 None] Flow 'volume_create_manager' (60dfe946-5a36-46eb-9f05-c570cdbe7b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:34 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:34 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7c6d0f15-4f5f-4878-a2b9-6f8cc0f73d4d tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15a95dfc-7662-41eb-9bb5-6b6c0e07aec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdd4d0e6-c2cf-4c3c-bd69-66875a4101dd_3vpxg7frdevstack@QuobyteHD" returned: 1 in 0.463s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdd4d0e6-c2cf-4c3c-bd69-66875a4101dd_3vpxg7frdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:50:34 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] Temporary image bdd4d0e6-c2cf-4c3c-bd69-66875a4101dd is fetched for user 0591b4506a94453c87bbd5a4a637ade0. {{(pid=86875) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 07:50:34 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7c6d0f15-4f5f-4878-a2b9-6f8cc0f73d4d tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15a95dfc-7662-41eb-9bb5-6b6c0e07aec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2038072985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63415a03-b3db-4fac-9f0f-5a2e3d952fb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb1730d50a9249af9db23fb7e793a2f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:34Z,use_quota=True,user_id='f21b7781126a4a6d8c5c58a237a6395e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:34 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7c6d0f15-4f5f-4878-a2b9-6f8cc0f73d4d tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdc38ee0-5ac8-4d6f-878f-e211aa0d3482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:34 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7c6d0f15-4f5f-4878-a2b9-6f8cc0f73d4d tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdc38ee0-5ac8-4d6f-878f-e211aa0d3482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:34 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7c6d0f15-4f5f-4878-a2b9-6f8cc0f73d4d tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (023f0769-3aae-4e14-89aa-5befbea76a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:34 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7c6d0f15-4f5f-4878-a2b9-6f8cc0f73d4d tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (023f0769-3aae-4e14-89aa-5befbea76a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63415a03-b3db-4fac-9f0f-5a2e3d952fb0', 'volume_name': 'volume-63415a03-b3db-4fac-9f0f-5a2e3d952fb0', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:34 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7c6d0f15-4f5f-4878-a2b9-6f8cc0f73d4d tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfd8a580-1fe5-4af1-97f8-c15e8440b5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:34 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7c6d0f15-4f5f-4878-a2b9-6f8cc0f73d4d tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfd8a580-1fe5-4af1-97f8-c15e8440b5cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:34 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7c6d0f15-4f5f-4878-a2b9-6f8cc0f73d4d tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b677615-0af8-4b5b-92e2-b4c77302ad90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:34 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-7c6d0f15-4f5f-4878-a2b9-6f8cc0f73d4d tempest-CreateVolumesFromSnapshotTest-1905686095 None] Volume 63415a03-b3db-4fac-9f0f-5a2e3d952fb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63415a03-b3db-4fac-9f0f-5a2e3d952fb0', 'volume_size': 1} Nov 03 07:50:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7c6d0f15-4f5f-4878-a2b9-6f8cc0f73d4d tempest-CreateVolumesFromSnapshotTest-1905686095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:34 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1a524f-1891-4d3a-bc58-ddfd4cd1f9e2]: (4, 'raw') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bdd4d0e6-c2cf-4c3c-bd69-66875a4101dd_3vpxg7frdevstack@QuobyteHD {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:34 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:34 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a4ab933f-3747-4e80-86d5-8660b5a70f39 tempest-CreateVolumesFromSnapshotTest-1905686095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3b56efea-b171-45dd-98ab-3db2adc479f5 1073741824" returned: 0 in 0.844s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-430cdae7-48a2-4dfd-bae4-16bd347e53d3 tempest-ProjectReaderTests-502528571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.306s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:34 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-430cdae7-48a2-4dfd-bae4-16bd347e53d3 tempest-ProjectReaderTests-502528571 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:50:34 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-430cdae7-48a2-4dfd-bae4-16bd347e53d3 tempest-ProjectReaderTests-502528571 None] Deleted volume successfully. Nov 03 07:50:34 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-430cdae7-48a2-4dfd-bae4-16bd347e53d3 tempest-ProjectReaderTests-502528571 None] Lock "cinder-49164781-a740-4169-8ceb-97294ab13045-delete_volume" released by "delete_volume" :: held 2.437s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a4ab933f-3747-4e80-86d5-8660b5a70f39 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3b56efea-b171-45dd-98ab-3db2adc479f5 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:34 devstack sudo[106547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bdd4d0e6-c2cf-4c3c-bd69-66875a4101dd_3vpxg7frdevstack@QuobyteHD Nov 03 07:50:34 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:34 devstack sudo[106549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3b56efea-b171-45dd-98ab-3db2adc479f5 Nov 03 07:50:34 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:35 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bdd4d0e6-c2cf-4c3c-bd69-66875a4101dd_3vpxg7frdevstack@QuobyteHD" returned: 0 in 0.407s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdd4d0e6-c2cf-4c3c-bd69-66875a4101dd_3vpxg7frdevstack@QuobyteHD {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:35 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a4ab933f-3747-4e80-86d5-8660b5a70f39 tempest-CreateVolumesFromSnapshotTest-1905686095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3b56efea-b171-45dd-98ab-3db2adc479f5" returned: 0 in 0.365s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:35 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a4ab933f-3747-4e80-86d5-8660b5a70f39 tempest-CreateVolumesFromSnapshotTest-1905686095 None] <== create_volume: return (1284ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:50:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a4ab933f-3747-4e80-86d5-8660b5a70f39 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.288s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-2e5de37c-e2b2-4232-882b-58214d98fc76 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.805s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:35 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-2e5de37c-e2b2-4232-882b-58214d98fc76 tempest-CreateVolumesFromSnapshotTest-1905686095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-740726465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=879adc44-dd69-4934-8c5c-d80d809654a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb1730d50a9249af9db23fb7e793a2f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:33Z,use_quota=True,user_id='f21b7781126a4a6d8c5c58a237a6395e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:50:35 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-2e5de37c-e2b2-4232-882b-58214d98fc76 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Creating volume 879adc44-dd69-4934-8c5c-d80d809654a3 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:50:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-2e5de37c-e2b2-4232-882b-58214d98fc76 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-2e5de37c-e2b2-4232-882b-58214d98fc76 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:35 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-2e5de37c-e2b2-4232-882b-58214d98fc76 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:35 devstack sudo[106554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdd4d0e6-c2cf-4c3c-bd69-66875a4101dd_3vpxg7frdevstack@QuobyteHD Nov 03 07:50:35 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:35 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-2e5de37c-e2b2-4232-882b-58214d98fc76 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-2e5de37c-e2b2-4232-882b-58214d98fc76 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:35 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-2e5de37c-e2b2-4232-882b-58214d98fc76 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:50:35 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-2e5de37c-e2b2-4232-882b-58214d98fc76 tempest-CreateVolumesFromSnapshotTest-1905686095 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:50:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2e5de37c-e2b2-4232-882b-58214d98fc76 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-879adc44-dd69-4934-8c5c-d80d809654a3 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:35 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a4ab933f-3747-4e80-86d5-8660b5a70f39 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d10c84a8-c62b-4e22-8c64-eeea85a6a9d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b56efea-b171-45dd-98ab-3db2adc479f5', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:35 devstack sudo[106557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-879adc44-dd69-4934-8c5c-d80d809654a3 1073741824 Nov 03 07:50:35 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a4ab933f-3747-4e80-86d5-8660b5a70f39 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05444e42-3fc6-4cb2-8d63-9fd33f64df0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:35 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:35 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-f649acfb-1bf2-4a3e-b7af-14ef4929c691 tempest-ProjectReaderTests-502528571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:50:35 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f649acfb-1bf2-4a3e-b7af-14ef4929c691 tempest-ProjectReaderTests-502528571 None] Flow 'volume_create_manager' (c9c445cb-783e-4422-b75a-b86c056aa959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:35 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f649acfb-1bf2-4a3e-b7af-14ef4929c691 tempest-ProjectReaderTests-502528571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7144031-0890-4e26-a0b2-63a267393464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:35 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-a4ab933f-3747-4e80-86d5-8660b5a70f39 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Volume volume-3b56efea-b171-45dd-98ab-3db2adc479f5 (3b56efea-b171-45dd-98ab-3db2adc479f5): created successfully Nov 03 07:50:35 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a4ab933f-3747-4e80-86d5-8660b5a70f39 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05444e42-3fc6-4cb2-8d63-9fd33f64df0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:35 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a4ab933f-3747-4e80-86d5-8660b5a70f39 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Flow 'volume_create_manager' (66c1d3f2-8857-4741-a908-f29a68883f08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:35 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f649acfb-1bf2-4a3e-b7af-14ef4929c691 tempest-ProjectReaderTests-502528571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7144031-0890-4e26-a0b2-63a267393464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-515877576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5fbef2f-4815-45fd-ad04-e52025007055,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8add37b5fee54b3b86fd2c461f733a93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:35Z,use_quota=True,user_id='f6a2a55bfa844c998456e9021f775e22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:35 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f649acfb-1bf2-4a3e-b7af-14ef4929c691 tempest-ProjectReaderTests-502528571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c25e7878-816b-428a-b92d-1c7eb9074ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:35 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f649acfb-1bf2-4a3e-b7af-14ef4929c691 tempest-ProjectReaderTests-502528571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c25e7878-816b-428a-b92d-1c7eb9074ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:35 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f649acfb-1bf2-4a3e-b7af-14ef4929c691 tempest-ProjectReaderTests-502528571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d73664d-aa93-4bb1-bdaf-3f273a22baa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:35 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f649acfb-1bf2-4a3e-b7af-14ef4929c691 tempest-ProjectReaderTests-502528571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d73664d-aa93-4bb1-bdaf-3f273a22baa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5fbef2f-4815-45fd-ad04-e52025007055', 'volume_name': 'volume-b5fbef2f-4815-45fd-ad04-e52025007055', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:35 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f649acfb-1bf2-4a3e-b7af-14ef4929c691 tempest-ProjectReaderTests-502528571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aff61400-79a7-4cee-81f4-bebdaa165af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:35 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f649acfb-1bf2-4a3e-b7af-14ef4929c691 tempest-ProjectReaderTests-502528571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aff61400-79a7-4cee-81f4-bebdaa165af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:35 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f649acfb-1bf2-4a3e-b7af-14ef4929c691 tempest-ProjectReaderTests-502528571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9fb68e2-419c-4de5-aaf7-a7a0917b7afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:35 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-f649acfb-1bf2-4a3e-b7af-14ef4929c691 tempest-ProjectReaderTests-502528571 None] Volume b5fbef2f-4815-45fd-ad04-e52025007055: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5fbef2f-4815-45fd-ad04-e52025007055', 'volume_size': 1} Nov 03 07:50:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-f649acfb-1bf2-4a3e-b7af-14ef4929c691 tempest-ProjectReaderTests-502528571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:35 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-a4ab933f-3747-4e80-86d5-8660b5a70f39 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Created volume successfully. Nov 03 07:50:35 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdd4d0e6-c2cf-4c3c-bd69-66875a4101dd_3vpxg7frdevstack@QuobyteHD" returned: 1 in 0.476s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdd4d0e6-c2cf-4c3c-bd69-66875a4101dd_3vpxg7frdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:50:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:35 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2e5de37c-e2b2-4232-882b-58214d98fc76 tempest-CreateVolumesFromSnapshotTest-1905686095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-879adc44-dd69-4934-8c5c-d80d809654a3 1073741824" returned: 0 in 0.568s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2e5de37c-e2b2-4232-882b-58214d98fc76 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-879adc44-dd69-4934-8c5c-d80d809654a3 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:35 devstack sudo[106566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-879adc44-dd69-4934-8c5c-d80d809654a3 Nov 03 07:50:35 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:35 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2e5de37c-e2b2-4232-882b-58214d98fc76 tempest-CreateVolumesFromSnapshotTest-1905686095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-879adc44-dd69-4934-8c5c-d80d809654a3" returned: 0 in 0.244s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:35 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-2e5de37c-e2b2-4232-882b-58214d98fc76 tempest-CreateVolumesFromSnapshotTest-1905686095 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:50:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-2e5de37c-e2b2-4232-882b-58214d98fc76 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-f0fbc83b-3b42-4cce-b30f-971c9c2b9eb6 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.873s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:35 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-f0fbc83b-3b42-4cce-b30f-971c9c2b9eb6 tempest-CreateVolumesFromSnapshotTest-1905686095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2114931124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d97b3ae-e12e-4150-886f-47b0f37e6b47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb1730d50a9249af9db23fb7e793a2f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:34Z,use_quota=True,user_id='f21b7781126a4a6d8c5c58a237a6395e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:50:35 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-f0fbc83b-3b42-4cce-b30f-971c9c2b9eb6 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Creating volume 6d97b3ae-e12e-4150-886f-47b0f37e6b47 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:50:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-f0fbc83b-3b42-4cce-b30f-971c9c2b9eb6 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-f0fbc83b-3b42-4cce-b30f-971c9c2b9eb6 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:35 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-f0fbc83b-3b42-4cce-b30f-971c9c2b9eb6 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:36 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-f0fbc83b-3b42-4cce-b30f-971c9c2b9eb6 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:36 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-f0fbc83b-3b42-4cce-b30f-971c9c2b9eb6 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:36 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-f0fbc83b-3b42-4cce-b30f-971c9c2b9eb6 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:50:36 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-f0fbc83b-3b42-4cce-b30f-971c9c2b9eb6 tempest-CreateVolumesFromSnapshotTest-1905686095 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:50:36 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f0fbc83b-3b42-4cce-b30f-971c9c2b9eb6 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6d97b3ae-e12e-4150-886f-47b0f37e6b47 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:36 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-2e5de37c-e2b2-4232-882b-58214d98fc76 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f0374d1-6dfc-495c-9471-70f68808d4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-879adc44-dd69-4934-8c5c-d80d809654a3', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:36 devstack sudo[106569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6d97b3ae-e12e-4150-886f-47b0f37e6b47 1073741824 Nov 03 07:50:36 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-2e5de37c-e2b2-4232-882b-58214d98fc76 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2417fbf9-c6be-4001-883b-e7b1d74e569b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:36 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:36 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-2e5de37c-e2b2-4232-882b-58214d98fc76 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Volume volume-879adc44-dd69-4934-8c5c-d80d809654a3 (879adc44-dd69-4934-8c5c-d80d809654a3): created successfully Nov 03 07:50:36 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-2e5de37c-e2b2-4232-882b-58214d98fc76 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2417fbf9-c6be-4001-883b-e7b1d74e569b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:36 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-2e5de37c-e2b2-4232-882b-58214d98fc76 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Flow 'volume_create_manager' (9342dc4b-87f3-4801-86cf-c0272cab0266) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:36 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-2e5de37c-e2b2-4232-882b-58214d98fc76 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Created volume successfully. Nov 03 07:50:36 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:36 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f0fbc83b-3b42-4cce-b30f-971c9c2b9eb6 tempest-CreateVolumesFromSnapshotTest-1905686095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6d97b3ae-e12e-4150-886f-47b0f37e6b47 1073741824" returned: 0 in 0.477s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:36 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f0fbc83b-3b42-4cce-b30f-971c9c2b9eb6 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6d97b3ae-e12e-4150-886f-47b0f37e6b47 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:36 devstack sudo[106575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6d97b3ae-e12e-4150-886f-47b0f37e6b47 Nov 03 07:50:36 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:36 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:36 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f0fbc83b-3b42-4cce-b30f-971c9c2b9eb6 tempest-CreateVolumesFromSnapshotTest-1905686095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6d97b3ae-e12e-4150-886f-47b0f37e6b47" returned: 0 in 0.251s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:36 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-f0fbc83b-3b42-4cce-b30f-971c9c2b9eb6 tempest-CreateVolumesFromSnapshotTest-1905686095 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:50:36 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-f0fbc83b-3b42-4cce-b30f-971c9c2b9eb6 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:36 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7c6d0f15-4f5f-4878-a2b9-6f8cc0f73d4d tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.213s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:36 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-7c6d0f15-4f5f-4878-a2b9-6f8cc0f73d4d tempest-CreateVolumesFromSnapshotTest-1905686095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2038072985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63415a03-b3db-4fac-9f0f-5a2e3d952fb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb1730d50a9249af9db23fb7e793a2f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:34Z,use_quota=True,user_id='f21b7781126a4a6d8c5c58a237a6395e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:50:36 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-7c6d0f15-4f5f-4878-a2b9-6f8cc0f73d4d tempest-CreateVolumesFromSnapshotTest-1905686095 None] Creating volume 63415a03-b3db-4fac-9f0f-5a2e3d952fb0 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:50:36 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7c6d0f15-4f5f-4878-a2b9-6f8cc0f73d4d tempest-CreateVolumesFromSnapshotTest-1905686095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:36 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7c6d0f15-4f5f-4878-a2b9-6f8cc0f73d4d tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:36 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-7c6d0f15-4f5f-4878-a2b9-6f8cc0f73d4d tempest-CreateVolumesFromSnapshotTest-1905686095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:36 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-7c6d0f15-4f5f-4878-a2b9-6f8cc0f73d4d tempest-CreateVolumesFromSnapshotTest-1905686095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:36 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7c6d0f15-4f5f-4878-a2b9-6f8cc0f73d4d tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:36 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-7c6d0f15-4f5f-4878-a2b9-6f8cc0f73d4d tempest-CreateVolumesFromSnapshotTest-1905686095 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:50:36 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-7c6d0f15-4f5f-4878-a2b9-6f8cc0f73d4d tempest-CreateVolumesFromSnapshotTest-1905686095 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:50:36 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7c6d0f15-4f5f-4878-a2b9-6f8cc0f73d4d tempest-CreateVolumesFromSnapshotTest-1905686095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-63415a03-b3db-4fac-9f0f-5a2e3d952fb0 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:36 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f0fbc83b-3b42-4cce-b30f-971c9c2b9eb6 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcc6a436-bdf7-4969-b89a-326bb1321e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d97b3ae-e12e-4150-886f-47b0f37e6b47', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:36 devstack sudo[106578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-63415a03-b3db-4fac-9f0f-5a2e3d952fb0 1073741824 Nov 03 07:50:36 devstack sudo[106578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:36 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f0fbc83b-3b42-4cce-b30f-971c9c2b9eb6 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df7cc08a-0a74-48d7-8ed5-ac04e29bc1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:36 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-f0fbc83b-3b42-4cce-b30f-971c9c2b9eb6 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Volume volume-6d97b3ae-e12e-4150-886f-47b0f37e6b47 (6d97b3ae-e12e-4150-886f-47b0f37e6b47): created successfully Nov 03 07:50:36 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f0fbc83b-3b42-4cce-b30f-971c9c2b9eb6 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df7cc08a-0a74-48d7-8ed5-ac04e29bc1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:36 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f0fbc83b-3b42-4cce-b30f-971c9c2b9eb6 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Flow 'volume_create_manager' (acec4139-17c3-4fde-a6b5-23661f652465) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:36 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-f0fbc83b-3b42-4cce-b30f-971c9c2b9eb6 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Created volume successfully. Nov 03 07:50:37 devstack sudo[106578]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7c6d0f15-4f5f-4878-a2b9-6f8cc0f73d4d tempest-CreateVolumesFromSnapshotTest-1905686095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-63415a03-b3db-4fac-9f0f-5a2e3d952fb0 1073741824" returned: 0 in 0.442s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7c6d0f15-4f5f-4878-a2b9-6f8cc0f73d4d tempest-CreateVolumesFromSnapshotTest-1905686095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-63415a03-b3db-4fac-9f0f-5a2e3d952fb0 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:37 devstack sudo[106586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-63415a03-b3db-4fac-9f0f-5a2e3d952fb0 Nov 03 07:50:37 devstack sudo[106586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:37 devstack sudo[106586]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7c6d0f15-4f5f-4878-a2b9-6f8cc0f73d4d tempest-CreateVolumesFromSnapshotTest-1905686095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-63415a03-b3db-4fac-9f0f-5a2e3d952fb0" returned: 0 in 0.243s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:37 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-7c6d0f15-4f5f-4878-a2b9-6f8cc0f73d4d tempest-CreateVolumesFromSnapshotTest-1905686095 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:50:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7c6d0f15-4f5f-4878-a2b9-6f8cc0f73d4d tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-f649acfb-1bf2-4a3e-b7af-14ef4929c691 tempest-ProjectReaderTests-502528571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.151s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:37 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-f649acfb-1bf2-4a3e-b7af-14ef4929c691 tempest-ProjectReaderTests-502528571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-515877576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5fbef2f-4815-45fd-ad04-e52025007055,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8add37b5fee54b3b86fd2c461f733a93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:35Z,use_quota=True,user_id='f6a2a55bfa844c998456e9021f775e22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:50:37 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-f649acfb-1bf2-4a3e-b7af-14ef4929c691 tempest-ProjectReaderTests-502528571 None] Creating volume b5fbef2f-4815-45fd-ad04-e52025007055 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:50:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-f649acfb-1bf2-4a3e-b7af-14ef4929c691 tempest-ProjectReaderTests-502528571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-f649acfb-1bf2-4a3e-b7af-14ef4929c691 tempest-ProjectReaderTests-502528571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:37 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-f649acfb-1bf2-4a3e-b7af-14ef4929c691 tempest-ProjectReaderTests-502528571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:37 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-f649acfb-1bf2-4a3e-b7af-14ef4929c691 tempest-ProjectReaderTests-502528571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-f649acfb-1bf2-4a3e-b7af-14ef4929c691 tempest-ProjectReaderTests-502528571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:37 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-f649acfb-1bf2-4a3e-b7af-14ef4929c691 tempest-ProjectReaderTests-502528571 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:50:37 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-f649acfb-1bf2-4a3e-b7af-14ef4929c691 tempest-ProjectReaderTests-502528571 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:50:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f649acfb-1bf2-4a3e-b7af-14ef4929c691 tempest-ProjectReaderTests-502528571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b5fbef2f-4815-45fd-ad04-e52025007055 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:37 devstack sudo[106589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b5fbef2f-4815-45fd-ad04-e52025007055 1073741824 Nov 03 07:50:37 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:37 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7c6d0f15-4f5f-4878-a2b9-6f8cc0f73d4d tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b677615-0af8-4b5b-92e2-b4c77302ad90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63415a03-b3db-4fac-9f0f-5a2e3d952fb0', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:37 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7c6d0f15-4f5f-4878-a2b9-6f8cc0f73d4d tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55d6f253-9431-46b4-aec0-2f74ea81aeda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:37 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-7c6d0f15-4f5f-4878-a2b9-6f8cc0f73d4d tempest-CreateVolumesFromSnapshotTest-1905686095 None] Volume volume-63415a03-b3db-4fac-9f0f-5a2e3d952fb0 (63415a03-b3db-4fac-9f0f-5a2e3d952fb0): created successfully Nov 03 07:50:37 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7c6d0f15-4f5f-4878-a2b9-6f8cc0f73d4d tempest-CreateVolumesFromSnapshotTest-1905686095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55d6f253-9431-46b4-aec0-2f74ea81aeda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:37 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7c6d0f15-4f5f-4878-a2b9-6f8cc0f73d4d tempest-CreateVolumesFromSnapshotTest-1905686095 None] Flow 'volume_create_manager' (60dfe946-5a36-46eb-9f05-c570cdbe7b05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:37 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-7c6d0f15-4f5f-4878-a2b9-6f8cc0f73d4d tempest-CreateVolumesFromSnapshotTest-1905686095 None] Created volume successfully. Nov 03 07:50:37 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-2d6991ee-c0d3-49b1-901b-5f3415031be3 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Acquiring lock "cinder-63415a03-b3db-4fac-9f0f-5a2e3d952fb0-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:37 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-2d6991ee-c0d3-49b1-901b-5f3415031be3 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "cinder-63415a03-b3db-4fac-9f0f-5a2e3d952fb0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:37 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-2d6991ee-c0d3-49b1-901b-5f3415031be3 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Acquiring lock "cinder-quobyte-63415a03-b3db-4fac-9f0f-5a2e3d952fb0" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:37 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-2d6991ee-c0d3-49b1-901b-5f3415031be3 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "cinder-quobyte-63415a03-b3db-4fac-9f0f-5a2e3d952fb0" acquired by "delete_volume" :: waited 0.022s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:37 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5181ce6-8e47-4293-b6fb-a39ff0d356a7]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2d6991ee-c0d3-49b1-901b-5f3415031be3 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-63415a03-b3db-4fac-9f0f-5a2e3d952fb0 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:38 devstack sudo[106594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-63415a03-b3db-4fac-9f0f-5a2e3d952fb0 Nov 03 07:50:38 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:38 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f649acfb-1bf2-4a3e-b7af-14ef4929c691 tempest-ProjectReaderTests-502528571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b5fbef2f-4815-45fd-ad04-e52025007055 1073741824" returned: 0 in 0.538s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f649acfb-1bf2-4a3e-b7af-14ef4929c691 tempest-ProjectReaderTests-502528571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b5fbef2f-4815-45fd-ad04-e52025007055 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:38 devstack sudo[106598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b5fbef2f-4815-45fd-ad04-e52025007055 Nov 03 07:50:38 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:38 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2d6991ee-c0d3-49b1-901b-5f3415031be3 tempest-CreateVolumesFromSnapshotTest-1905686095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-63415a03-b3db-4fac-9f0f-5a2e3d952fb0" returned: 0 in 0.390s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2d6991ee-c0d3-49b1-901b-5f3415031be3 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-63415a03-b3db-4fac-9f0f-5a2e3d952fb0 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:38 devstack sudo[106603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-63415a03-b3db-4fac-9f0f-5a2e3d952fb0 Nov 03 07:50:38 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:38 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f649acfb-1bf2-4a3e-b7af-14ef4929c691 tempest-ProjectReaderTests-502528571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b5fbef2f-4815-45fd-ad04-e52025007055" returned: 0 in 0.278s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:38 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-f649acfb-1bf2-4a3e-b7af-14ef4929c691 tempest-ProjectReaderTests-502528571 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:50:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-f649acfb-1bf2-4a3e-b7af-14ef4929c691 tempest-ProjectReaderTests-502528571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.864s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:38 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be4a58ff-2d0b-4901-a195-010ce513be5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a51c0f5dde54233848cf77d6f5e8ffb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:32Z,use_quota=True,user_id='0591b4506a94453c87bbd5a4a637ade0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:50:38 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] Creating volume be4a58ff-2d0b-4901-a195-010ce513be5c {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:50:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:38 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:38 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:38 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:50:38 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:50:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-be4a58ff-2d0b-4901-a195-010ce513be5c 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:38 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f649acfb-1bf2-4a3e-b7af-14ef4929c691 tempest-ProjectReaderTests-502528571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9fb68e2-419c-4de5-aaf7-a7a0917b7afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5fbef2f-4815-45fd-ad04-e52025007055', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:38 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f649acfb-1bf2-4a3e-b7af-14ef4929c691 tempest-ProjectReaderTests-502528571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20117577-2b9e-46ef-abaf-c78c8b2af02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:38 devstack sudo[106606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-be4a58ff-2d0b-4901-a195-010ce513be5c 1073741824 Nov 03 07:50:38 devstack sudo[106606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:38 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-f649acfb-1bf2-4a3e-b7af-14ef4929c691 tempest-ProjectReaderTests-502528571 None] Volume volume-b5fbef2f-4815-45fd-ad04-e52025007055 (b5fbef2f-4815-45fd-ad04-e52025007055): created successfully Nov 03 07:50:38 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f649acfb-1bf2-4a3e-b7af-14ef4929c691 tempest-ProjectReaderTests-502528571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20117577-2b9e-46ef-abaf-c78c8b2af02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:38 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-f649acfb-1bf2-4a3e-b7af-14ef4929c691 tempest-ProjectReaderTests-502528571 None] Flow 'volume_create_manager' (c9c445cb-783e-4422-b75a-b86c056aa959) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:38 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-f649acfb-1bf2-4a3e-b7af-14ef4929c691 tempest-ProjectReaderTests-502528571 None] Created volume successfully. Nov 03 07:50:38 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2d6991ee-c0d3-49b1-901b-5f3415031be3 tempest-CreateVolumesFromSnapshotTest-1905686095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-63415a03-b3db-4fac-9f0f-5a2e3d952fb0" returned: 0 in 0.317s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:38 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-2d6991ee-c0d3-49b1-901b-5f3415031be3 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "cinder-quobyte-63415a03-b3db-4fac-9f0f-5a2e3d952fb0" released by "delete_volume" :: held 0.762s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:38 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-2d6991ee-c0d3-49b1-901b-5f3415031be3 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Created reservations ['862f9996-a4d3-4bcc-90ae-4a57d9d51065', '16b41018-bfb6-4913-b3dd-ce1a47b612d2', '368a04f9-bc20-449a-a868-d13b86953276', '790969b0-7433-46b7-9b01-e877d7f77c31'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:50:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-2d6991ee-c0d3-49b1-901b-5f3415031be3 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-2d6991ee-c0d3-49b1-901b-5f3415031be3 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:38 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-2d6991ee-c0d3-49b1-901b-5f3415031be3 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:38 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-2d6991ee-c0d3-49b1-901b-5f3415031be3 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-2d6991ee-c0d3-49b1-901b-5f3415031be3 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2d6991ee-c0d3-49b1-901b-5f3415031be3 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:38 devstack sudo[106612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:50:38 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:38 devstack sudo[106606]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-be4a58ff-2d0b-4901-a195-010ce513be5c 1073741824" returned: 0 in 0.560s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:38 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d02e5ec2-4a7e-43b0-bf16-dec52eeacaf4 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Acquiring lock "cinder-6d97b3ae-e12e-4150-886f-47b0f37e6b47-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:38 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d02e5ec2-4a7e-43b0-bf16-dec52eeacaf4 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "cinder-6d97b3ae-e12e-4150-886f-47b0f37e6b47-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-be4a58ff-2d0b-4901-a195-010ce513be5c {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:39 devstack sudo[106616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-be4a58ff-2d0b-4901-a195-010ce513be5c Nov 03 07:50:39 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:39 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d02e5ec2-4a7e-43b0-bf16-dec52eeacaf4 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Acquiring lock "cinder-quobyte-6d97b3ae-e12e-4150-886f-47b0f37e6b47" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:39 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:39 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d02e5ec2-4a7e-43b0-bf16-dec52eeacaf4 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "cinder-quobyte-6d97b3ae-e12e-4150-886f-47b0f37e6b47" acquired by "delete_volume" :: waited 0.019s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2d6991ee-c0d3-49b1-901b-5f3415031be3 tempest-CreateVolumesFromSnapshotTest-1905686095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.341s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:39 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-2d6991ee-c0d3-49b1-901b-5f3415031be3 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:50:39 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-2d6991ee-c0d3-49b1-901b-5f3415031be3 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Deleted volume successfully. Nov 03 07:50:39 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[50dafc81-e6f5-4de6-b5cb-6eb0a159c1ed]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d02e5ec2-4a7e-43b0-bf16-dec52eeacaf4 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6d97b3ae-e12e-4150-886f-47b0f37e6b47 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:39 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-2d6991ee-c0d3-49b1-901b-5f3415031be3 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "cinder-63415a03-b3db-4fac-9f0f-5a2e3d952fb0-delete_volume" released by "delete_volume" :: held 1.358s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:39 devstack sudo[106618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6d97b3ae-e12e-4150-886f-47b0f37e6b47 Nov 03 07:50:39 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:39 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-be4a58ff-2d0b-4901-a195-010ce513be5c" returned: 0 in 0.309s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:39 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:50:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:39 devstack cinder-volume[86875]: DEBUG cinder.volume.volume_utils [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] Attempting download of bdd4d0e6-c2cf-4c3c-bd69-66875a4101dd ((None, [{'url': 'file:///opt/stack/data/glance/images/bdd4d0e6-c2cf-4c3c-bd69-66875a4101dd', 'metadata': {}}])) to volume be4a58ff-2d0b-4901-a195-010ce513be5c. {{(pid=86875) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 07:50:39 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-53a8fe4b-34c4-4042-8303-1e172d735a3a tempest-ProjectReaderTests-502528571 None] Acquiring lock "cinder-b5fbef2f-4815-45fd-ad04-e52025007055-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:39 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-53a8fe4b-34c4-4042-8303-1e172d735a3a tempest-ProjectReaderTests-502528571 None] Lock "cinder-b5fbef2f-4815-45fd-ad04-e52025007055-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:39 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-53a8fe4b-34c4-4042-8303-1e172d735a3a tempest-ProjectReaderTests-502528571 None] Acquiring lock "cinder-quobyte-b5fbef2f-4815-45fd-ad04-e52025007055" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:39 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-53a8fe4b-34c4-4042-8303-1e172d735a3a tempest-ProjectReaderTests-502528571 None] Lock "cinder-quobyte-b5fbef2f-4815-45fd-ad04-e52025007055" acquired by "delete_volume" :: waited 0.016s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:39 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a6d64e-4a7f-43cd-8261-8460715f92d5]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-53a8fe4b-34c4-4042-8303-1e172d735a3a tempest-ProjectReaderTests-502528571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b5fbef2f-4815-45fd-ad04-e52025007055 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:39 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d02e5ec2-4a7e-43b0-bf16-dec52eeacaf4 tempest-CreateVolumesFromSnapshotTest-1905686095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6d97b3ae-e12e-4150-886f-47b0f37e6b47" returned: 0 in 0.548s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d02e5ec2-4a7e-43b0-bf16-dec52eeacaf4 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6d97b3ae-e12e-4150-886f-47b0f37e6b47 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:39 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6d97b3ae-e12e-4150-886f-47b0f37e6b47 Nov 03 07:50:39 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:39 devstack sudo[106624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b5fbef2f-4815-45fd-ad04-e52025007055 Nov 03 07:50:39 devstack sudo[106624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:39 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[44dddf5d-142c-4c06-b524-f04e47855110]: (4, 'raw') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bdd4d0e6-c2cf-4c3c-bd69-66875a4101dd_a13rbp09 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:39 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d02e5ec2-4a7e-43b0-bf16-dec52eeacaf4 tempest-CreateVolumesFromSnapshotTest-1905686095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6d97b3ae-e12e-4150-886f-47b0f37e6b47" returned: 0 in 0.293s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:39 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d02e5ec2-4a7e-43b0-bf16-dec52eeacaf4 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "cinder-quobyte-6d97b3ae-e12e-4150-886f-47b0f37e6b47" released by "delete_volume" :: held 0.902s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:40 devstack sudo[106624]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-53a8fe4b-34c4-4042-8303-1e172d735a3a tempest-ProjectReaderTests-502528571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b5fbef2f-4815-45fd-ad04-e52025007055" returned: 0 in 0.396s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:40 devstack sudo[106628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bdd4d0e6-c2cf-4c3c-bd69-66875a4101dd_a13rbp09 Nov 03 07:50:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-53a8fe4b-34c4-4042-8303-1e172d735a3a tempest-ProjectReaderTests-502528571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b5fbef2f-4815-45fd-ad04-e52025007055 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:40 devstack sudo[106628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:40 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b5fbef2f-4815-45fd-ad04-e52025007055 Nov 03 07:50:40 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:40 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-d02e5ec2-4a7e-43b0-bf16-dec52eeacaf4 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Created reservations ['02529034-6cb0-4ace-82cd-d4cd29264090', '04ca31dd-1bac-4b59-a341-39ad72c37916', '57e013af-3891-45ff-be3f-2c6c3b055c00', 'a90add4d-66d6-40b6-9700-fbf62d890a46'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:50:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-d02e5ec2-4a7e-43b0-bf16-dec52eeacaf4 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-d02e5ec2-4a7e-43b0-bf16-dec52eeacaf4 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:40 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-d02e5ec2-4a7e-43b0-bf16-dec52eeacaf4 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:40 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-d02e5ec2-4a7e-43b0-bf16-dec52eeacaf4 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-d02e5ec2-4a7e-43b0-bf16-dec52eeacaf4 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d02e5ec2-4a7e-43b0-bf16-dec52eeacaf4 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:40 devstack sudo[106637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:50:40 devstack sudo[106637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:40 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-29daa709-d270-4072-b48d-1c8b5a7a0916 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Acquiring lock "cinder-879adc44-dd69-4934-8c5c-d80d809654a3-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:40 devstack sudo[106628]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bdd4d0e6-c2cf-4c3c-bd69-66875a4101dd_a13rbp09" returned: 0 in 0.432s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bdd4d0e6-c2cf-4c3c-bd69-66875a4101dd_a13rbp09 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:40 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-29daa709-d270-4072-b48d-1c8b5a7a0916 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "cinder-879adc44-dd69-4934-8c5c-d80d809654a3-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:40 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-53a8fe4b-34c4-4042-8303-1e172d735a3a tempest-ProjectReaderTests-502528571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-b5fbef2f-4815-45fd-ad04-e52025007055" returned: 0 in 0.411s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:40 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-29daa709-d270-4072-b48d-1c8b5a7a0916 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Acquiring lock "cinder-quobyte-879adc44-dd69-4934-8c5c-d80d809654a3" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:40 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-53a8fe4b-34c4-4042-8303-1e172d735a3a tempest-ProjectReaderTests-502528571 None] Lock "cinder-quobyte-b5fbef2f-4815-45fd-ad04-e52025007055" released by "delete_volume" :: held 0.864s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:40 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-29daa709-d270-4072-b48d-1c8b5a7a0916 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "cinder-quobyte-879adc44-dd69-4934-8c5c-d80d809654a3" acquired by "delete_volume" :: waited 0.035s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:40 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9e17bb-5ba7-4c82-972d-8b15cfe1b165]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-29daa709-d270-4072-b48d-1c8b5a7a0916 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-879adc44-dd69-4934-8c5c-d80d809654a3 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:40 devstack sudo[106642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bdd4d0e6-c2cf-4c3c-bd69-66875a4101dd_a13rbp09 Nov 03 07:50:40 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:40 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-53a8fe4b-34c4-4042-8303-1e172d735a3a tempest-ProjectReaderTests-502528571 None] Created reservations ['f202f6ab-0fbd-4296-b1fb-35bbf96c5899', '0d47491d-1dac-4cbc-9771-61c64d9c5409', '4fd09fd1-10a3-43a8-93c3-3147a59c9c7e', '49767428-5955-402c-a7ee-b9f7e69876de'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:50:40 devstack sudo[106637]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d02e5ec2-4a7e-43b0-bf16-dec52eeacaf4 tempest-CreateVolumesFromSnapshotTest-1905686095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.388s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:40 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-d02e5ec2-4a7e-43b0-bf16-dec52eeacaf4 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:50:40 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-d02e5ec2-4a7e-43b0-bf16-dec52eeacaf4 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Deleted volume successfully. Nov 03 07:50:40 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d02e5ec2-4a7e-43b0-bf16-dec52eeacaf4 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "cinder-6d97b3ae-e12e-4150-886f-47b0f37e6b47-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:40 devstack sudo[106643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-879adc44-dd69-4934-8c5c-d80d809654a3 Nov 03 07:50:40 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-53a8fe4b-34c4-4042-8303-1e172d735a3a tempest-ProjectReaderTests-502528571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-53a8fe4b-34c4-4042-8303-1e172d735a3a tempest-ProjectReaderTests-502528571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:40 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-53a8fe4b-34c4-4042-8303-1e172d735a3a tempest-ProjectReaderTests-502528571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:40 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-53a8fe4b-34c4-4042-8303-1e172d735a3a tempest-ProjectReaderTests-502528571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-53a8fe4b-34c4-4042-8303-1e172d735a3a tempest-ProjectReaderTests-502528571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-53a8fe4b-34c4-4042-8303-1e172d735a3a tempest-ProjectReaderTests-502528571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:40 devstack sudo[106647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:50:40 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:40 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bdd4d0e6-c2cf-4c3c-bd69-66875a4101dd_a13rbp09" returned: 1 in 0.653s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bdd4d0e6-c2cf-4c3c-bd69-66875a4101dd_a13rbp09' failed. Not Retrying. {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:50:40 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-53a8fe4b-34c4-4042-8303-1e172d735a3a tempest-ProjectReaderTests-502528571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.275s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:40 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-53a8fe4b-34c4-4042-8303-1e172d735a3a tempest-ProjectReaderTests-502528571 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:50:40 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ec48ce-8674-4acd-a9e0-a38944bbc0f3]: (4, 'raw') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bdd4d0e6-c2cf-4c3c-bd69-66875a4101dd_3vpxg7frdevstack@QuobyteHD {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:41 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-53a8fe4b-34c4-4042-8303-1e172d735a3a tempest-ProjectReaderTests-502528571 None] Deleted volume successfully. Nov 03 07:50:41 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-53a8fe4b-34c4-4042-8303-1e172d735a3a tempest-ProjectReaderTests-502528571 None] Lock "cinder-b5fbef2f-4815-45fd-ad04-e52025007055-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:41 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-29daa709-d270-4072-b48d-1c8b5a7a0916 tempest-CreateVolumesFromSnapshotTest-1905686095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-879adc44-dd69-4934-8c5c-d80d809654a3" returned: 0 in 0.553s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-29daa709-d270-4072-b48d-1c8b5a7a0916 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-879adc44-dd69-4934-8c5c-d80d809654a3 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:41 devstack sudo[106656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-879adc44-dd69-4934-8c5c-d80d809654a3 Nov 03 07:50:41 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:41 devstack sudo[106655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bdd4d0e6-c2cf-4c3c-bd69-66875a4101dd_3vpxg7frdevstack@QuobyteHD Nov 03 07:50:41 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:41 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-29daa709-d270-4072-b48d-1c8b5a7a0916 tempest-CreateVolumesFromSnapshotTest-1905686095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-879adc44-dd69-4934-8c5c-d80d809654a3" returned: 0 in 0.321s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:41 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bdd4d0e6-c2cf-4c3c-bd69-66875a4101dd_3vpxg7frdevstack@QuobyteHD" returned: 0 in 0.417s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdd4d0e6-c2cf-4c3c-bd69-66875a4101dd_3vpxg7frdevstack@QuobyteHD {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:41 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-29daa709-d270-4072-b48d-1c8b5a7a0916 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "cinder-quobyte-879adc44-dd69-4934-8c5c-d80d809654a3" released by "delete_volume" :: held 0.947s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:41 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5202ac2-fd01-4e02-b8a5-88a87801e542 tempest-ProjectReaderTests-502528571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:50:41 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c5202ac2-fd01-4e02-b8a5-88a87801e542 tempest-ProjectReaderTests-502528571 None] Flow 'volume_create_manager' (d6baa364-0637-4e73-a224-e0c31f039a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:41 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c5202ac2-fd01-4e02-b8a5-88a87801e542 tempest-ProjectReaderTests-502528571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd43e17b-962a-4236-b670-652a4fad800a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:41 devstack sudo[106663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdd4d0e6-c2cf-4c3c-bd69-66875a4101dd_3vpxg7frdevstack@QuobyteHD Nov 03 07:50:41 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:41 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-29daa709-d270-4072-b48d-1c8b5a7a0916 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Created reservations ['f5608ad4-2460-4420-bb51-be551e2ad2d6', 'e1a54b00-5911-4131-91fc-15759b8b8f04', '03839eb6-fdcc-4508-8f30-176ce78ddced', 'e7256184-2969-425c-81e3-7d416e48d967'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:50:41 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c5202ac2-fd01-4e02-b8a5-88a87801e542 tempest-ProjectReaderTests-502528571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd43e17b-962a-4236-b670-652a4fad800a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-104397463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7e0dfd3-47e1-424b-aa59-cb1e277999a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8add37b5fee54b3b86fd2c461f733a93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:41Z,use_quota=True,user_id='f6a2a55bfa844c998456e9021f775e22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:41 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c5202ac2-fd01-4e02-b8a5-88a87801e542 tempest-ProjectReaderTests-502528571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb0be8cb-8f9f-446a-94fb-6caef6015df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:41 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c5202ac2-fd01-4e02-b8a5-88a87801e542 tempest-ProjectReaderTests-502528571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb0be8cb-8f9f-446a-94fb-6caef6015df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:41 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c5202ac2-fd01-4e02-b8a5-88a87801e542 tempest-ProjectReaderTests-502528571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fe9bcb0-ac12-48cc-93b0-24d04e9f4148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:41 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c5202ac2-fd01-4e02-b8a5-88a87801e542 tempest-ProjectReaderTests-502528571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fe9bcb0-ac12-48cc-93b0-24d04e9f4148) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7e0dfd3-47e1-424b-aa59-cb1e277999a0', 'volume_name': 'volume-c7e0dfd3-47e1-424b-aa59-cb1e277999a0', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:41 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c5202ac2-fd01-4e02-b8a5-88a87801e542 tempest-ProjectReaderTests-502528571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56cd73fd-8431-47ff-9cd8-33ae628de592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:41 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c5202ac2-fd01-4e02-b8a5-88a87801e542 tempest-ProjectReaderTests-502528571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56cd73fd-8431-47ff-9cd8-33ae628de592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:41 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c5202ac2-fd01-4e02-b8a5-88a87801e542 tempest-ProjectReaderTests-502528571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca2420eb-63de-4775-a4f2-c32e47128381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:41 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-c5202ac2-fd01-4e02-b8a5-88a87801e542 tempest-ProjectReaderTests-502528571 None] Volume c7e0dfd3-47e1-424b-aa59-cb1e277999a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7e0dfd3-47e1-424b-aa59-cb1e277999a0', 'volume_size': 1} Nov 03 07:50:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-c5202ac2-fd01-4e02-b8a5-88a87801e542 tempest-ProjectReaderTests-502528571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-c5202ac2-fd01-4e02-b8a5-88a87801e542 tempest-ProjectReaderTests-502528571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:41 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-c5202ac2-fd01-4e02-b8a5-88a87801e542 tempest-ProjectReaderTests-502528571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-104397463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7e0dfd3-47e1-424b-aa59-cb1e277999a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8add37b5fee54b3b86fd2c461f733a93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:41Z,use_quota=True,user_id='f6a2a55bfa844c998456e9021f775e22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:50:41 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-c5202ac2-fd01-4e02-b8a5-88a87801e542 tempest-ProjectReaderTests-502528571 None] Creating volume c7e0dfd3-47e1-424b-aa59-cb1e277999a0 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:50:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-c5202ac2-fd01-4e02-b8a5-88a87801e542 tempest-ProjectReaderTests-502528571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-c5202ac2-fd01-4e02-b8a5-88a87801e542 tempest-ProjectReaderTests-502528571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:41 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-c5202ac2-fd01-4e02-b8a5-88a87801e542 tempest-ProjectReaderTests-502528571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:41 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-c5202ac2-fd01-4e02-b8a5-88a87801e542 tempest-ProjectReaderTests-502528571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-c5202ac2-fd01-4e02-b8a5-88a87801e542 tempest-ProjectReaderTests-502528571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:41 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-c5202ac2-fd01-4e02-b8a5-88a87801e542 tempest-ProjectReaderTests-502528571 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:50:41 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-c5202ac2-fd01-4e02-b8a5-88a87801e542 tempest-ProjectReaderTests-502528571 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:50:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c5202ac2-fd01-4e02-b8a5-88a87801e542 tempest-ProjectReaderTests-502528571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c7e0dfd3-47e1-424b-aa59-cb1e277999a0 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:41 devstack sudo[106665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c7e0dfd3-47e1-424b-aa59-cb1e277999a0 1073741824 Nov 03 07:50:41 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-29daa709-d270-4072-b48d-1c8b5a7a0916 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-29daa709-d270-4072-b48d-1c8b5a7a0916 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:41 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-29daa709-d270-4072-b48d-1c8b5a7a0916 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:41 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-29daa709-d270-4072-b48d-1c8b5a7a0916 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-29daa709-d270-4072-b48d-1c8b5a7a0916 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-29daa709-d270-4072-b48d-1c8b5a7a0916 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:41 devstack sudo[106667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:50:41 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:41 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdd4d0e6-c2cf-4c3c-bd69-66875a4101dd_3vpxg7frdevstack@QuobyteHD" returned: 1 in 0.500s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdd4d0e6-c2cf-4c3c-bd69-66875a4101dd_3vpxg7frdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 07:50:41 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] bdd4d0e6-c2cf-4c3c-bd69-66875a4101dd was raw, converting to qcow2 {{(pid=86875) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 07:50:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bdd4d0e6-c2cf-4c3c-bd69-66875a4101dd_3vpxg7frdevstack@QuobyteHD /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-be4a58ff-2d0b-4901-a195-010ce513be5c {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:41 devstack sudo[106672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bdd4d0e6-c2cf-4c3c-bd69-66875a4101dd_3vpxg7frdevstack@QuobyteHD /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-be4a58ff-2d0b-4901-a195-010ce513be5c Nov 03 07:50:41 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:42 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-29daa709-d270-4072-b48d-1c8b5a7a0916 tempest-CreateVolumesFromSnapshotTest-1905686095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.278s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:42 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-29daa709-d270-4072-b48d-1c8b5a7a0916 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:50:42 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-29daa709-d270-4072-b48d-1c8b5a7a0916 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Deleted volume successfully. Nov 03 07:50:42 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-29daa709-d270-4072-b48d-1c8b5a7a0916 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "cinder-879adc44-dd69-4934-8c5c-d80d809654a3-delete_volume" released by "delete_volume" :: held 1.804s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:42 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c5202ac2-fd01-4e02-b8a5-88a87801e542 tempest-ProjectReaderTests-502528571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c7e0dfd3-47e1-424b-aa59-cb1e277999a0 1073741824" returned: 0 in 0.520s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c5202ac2-fd01-4e02-b8a5-88a87801e542 tempest-ProjectReaderTests-502528571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c7e0dfd3-47e1-424b-aa59-cb1e277999a0 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:42 devstack sudo[106682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c7e0dfd3-47e1-424b-aa59-cb1e277999a0 Nov 03 07:50:42 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:42 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bdd4d0e6-c2cf-4c3c-bd69-66875a4101dd_3vpxg7frdevstack@QuobyteHD /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-be4a58ff-2d0b-4901-a195-010ce513be5c" returned: 0 in 0.583s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:42 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bdd4d0e6-c2cf-4c3c-bd69-66875a4101dd_3vpxg7frdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-be4a58ff-2d0b-4901-a195-010ce513be5c {{(pid=86875) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:50:42 devstack cinder-volume[86875]: INFO cinder.image.image_utils [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] Converted 0.00 MB image at 0.00 MB/s Nov 03 07:50:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-be4a58ff-2d0b-4901-a195-010ce513be5c 1G {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:42 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-be4a58ff-2d0b-4901-a195-010ce513be5c 1G Nov 03 07:50:42 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:42 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c5202ac2-fd01-4e02-b8a5-88a87801e542 tempest-ProjectReaderTests-502528571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c7e0dfd3-47e1-424b-aa59-cb1e277999a0" returned: 0 in 0.280s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:42 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-c5202ac2-fd01-4e02-b8a5-88a87801e542 tempest-ProjectReaderTests-502528571 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:50:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-c5202ac2-fd01-4e02-b8a5-88a87801e542 tempest-ProjectReaderTests-502528571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:42 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c5202ac2-fd01-4e02-b8a5-88a87801e542 tempest-ProjectReaderTests-502528571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca2420eb-63de-4775-a4f2-c32e47128381) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7e0dfd3-47e1-424b-aa59-cb1e277999a0', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:42 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c5202ac2-fd01-4e02-b8a5-88a87801e542 tempest-ProjectReaderTests-502528571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45e6a36e-290d-42e5-aa4e-22559b54b50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:42 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-c5202ac2-fd01-4e02-b8a5-88a87801e542 tempest-ProjectReaderTests-502528571 None] Volume volume-c7e0dfd3-47e1-424b-aa59-cb1e277999a0 (c7e0dfd3-47e1-424b-aa59-cb1e277999a0): created successfully Nov 03 07:50:42 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c5202ac2-fd01-4e02-b8a5-88a87801e542 tempest-ProjectReaderTests-502528571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45e6a36e-290d-42e5-aa4e-22559b54b50a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:42 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c5202ac2-fd01-4e02-b8a5-88a87801e542 tempest-ProjectReaderTests-502528571 None] Flow 'volume_create_manager' (d6baa364-0637-4e73-a224-e0c31f039a6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:42 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3da56d5-689f-494d-8e02-3a5d907faaa7 tempest-ProjectReaderTests-1379712565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:50:42 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a3da56d5-689f-494d-8e02-3a5d907faaa7 tempest-ProjectReaderTests-1379712565 None] Flow 'volume_create_manager' (24421949-a1b1-43bc-8b8e-66212bc0859a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:42 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a3da56d5-689f-494d-8e02-3a5d907faaa7 tempest-ProjectReaderTests-1379712565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01c9c71f-a6ea-4d0f-804e-7899fb3b0516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:42 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-c5202ac2-fd01-4e02-b8a5-88a87801e542 tempest-ProjectReaderTests-502528571 None] Created volume successfully. Nov 03 07:50:42 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-c87b4dde-ce25-4821-9a16-43ff0f9c0dfd tempest-CreateVolumesFromSnapshotTest-1905686095 None] Acquiring lock "cinder-3b56efea-b171-45dd-98ab-3db2adc479f5-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:42 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a3da56d5-689f-494d-8e02-3a5d907faaa7 tempest-ProjectReaderTests-1379712565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01c9c71f-a6ea-4d0f-804e-7899fb3b0516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1240820827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cec0116-eb1b-49ae-8a2a-07d59d3bf88d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e063beebf62e4f73889c7cf7c63d85ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:43Z,use_quota=True,user_id='51c0eb5e9adb43cf9694fdbca9269bec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:42 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a3da56d5-689f-494d-8e02-3a5d907faaa7 tempest-ProjectReaderTests-1379712565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24a77049-2944-450a-bf5e-e2d9b04e00b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:42 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a3da56d5-689f-494d-8e02-3a5d907faaa7 tempest-ProjectReaderTests-1379712565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24a77049-2944-450a-bf5e-e2d9b04e00b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:42 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a3da56d5-689f-494d-8e02-3a5d907faaa7 tempest-ProjectReaderTests-1379712565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86c042c0-f7c0-4488-bd0f-0e4d06ff30e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:42 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a3da56d5-689f-494d-8e02-3a5d907faaa7 tempest-ProjectReaderTests-1379712565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86c042c0-f7c0-4488-bd0f-0e4d06ff30e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cec0116-eb1b-49ae-8a2a-07d59d3bf88d', 'volume_name': 'volume-5cec0116-eb1b-49ae-8a2a-07d59d3bf88d', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:42 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a3da56d5-689f-494d-8e02-3a5d907faaa7 tempest-ProjectReaderTests-1379712565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b586861e-4d96-4895-adc8-588a233baa67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:42 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a3da56d5-689f-494d-8e02-3a5d907faaa7 tempest-ProjectReaderTests-1379712565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b586861e-4d96-4895-adc8-588a233baa67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:42 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a3da56d5-689f-494d-8e02-3a5d907faaa7 tempest-ProjectReaderTests-1379712565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6ad991f-1296-4506-b593-28bb59bc6c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:42 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-a3da56d5-689f-494d-8e02-3a5d907faaa7 tempest-ProjectReaderTests-1379712565 None] Volume 5cec0116-eb1b-49ae-8a2a-07d59d3bf88d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cec0116-eb1b-49ae-8a2a-07d59d3bf88d', 'volume_size': 1} Nov 03 07:50:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a3da56d5-689f-494d-8e02-3a5d907faaa7 tempest-ProjectReaderTests-1379712565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a3da56d5-689f-494d-8e02-3a5d907faaa7 tempest-ProjectReaderTests-1379712565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:42 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a3da56d5-689f-494d-8e02-3a5d907faaa7 tempest-ProjectReaderTests-1379712565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1240820827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cec0116-eb1b-49ae-8a2a-07d59d3bf88d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e063beebf62e4f73889c7cf7c63d85ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:43Z,use_quota=True,user_id='51c0eb5e9adb43cf9694fdbca9269bec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:50:42 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-a3da56d5-689f-494d-8e02-3a5d907faaa7 tempest-ProjectReaderTests-1379712565 None] Creating volume 5cec0116-eb1b-49ae-8a2a-07d59d3bf88d {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:50:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a3da56d5-689f-494d-8e02-3a5d907faaa7 tempest-ProjectReaderTests-1379712565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a3da56d5-689f-494d-8e02-3a5d907faaa7 tempest-ProjectReaderTests-1379712565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:42 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a3da56d5-689f-494d-8e02-3a5d907faaa7 tempest-ProjectReaderTests-1379712565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:42 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a3da56d5-689f-494d-8e02-3a5d907faaa7 tempest-ProjectReaderTests-1379712565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a3da56d5-689f-494d-8e02-3a5d907faaa7 tempest-ProjectReaderTests-1379712565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:42 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a3da56d5-689f-494d-8e02-3a5d907faaa7 tempest-ProjectReaderTests-1379712565 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:50:42 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-a3da56d5-689f-494d-8e02-3a5d907faaa7 tempest-ProjectReaderTests-1379712565 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:50:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a3da56d5-689f-494d-8e02-3a5d907faaa7 tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5cec0116-eb1b-49ae-8a2a-07d59d3bf88d 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:42 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-c87b4dde-ce25-4821-9a16-43ff0f9c0dfd tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "cinder-3b56efea-b171-45dd-98ab-3db2adc479f5-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:42 devstack sudo[106689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5cec0116-eb1b-49ae-8a2a-07d59d3bf88d 1073741824 Nov 03 07:50:42 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:42 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-c87b4dde-ce25-4821-9a16-43ff0f9c0dfd tempest-CreateVolumesFromSnapshotTest-1905686095 None] Acquiring lock "cinder-quobyte-3b56efea-b171-45dd-98ab-3db2adc479f5" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:42 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-c87b4dde-ce25-4821-9a16-43ff0f9c0dfd tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "cinder-quobyte-3b56efea-b171-45dd-98ab-3db2adc479f5" acquired by "delete_volume" :: waited 0.018s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:42 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec77585a-2aa7-494d-a433-33902f8fe85e]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c87b4dde-ce25-4821-9a16-43ff0f9c0dfd tempest-CreateVolumesFromSnapshotTest-1905686095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3b56efea-b171-45dd-98ab-3db2adc479f5 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:42 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-be4a58ff-2d0b-4901-a195-010ce513be5c 1G" returned: 0 in 0.392s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:42 devstack cinder-volume[86875]: DEBUG cinder.volume.volume_utils [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] Downloaded image bdd4d0e6-c2cf-4c3c-bd69-66875a4101dd ((None, [{'url': 'file:///opt/stack/data/glance/images/bdd4d0e6-c2cf-4c3c-bd69-66875a4101dd', 'metadata': {}}])) to volume be4a58ff-2d0b-4901-a195-010ce513be5c successfully. {{(pid=86875) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 07:50:42 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] Temporary image bdd4d0e6-c2cf-4c3c-bd69-66875a4101dd for user 0591b4506a94453c87bbd5a4a637ade0 is deleted. {{(pid=86875) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 07:50:42 devstack cinder-volume[86875]: DEBUG cinder.volume.volume_utils [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] Marking volume be4a58ff-2d0b-4901-a195-010ce513be5c as bootable. {{(pid=86875) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 07:50:42 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] Copying metadata from image bdd4d0e6-c2cf-4c3c-bd69-66875a4101dd to be4a58ff-2d0b-4901-a195-010ce513be5c. {{(pid=86875) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 07:50:42 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] Creating volume glance metadata for volume be4a58ff-2d0b-4901-a195-010ce513be5c backed by image bdd4d0e6-c2cf-4c3c-bd69-66875a4101dd with: {'image_id': 'bdd4d0e6-c2cf-4c3c-bd69-66875a4101dd', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'f6ddec0052b46a28ffa489fceaa1e838', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86875) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 07:50:42 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf1da10f-4ad0-469b-91cd-aaa73b85f084) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be4a58ff-2d0b-4901-a195-010ce513be5c', 'volume_size': 1, 'image_id': 'bdd4d0e6-c2cf-4c3c-bd69-66875a4101dd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bdd4d0e6-c2cf-4c3c-bd69-66875a4101dd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f6ddec0052b46a28ffa489fceaa1e838', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6a51c0f5dde54233848cf77d6f5e8ffb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '527278357b166857a3e40f6110f45f9aa883db11fc71527ed636106bf83d7c07812c84c11000d7f079b7efb60e61f3ff0b8eea18a0b4d9f9dac02bb0d4e90880', 'id': 'bdd4d0e6-c2cf-4c3c-bd69-66875a4101dd', 'created_at': datetime.datetime(2026, 11, 3, 6, 50, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 50, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bdd4d0e6-c2cf-4c3c-bd69-66875a4101dd/file', 'properties': {}}, 'image_service': }' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:42 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3b56efea-b171-45dd-98ab-3db2adc479f5 Nov 03 07:50:42 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:42 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58f05f0c-68e6-40ad-a6f0-1176478346bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:42 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] Volume volume-be4a58ff-2d0b-4901-a195-010ce513be5c (be4a58ff-2d0b-4901-a195-010ce513be5c): created successfully Nov 03 07:50:43 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58f05f0c-68e6-40ad-a6f0-1176478346bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:43 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] Flow 'volume_create_manager' (d5649587-8601-4493-8b70-610d2e8b7675) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:43 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-fe6834c6-88a0-4df3-b06b-a5cbb4fc9289 tempest-VolumeImageDependencyTests-1060395100 None] Created volume successfully. Nov 03 07:50:43 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:43 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a3da56d5-689f-494d-8e02-3a5d907faaa7 tempest-ProjectReaderTests-1379712565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5cec0116-eb1b-49ae-8a2a-07d59d3bf88d 1073741824" returned: 0 in 0.445s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:43 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a3da56d5-689f-494d-8e02-3a5d907faaa7 tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5cec0116-eb1b-49ae-8a2a-07d59d3bf88d {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:43 devstack sudo[106703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5cec0116-eb1b-49ae-8a2a-07d59d3bf88d Nov 03 07:50:43 devstack sudo[106703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:43 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:43 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c87b4dde-ce25-4821-9a16-43ff0f9c0dfd tempest-CreateVolumesFromSnapshotTest-1905686095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3b56efea-b171-45dd-98ab-3db2adc479f5" returned: 0 in 0.413s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:43 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c87b4dde-ce25-4821-9a16-43ff0f9c0dfd tempest-CreateVolumesFromSnapshotTest-1905686095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3b56efea-b171-45dd-98ab-3db2adc479f5 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:43 devstack sudo[106705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3b56efea-b171-45dd-98ab-3db2adc479f5 Nov 03 07:50:43 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:43 devstack sudo[106703]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:43 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a3da56d5-689f-494d-8e02-3a5d907faaa7 tempest-ProjectReaderTests-1379712565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5cec0116-eb1b-49ae-8a2a-07d59d3bf88d" returned: 0 in 0.264s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:43 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a3da56d5-689f-494d-8e02-3a5d907faaa7 tempest-ProjectReaderTests-1379712565 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:50:43 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a3da56d5-689f-494d-8e02-3a5d907faaa7 tempest-ProjectReaderTests-1379712565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:43 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:43 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c87b4dde-ce25-4821-9a16-43ff0f9c0dfd tempest-CreateVolumesFromSnapshotTest-1905686095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3b56efea-b171-45dd-98ab-3db2adc479f5" returned: 0 in 0.251s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:43 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a3da56d5-689f-494d-8e02-3a5d907faaa7 tempest-ProjectReaderTests-1379712565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6ad991f-1296-4506-b593-28bb59bc6c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cec0116-eb1b-49ae-8a2a-07d59d3bf88d', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:43 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a3da56d5-689f-494d-8e02-3a5d907faaa7 tempest-ProjectReaderTests-1379712565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0413f90-97bd-45a5-a650-24d6588c98d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:43 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-c87b4dde-ce25-4821-9a16-43ff0f9c0dfd tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "cinder-quobyte-3b56efea-b171-45dd-98ab-3db2adc479f5" released by "delete_volume" :: held 0.739s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:43 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-9428e032-a4a8-4f10-839d-3afbea6a9379 tempest-ProjectReaderTests-502528571 None] Acquiring lock "cinder-c7e0dfd3-47e1-424b-aa59-cb1e277999a0-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:43 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-a3da56d5-689f-494d-8e02-3a5d907faaa7 tempest-ProjectReaderTests-1379712565 None] Volume volume-5cec0116-eb1b-49ae-8a2a-07d59d3bf88d (5cec0116-eb1b-49ae-8a2a-07d59d3bf88d): created successfully Nov 03 07:50:43 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a3da56d5-689f-494d-8e02-3a5d907faaa7 tempest-ProjectReaderTests-1379712565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0413f90-97bd-45a5-a650-24d6588c98d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:43 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a3da56d5-689f-494d-8e02-3a5d907faaa7 tempest-ProjectReaderTests-1379712565 None] Flow 'volume_create_manager' (24421949-a1b1-43bc-8b8e-66212bc0859a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:43 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-9428e032-a4a8-4f10-839d-3afbea6a9379 tempest-ProjectReaderTests-502528571 None] Lock "cinder-c7e0dfd3-47e1-424b-aa59-cb1e277999a0-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:43 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-a3da56d5-689f-494d-8e02-3a5d907faaa7 tempest-ProjectReaderTests-1379712565 None] Created volume successfully. Nov 03 07:50:43 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-9428e032-a4a8-4f10-839d-3afbea6a9379 tempest-ProjectReaderTests-502528571 None] Acquiring lock "cinder-quobyte-c7e0dfd3-47e1-424b-aa59-cb1e277999a0" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:43 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-c87b4dde-ce25-4821-9a16-43ff0f9c0dfd tempest-CreateVolumesFromSnapshotTest-1905686095 None] Created reservations ['7ca8e2b7-b44e-42d0-9a37-d92d34d40e4b', 'd131c190-b66e-4f52-9331-36e510110445', '7b9c5e40-4ca8-4476-8363-b19b7ec10bea', '514e168a-1bee-49fc-9254-51cd553b8359'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:50:43 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-9428e032-a4a8-4f10-839d-3afbea6a9379 tempest-ProjectReaderTests-502528571 None] Lock "cinder-quobyte-c7e0dfd3-47e1-424b-aa59-cb1e277999a0" acquired by "delete_volume" :: waited 0.024s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:43 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[65068e35-5a52-46e9-8066-a2370e17daab]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:43 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9428e032-a4a8-4f10-839d-3afbea6a9379 tempest-ProjectReaderTests-502528571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c7e0dfd3-47e1-424b-aa59-cb1e277999a0 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:43 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-c87b4dde-ce25-4821-9a16-43ff0f9c0dfd tempest-CreateVolumesFromSnapshotTest-1905686095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:43 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-c87b4dde-ce25-4821-9a16-43ff0f9c0dfd tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:43 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-c87b4dde-ce25-4821-9a16-43ff0f9c0dfd tempest-CreateVolumesFromSnapshotTest-1905686095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:43 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-c87b4dde-ce25-4821-9a16-43ff0f9c0dfd tempest-CreateVolumesFromSnapshotTest-1905686095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:43 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-c87b4dde-ce25-4821-9a16-43ff0f9c0dfd tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:43 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c87b4dde-ce25-4821-9a16-43ff0f9c0dfd tempest-CreateVolumesFromSnapshotTest-1905686095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:43 devstack sudo[106710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:50:43 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:43 devstack sudo[106709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c7e0dfd3-47e1-424b-aa59-cb1e277999a0 Nov 03 07:50:43 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:43 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-099d0f57-8a59-4332-9ae7-5510aa87f56c tempest-CreateVolumesFromSnapshotTest-1905686095 None] Acquiring lock "cinder-c9e26e15-b756-4ac0-860f-ffed3270f1b2-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:43 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-099d0f57-8a59-4332-9ae7-5510aa87f56c tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "cinder-c9e26e15-b756-4ac0-860f-ffed3270f1b2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:43 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-099d0f57-8a59-4332-9ae7-5510aa87f56c tempest-CreateVolumesFromSnapshotTest-1905686095 None] Acquiring lock "cinder-quobyte-c9e26e15-b756-4ac0-860f-ffed3270f1b2" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:43 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-099d0f57-8a59-4332-9ae7-5510aa87f56c tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "cinder-quobyte-c9e26e15-b756-4ac0-860f-ffed3270f1b2" acquired by "delete_volume" :: waited 0.023s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:43 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e55394-edfa-486c-a58c-09e4f2489707]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:43 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-099d0f57-8a59-4332-9ae7-5510aa87f56c tempest-CreateVolumesFromSnapshotTest-1905686095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c9e26e15-b756-4ac0-860f-ffed3270f1b2 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:44 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c87b4dde-ce25-4821-9a16-43ff0f9c0dfd tempest-CreateVolumesFromSnapshotTest-1905686095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.301s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:44 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-c87b4dde-ce25-4821-9a16-43ff0f9c0dfd tempest-CreateVolumesFromSnapshotTest-1905686095 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:50:44 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-c87b4dde-ce25-4821-9a16-43ff0f9c0dfd tempest-CreateVolumesFromSnapshotTest-1905686095 None] Deleted volume successfully. Nov 03 07:50:44 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-c87b4dde-ce25-4821-9a16-43ff0f9c0dfd tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "cinder-3b56efea-b171-45dd-98ab-3db2adc479f5-delete_volume" released by "delete_volume" :: held 1.348s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:44 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c9e26e15-b756-4ac0-860f-ffed3270f1b2 Nov 03 07:50:44 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:44 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:44 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-79832645-07cd-4ddb-bd03-7f35b0903ba6 tempest-VolumeImageDependencyTests-1060395100 None] Acquiring lock "cinder-be4a58ff-2d0b-4901-a195-010ce513be5c-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9428e032-a4a8-4f10-839d-3afbea6a9379 tempest-ProjectReaderTests-502528571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c7e0dfd3-47e1-424b-aa59-cb1e277999a0" returned: 0 in 0.446s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9428e032-a4a8-4f10-839d-3afbea6a9379 tempest-ProjectReaderTests-502528571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c7e0dfd3-47e1-424b-aa59-cb1e277999a0 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:44 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-79832645-07cd-4ddb-bd03-7f35b0903ba6 tempest-VolumeImageDependencyTests-1060395100 None] Lock "cinder-be4a58ff-2d0b-4901-a195-010ce513be5c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:44 devstack sudo[106720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c7e0dfd3-47e1-424b-aa59-cb1e277999a0 Nov 03 07:50:44 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:44 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-79832645-07cd-4ddb-bd03-7f35b0903ba6 tempest-VolumeImageDependencyTests-1060395100 None] Acquiring lock "cinder-quobyte-be4a58ff-2d0b-4901-a195-010ce513be5c" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:44 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-79832645-07cd-4ddb-bd03-7f35b0903ba6 tempest-VolumeImageDependencyTests-1060395100 None] Lock "cinder-quobyte-be4a58ff-2d0b-4901-a195-010ce513be5c" acquired by "delete_volume" :: waited 0.023s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:44 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec267a8a-016a-44e8-a542-1fec60a16000]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-79832645-07cd-4ddb-bd03-7f35b0903ba6 tempest-VolumeImageDependencyTests-1060395100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-be4a58ff-2d0b-4901-a195-010ce513be5c {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:44 devstack sudo[106722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-be4a58ff-2d0b-4901-a195-010ce513be5c Nov 03 07:50:44 devstack sudo[106722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:44 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-099d0f57-8a59-4332-9ae7-5510aa87f56c tempest-CreateVolumesFromSnapshotTest-1905686095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c9e26e15-b756-4ac0-860f-ffed3270f1b2" returned: 0 in 0.420s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-099d0f57-8a59-4332-9ae7-5510aa87f56c tempest-CreateVolumesFromSnapshotTest-1905686095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c9e26e15-b756-4ac0-860f-ffed3270f1b2 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:44 devstack sudo[106728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c9e26e15-b756-4ac0-860f-ffed3270f1b2 Nov 03 07:50:44 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:44 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9428e032-a4a8-4f10-839d-3afbea6a9379 tempest-ProjectReaderTests-502528571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c7e0dfd3-47e1-424b-aa59-cb1e277999a0" returned: 0 in 0.282s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:44 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-9428e032-a4a8-4f10-839d-3afbea6a9379 tempest-ProjectReaderTests-502528571 None] Lock "cinder-quobyte-c7e0dfd3-47e1-424b-aa59-cb1e277999a0" released by "delete_volume" :: held 0.778s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:44 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-9428e032-a4a8-4f10-839d-3afbea6a9379 tempest-ProjectReaderTests-502528571 None] Created reservations ['77baf2eb-5081-46ff-9426-e20c42e7b361', 'c29f8701-5242-4bb1-bd02-36a899ac2b2d', 'c645f316-9b60-4b16-b8ee-3e2b590683a1', 'f511a1c3-ca47-4693-9d29-06000f63fb41'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:50:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-9428e032-a4a8-4f10-839d-3afbea6a9379 tempest-ProjectReaderTests-502528571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-9428e032-a4a8-4f10-839d-3afbea6a9379 tempest-ProjectReaderTests-502528571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:44 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-9428e032-a4a8-4f10-839d-3afbea6a9379 tempest-ProjectReaderTests-502528571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:44 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-9428e032-a4a8-4f10-839d-3afbea6a9379 tempest-ProjectReaderTests-502528571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-9428e032-a4a8-4f10-839d-3afbea6a9379 tempest-ProjectReaderTests-502528571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9428e032-a4a8-4f10-839d-3afbea6a9379 tempest-ProjectReaderTests-502528571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:44 devstack sudo[106732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:50:44 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:44 devstack sudo[106722]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-79832645-07cd-4ddb-bd03-7f35b0903ba6 tempest-VolumeImageDependencyTests-1060395100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-be4a58ff-2d0b-4901-a195-010ce513be5c" returned: 0 in 0.421s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-79832645-07cd-4ddb-bd03-7f35b0903ba6 tempest-VolumeImageDependencyTests-1060395100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-be4a58ff-2d0b-4901-a195-010ce513be5c {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:44 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:44 devstack sudo[106736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-be4a58ff-2d0b-4901-a195-010ce513be5c Nov 03 07:50:44 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-099d0f57-8a59-4332-9ae7-5510aa87f56c tempest-CreateVolumesFromSnapshotTest-1905686095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c9e26e15-b756-4ac0-860f-ffed3270f1b2" returned: 0 in 0.356s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:44 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-099d0f57-8a59-4332-9ae7-5510aa87f56c tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "cinder-quobyte-c9e26e15-b756-4ac0-860f-ffed3270f1b2" released by "delete_volume" :: held 0.841s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:44 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-099d0f57-8a59-4332-9ae7-5510aa87f56c tempest-CreateVolumesFromSnapshotTest-1905686095 None] Created reservations ['791d2f89-6abe-4fce-b453-8ea7e843f75b', '1636d676-7a62-4d50-9b0f-f965c4773482', '74900e5e-573e-4188-8d5d-1b96c3c79f25', '493c9612-5866-456a-ae36-c2c804208696'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:50:44 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9428e032-a4a8-4f10-839d-3afbea6a9379 tempest-ProjectReaderTests-502528571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.412s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:45 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-9428e032-a4a8-4f10-839d-3afbea6a9379 tempest-ProjectReaderTests-502528571 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:50:45 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-9428e032-a4a8-4f10-839d-3afbea6a9379 tempest-ProjectReaderTests-502528571 None] Deleted volume successfully. Nov 03 07:50:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e8bdf072-53fa-4ee3-89bc-d4fc9d46257d tempest-ProjectReaderTests-1379712565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e8bdf072-53fa-4ee3-89bc-d4fc9d46257d tempest-ProjectReaderTests-1379712565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:45 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-983b44b8-8f3d-4a35-b8b7-0c1ebcfa9c3e tempest-CreateVolumesFromSnapshotTest-1905686095 None] Acquiring lock "cinder-30252a61-e54c-4774-8824-3036f827c992-delete_snapshot" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:45 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-e8bdf072-53fa-4ee3-89bc-d4fc9d46257d tempest-ProjectReaderTests-1379712565 None] Creating offline snapshot e052feb8-4c9f-4054-8d4e-1390bbbae7f5 of volume 5cec0116-eb1b-49ae-8a2a-07d59d3bf88d {{(pid=86875) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:50:45 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:45 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-9428e032-a4a8-4f10-839d-3afbea6a9379 tempest-ProjectReaderTests-502528571 None] Lock "cinder-c7e0dfd3-47e1-424b-aa59-cb1e277999a0-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-099d0f57-8a59-4332-9ae7-5510aa87f56c tempest-CreateVolumesFromSnapshotTest-1905686095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-099d0f57-8a59-4332-9ae7-5510aa87f56c tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:45 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-099d0f57-8a59-4332-9ae7-5510aa87f56c tempest-CreateVolumesFromSnapshotTest-1905686095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:45 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-099d0f57-8a59-4332-9ae7-5510aa87f56c tempest-CreateVolumesFromSnapshotTest-1905686095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-099d0f57-8a59-4332-9ae7-5510aa87f56c tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-099d0f57-8a59-4332-9ae7-5510aa87f56c tempest-CreateVolumesFromSnapshotTest-1905686095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-79832645-07cd-4ddb-bd03-7f35b0903ba6 tempest-VolumeImageDependencyTests-1060395100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-be4a58ff-2d0b-4901-a195-010ce513be5c" returned: 0 in 0.430s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:45 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d654b23-d657-43cb-940e-76b25ed94453]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:45 devstack sudo[106740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:50:45 devstack sudo[106740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e8bdf072-53fa-4ee3-89bc-d4fc9d46257d tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5cec0116-eb1b-49ae-8a2a-07d59d3bf88d {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:45 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-983b44b8-8f3d-4a35-b8b7-0c1ebcfa9c3e tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "cinder-30252a61-e54c-4774-8824-3036f827c992-delete_snapshot" acquired by "delete_snapshot" :: waited 0.094s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:45 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-983b44b8-8f3d-4a35-b8b7-0c1ebcfa9c3e tempest-CreateVolumesFromSnapshotTest-1905686095 None] Acquiring lock "cinder-quobyte-e72f94b1-f1db-4742-8b98-7b77499b6d0f" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:45 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-79832645-07cd-4ddb-bd03-7f35b0903ba6 tempest-VolumeImageDependencyTests-1060395100 None] Lock "cinder-quobyte-be4a58ff-2d0b-4901-a195-010ce513be5c" released by "delete_volume" :: held 0.940s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:45 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-983b44b8-8f3d-4a35-b8b7-0c1ebcfa9c3e tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "cinder-quobyte-e72f94b1-f1db-4742-8b98-7b77499b6d0f" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:45 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-983b44b8-8f3d-4a35-b8b7-0c1ebcfa9c3e tempest-CreateVolumesFromSnapshotTest-1905686095 None] Acquiring lock "cinder-quobyte-30252a61-e54c-4774-8824-3036f827c992" by "_delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:45 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-983b44b8-8f3d-4a35-b8b7-0c1ebcfa9c3e tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "cinder-quobyte-30252a61-e54c-4774-8824-3036f827c992" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:45 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-983b44b8-8f3d-4a35-b8b7-0c1ebcfa9c3e tempest-CreateVolumesFromSnapshotTest-1905686095 None] Deleting offline snapshot 30252a61-e54c-4774-8824-3036f827c992 of volume e72f94b1-f1db-4742-8b98-7b77499b6d0f {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:50:45 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-983b44b8-8f3d-4a35-b8b7-0c1ebcfa9c3e tempest-CreateVolumesFromSnapshotTest-1905686095 None] snapshot_file for this snap is: volume-e72f94b1-f1db-4742-8b98-7b77499b6d0f.30252a61-e54c-4774-8824-3036f827c992 {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:50:45 devstack sudo[106742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5cec0116-eb1b-49ae-8a2a-07d59d3bf88d Nov 03 07:50:45 devstack sudo[106742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:45 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[99952e02-e5a3-4b21-9989-c8cca9e5a9b5]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-983b44b8-8f3d-4a35-b8b7-0c1ebcfa9c3e tempest-CreateVolumesFromSnapshotTest-1905686095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e72f94b1-f1db-4742-8b98-7b77499b6d0f.30252a61-e54c-4774-8824-3036f827c992 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:45 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-79832645-07cd-4ddb-bd03-7f35b0903ba6 tempest-VolumeImageDependencyTests-1060395100 None] Created reservations ['5b5ff7f8-4787-42b4-b2da-32246f9bd394', '019756eb-a0d5-4a92-8966-f4bbcfca0e42', '67178d3d-1e27-43ef-892b-06e8adbf2417', '2d5cb0ca-6b16-4e4d-af68-a3bf2692306d'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:50:45 devstack sudo[106740]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-099d0f57-8a59-4332-9ae7-5510aa87f56c tempest-CreateVolumesFromSnapshotTest-1905686095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.356s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:45 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-099d0f57-8a59-4332-9ae7-5510aa87f56c tempest-CreateVolumesFromSnapshotTest-1905686095 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:50:45 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-099d0f57-8a59-4332-9ae7-5510aa87f56c tempest-CreateVolumesFromSnapshotTest-1905686095 None] Deleted volume successfully. Nov 03 07:50:45 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-099d0f57-8a59-4332-9ae7-5510aa87f56c tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "cinder-c9e26e15-b756-4ac0-860f-ffed3270f1b2-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:45 devstack sudo[106744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e72f94b1-f1db-4742-8b98-7b77499b6d0f.30252a61-e54c-4774-8824-3036f827c992 Nov 03 07:50:45 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-79832645-07cd-4ddb-bd03-7f35b0903ba6 tempest-VolumeImageDependencyTests-1060395100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-79832645-07cd-4ddb-bd03-7f35b0903ba6 tempest-VolumeImageDependencyTests-1060395100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:45 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-79832645-07cd-4ddb-bd03-7f35b0903ba6 tempest-VolumeImageDependencyTests-1060395100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:45 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-79832645-07cd-4ddb-bd03-7f35b0903ba6 tempest-VolumeImageDependencyTests-1060395100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-79832645-07cd-4ddb-bd03-7f35b0903ba6 tempest-VolumeImageDependencyTests-1060395100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-79832645-07cd-4ddb-bd03-7f35b0903ba6 tempest-VolumeImageDependencyTests-1060395100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:45 devstack sudo[106747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:50:45 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:45 devstack sudo[106742]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e8bdf072-53fa-4ee3-89bc-d4fc9d46257d tempest-ProjectReaderTests-1379712565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5cec0116-eb1b-49ae-8a2a-07d59d3bf88d" returned: 0 in 0.565s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e8bdf072-53fa-4ee3-89bc-d4fc9d46257d tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5cec0116-eb1b-49ae-8a2a-07d59d3bf88d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5cec0116-eb1b-49ae-8a2a-07d59d3bf88d.e052feb8-4c9f-4054-8d4e-1390bbbae7f5 1G {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:45 devstack sudo[106753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5cec0116-eb1b-49ae-8a2a-07d59d3bf88d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5cec0116-eb1b-49ae-8a2a-07d59d3bf88d.e052feb8-4c9f-4054-8d4e-1390bbbae7f5 1G Nov 03 07:50:45 devstack sudo[106753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:45 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-983b44b8-8f3d-4a35-b8b7-0c1ebcfa9c3e tempest-CreateVolumesFromSnapshotTest-1905686095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e72f94b1-f1db-4742-8b98-7b77499b6d0f.30252a61-e54c-4774-8824-3036f827c992" returned: 0 in 0.516s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:45 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-983b44b8-8f3d-4a35-b8b7-0c1ebcfa9c3e tempest-CreateVolumesFromSnapshotTest-1905686095 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e72f94b1-f1db-4742-8b98-7b77499b6d0f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:50:45 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-79832645-07cd-4ddb-bd03-7f35b0903ba6 tempest-VolumeImageDependencyTests-1060395100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.302s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:45 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-79832645-07cd-4ddb-bd03-7f35b0903ba6 tempest-VolumeImageDependencyTests-1060395100 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:50:45 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd557bf-aebd-4aaa-9889-ccb430bbd3d6]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-983b44b8-8f3d-4a35-b8b7-0c1ebcfa9c3e tempest-CreateVolumesFromSnapshotTest-1905686095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e72f94b1-f1db-4742-8b98-7b77499b6d0f {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:45 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-79832645-07cd-4ddb-bd03-7f35b0903ba6 tempest-VolumeImageDependencyTests-1060395100 None] Deleted volume successfully. Nov 03 07:50:45 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-79832645-07cd-4ddb-bd03-7f35b0903ba6 tempest-VolumeImageDependencyTests-1060395100 None] Lock "cinder-be4a58ff-2d0b-4901-a195-010ce513be5c-delete_volume" released by "delete_volume" :: held 1.798s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:46 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e72f94b1-f1db-4742-8b98-7b77499b6d0f Nov 03 07:50:46 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:46 devstack sudo[106753]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e8bdf072-53fa-4ee3-89bc-d4fc9d46257d tempest-ProjectReaderTests-1379712565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5cec0116-eb1b-49ae-8a2a-07d59d3bf88d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5cec0116-eb1b-49ae-8a2a-07d59d3bf88d.e052feb8-4c9f-4054-8d4e-1390bbbae7f5 1G" returned: 0 in 0.560s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e8bdf072-53fa-4ee3-89bc-d4fc9d46257d tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5cec0116-eb1b-49ae-8a2a-07d59d3bf88d -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5cec0116-eb1b-49ae-8a2a-07d59d3bf88d.e052feb8-4c9f-4054-8d4e-1390bbbae7f5 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:46 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5cec0116-eb1b-49ae-8a2a-07d59d3bf88d -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5cec0116-eb1b-49ae-8a2a-07d59d3bf88d.e052feb8-4c9f-4054-8d4e-1390bbbae7f5 Nov 03 07:50:46 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:46 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-983b44b8-8f3d-4a35-b8b7-0c1ebcfa9c3e tempest-CreateVolumesFromSnapshotTest-1905686095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e72f94b1-f1db-4742-8b98-7b77499b6d0f" returned: 0 in 0.464s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-983b44b8-8f3d-4a35-b8b7-0c1ebcfa9c3e tempest-CreateVolumesFromSnapshotTest-1905686095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e72f94b1-f1db-4742-8b98-7b77499b6d0f.30252a61-e54c-4774-8824-3036f827c992 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:46 devstack sudo[106771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e72f94b1-f1db-4742-8b98-7b77499b6d0f.30252a61-e54c-4774-8824-3036f827c992 Nov 03 07:50:46 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:46 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e8bdf072-53fa-4ee3-89bc-d4fc9d46257d tempest-ProjectReaderTests-1379712565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5cec0116-eb1b-49ae-8a2a-07d59d3bf88d -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5cec0116-eb1b-49ae-8a2a-07d59d3bf88d.e052feb8-4c9f-4054-8d4e-1390bbbae7f5" returned: 0 in 0.350s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:46 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-e8bdf072-53fa-4ee3-89bc-d4fc9d46257d tempest-ProjectReaderTests-1379712565 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5cec0116-eb1b-49ae-8a2a-07d59d3bf88d.e052feb8-4c9f-4054-8d4e-1390bbbae7f5 is being set with open permissions: ugo+rw Nov 03 07:50:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e8bdf072-53fa-4ee3-89bc-d4fc9d46257d tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5cec0116-eb1b-49ae-8a2a-07d59d3bf88d.e052feb8-4c9f-4054-8d4e-1390bbbae7f5 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:46 devstack sudo[106776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5cec0116-eb1b-49ae-8a2a-07d59d3bf88d.e052feb8-4c9f-4054-8d4e-1390bbbae7f5 Nov 03 07:50:46 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:46 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-983b44b8-8f3d-4a35-b8b7-0c1ebcfa9c3e tempest-CreateVolumesFromSnapshotTest-1905686095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e72f94b1-f1db-4742-8b98-7b77499b6d0f.30252a61-e54c-4774-8824-3036f827c992" returned: 0 in 0.496s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-983b44b8-8f3d-4a35-b8b7-0c1ebcfa9c3e tempest-CreateVolumesFromSnapshotTest-1905686095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e72f94b1-f1db-4742-8b98-7b77499b6d0f.30252a61-e54c-4774-8824-3036f827c992 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:46 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e72f94b1-f1db-4742-8b98-7b77499b6d0f.30252a61-e54c-4774-8824-3036f827c992 Nov 03 07:50:46 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:46 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e8bdf072-53fa-4ee3-89bc-d4fc9d46257d tempest-ProjectReaderTests-1379712565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5cec0116-eb1b-49ae-8a2a-07d59d3bf88d.e052feb8-4c9f-4054-8d4e-1390bbbae7f5" returned: 0 in 0.331s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e8bdf072-53fa-4ee3-89bc-d4fc9d46257d tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5cec0116-eb1b-49ae-8a2a-07d59d3bf88d.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:47 devstack sudo[106785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5cec0116-eb1b-49ae-8a2a-07d59d3bf88d.info Nov 03 07:50:47 devstack sudo[106785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:47 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:47 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-983b44b8-8f3d-4a35-b8b7-0c1ebcfa9c3e tempest-CreateVolumesFromSnapshotTest-1905686095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e72f94b1-f1db-4742-8b98-7b77499b6d0f.30252a61-e54c-4774-8824-3036f827c992" returned: 0 in 0.352s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:47 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-983b44b8-8f3d-4a35-b8b7-0c1ebcfa9c3e tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "cinder-quobyte-30252a61-e54c-4774-8824-3036f827c992" released by "_delete_snapshot" :: held 2.017s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:47 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-983b44b8-8f3d-4a35-b8b7-0c1ebcfa9c3e tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "cinder-quobyte-e72f94b1-f1db-4742-8b98-7b77499b6d0f" released by "delete_snapshot" :: held 2.076s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:47 devstack sudo[106785]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:47 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e8bdf072-53fa-4ee3-89bc-d4fc9d46257d tempest-ProjectReaderTests-1379712565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5cec0116-eb1b-49ae-8a2a-07d59d3bf88d.info" returned: 0 in 0.318s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:47 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-e8bdf072-53fa-4ee3-89bc-d4fc9d46257d tempest-ProjectReaderTests-1379712565 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5cec0116-eb1b-49ae-8a2a-07d59d3bf88d.info is being set with open permissions: ugo+rw Nov 03 07:50:47 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e8bdf072-53fa-4ee3-89bc-d4fc9d46257d tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5cec0116-eb1b-49ae-8a2a-07d59d3bf88d.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:47 devstack sudo[106789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5cec0116-eb1b-49ae-8a2a-07d59d3bf88d.info Nov 03 07:50:47 devstack sudo[106789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:47 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-983b44b8-8f3d-4a35-b8b7-0c1ebcfa9c3e tempest-CreateVolumesFromSnapshotTest-1905686095 None] Created reservations ['09b46298-5342-4045-9f4d-884b52d94e09', '8908886d-b7f0-4d6e-ab01-2d6f477bf1ec', '354dcffe-ee29-4899-a2c2-0c982ec80762', '260aa6c3-d9a2-426a-a58f-ff69a7ab9fb9'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:50:47 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-983b44b8-8f3d-4a35-b8b7-0c1ebcfa9c3e tempest-CreateVolumesFromSnapshotTest-1905686095 None] Delete snapshot completed successfully. Nov 03 07:50:47 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-983b44b8-8f3d-4a35-b8b7-0c1ebcfa9c3e tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "cinder-30252a61-e54c-4774-8824-3036f827c992-delete_snapshot" released by "delete_snapshot" :: held 2.298s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:47 devstack sudo[106789]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:47 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e8bdf072-53fa-4ee3-89bc-d4fc9d46257d tempest-ProjectReaderTests-1379712565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5cec0116-eb1b-49ae-8a2a-07d59d3bf88d.info" returned: 0 in 0.291s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:47 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e8bdf072-53fa-4ee3-89bc-d4fc9d46257d tempest-ProjectReaderTests-1379712565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.585s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:47 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-e8bdf072-53fa-4ee3-89bc-d4fc9d46257d tempest-ProjectReaderTests-1379712565 None] Create snapshot completed successfully Nov 03 07:50:48 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-15b6ccca-9f70-4869-9175-505b5b07e659 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Acquiring lock "cinder-e72f94b1-f1db-4742-8b98-7b77499b6d0f-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:48 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-15b6ccca-9f70-4869-9175-505b5b07e659 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "cinder-e72f94b1-f1db-4742-8b98-7b77499b6d0f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:48 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-15b6ccca-9f70-4869-9175-505b5b07e659 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Acquiring lock "cinder-quobyte-e72f94b1-f1db-4742-8b98-7b77499b6d0f" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:48 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-15b6ccca-9f70-4869-9175-505b5b07e659 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "cinder-quobyte-e72f94b1-f1db-4742-8b98-7b77499b6d0f" acquired by "delete_volume" :: waited 0.026s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:48 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78c62ec-451e-47b1-975d-4a8d2b05ab19]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-15b6ccca-9f70-4869-9175-505b5b07e659 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e72f94b1-f1db-4742-8b98-7b77499b6d0f {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:48 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a8c28351-055a-461e-b49b-779ccf3a6e82 tempest-ProjectReaderTests-1379712565 None] Acquiring lock "cinder-e052feb8-4c9f-4054-8d4e-1390bbbae7f5-delete_snapshot" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:48 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a8c28351-055a-461e-b49b-779ccf3a6e82 tempest-ProjectReaderTests-1379712565 None] Lock "cinder-e052feb8-4c9f-4054-8d4e-1390bbbae7f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:48 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a8c28351-055a-461e-b49b-779ccf3a6e82 tempest-ProjectReaderTests-1379712565 None] Acquiring lock "cinder-quobyte-5cec0116-eb1b-49ae-8a2a-07d59d3bf88d" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:48 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a8c28351-055a-461e-b49b-779ccf3a6e82 tempest-ProjectReaderTests-1379712565 None] Lock "cinder-quobyte-5cec0116-eb1b-49ae-8a2a-07d59d3bf88d" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:48 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a8c28351-055a-461e-b49b-779ccf3a6e82 tempest-ProjectReaderTests-1379712565 None] Acquiring lock "cinder-quobyte-e052feb8-4c9f-4054-8d4e-1390bbbae7f5" by "_delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:48 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a8c28351-055a-461e-b49b-779ccf3a6e82 tempest-ProjectReaderTests-1379712565 None] Lock "cinder-quobyte-e052feb8-4c9f-4054-8d4e-1390bbbae7f5" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:48 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-a8c28351-055a-461e-b49b-779ccf3a6e82 tempest-ProjectReaderTests-1379712565 None] Deleting offline snapshot e052feb8-4c9f-4054-8d4e-1390bbbae7f5 of volume 5cec0116-eb1b-49ae-8a2a-07d59d3bf88d {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:50:48 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-a8c28351-055a-461e-b49b-779ccf3a6e82 tempest-ProjectReaderTests-1379712565 None] snapshot_file for this snap is: volume-5cec0116-eb1b-49ae-8a2a-07d59d3bf88d.e052feb8-4c9f-4054-8d4e-1390bbbae7f5 {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:50:48 devstack sudo[106793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e72f94b1-f1db-4742-8b98-7b77499b6d0f Nov 03 07:50:48 devstack sudo[106793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:48 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[2753acd6-2df4-41c2-a773-60f76bff6156]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a8c28351-055a-461e-b49b-779ccf3a6e82 tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5cec0116-eb1b-49ae-8a2a-07d59d3bf88d.e052feb8-4c9f-4054-8d4e-1390bbbae7f5 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:48 devstack sudo[106795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5cec0116-eb1b-49ae-8a2a-07d59d3bf88d.e052feb8-4c9f-4054-8d4e-1390bbbae7f5 Nov 03 07:50:48 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:49 devstack sudo[106793]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-15b6ccca-9f70-4869-9175-505b5b07e659 tempest-CreateVolumesFromSnapshotTest-1905686095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e72f94b1-f1db-4742-8b98-7b77499b6d0f" returned: 0 in 0.533s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-15b6ccca-9f70-4869-9175-505b5b07e659 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e72f94b1-f1db-4742-8b98-7b77499b6d0f {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:49 devstack sudo[106801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e72f94b1-f1db-4742-8b98-7b77499b6d0f Nov 03 07:50:49 devstack sudo[106801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:49 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a8c28351-055a-461e-b49b-779ccf3a6e82 tempest-ProjectReaderTests-1379712565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5cec0116-eb1b-49ae-8a2a-07d59d3bf88d.e052feb8-4c9f-4054-8d4e-1390bbbae7f5" returned: 0 in 0.500s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:49 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-a8c28351-055a-461e-b49b-779ccf3a6e82 tempest-ProjectReaderTests-1379712565 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5cec0116-eb1b-49ae-8a2a-07d59d3bf88d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:50:49 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef208f06-e0d0-44a3-b175-8c26b6f50bbf]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a8c28351-055a-461e-b49b-779ccf3a6e82 tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5cec0116-eb1b-49ae-8a2a-07d59d3bf88d {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:49 devstack sudo[106806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5cec0116-eb1b-49ae-8a2a-07d59d3bf88d Nov 03 07:50:49 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:49 devstack sudo[106801]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-15b6ccca-9f70-4869-9175-505b5b07e659 tempest-CreateVolumesFromSnapshotTest-1905686095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e72f94b1-f1db-4742-8b98-7b77499b6d0f" returned: 0 in 0.336s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:49 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-15b6ccca-9f70-4869-9175-505b5b07e659 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "cinder-quobyte-e72f94b1-f1db-4742-8b98-7b77499b6d0f" released by "delete_volume" :: held 0.975s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:49 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-15b6ccca-9f70-4869-9175-505b5b07e659 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Created reservations ['8b3d58ab-c660-4e01-8e34-eb42d105943e', '0584eb86-41a7-4be4-a89e-4207aef751f8', '8b75855a-11e5-4a13-9eed-faf87d1b15b1', '25e2997e-249c-441d-a66d-6decb7687529'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:50:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-15b6ccca-9f70-4869-9175-505b5b07e659 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-15b6ccca-9f70-4869-9175-505b5b07e659 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:49 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-15b6ccca-9f70-4869-9175-505b5b07e659 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:49 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-15b6ccca-9f70-4869-9175-505b5b07e659 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-15b6ccca-9f70-4869-9175-505b5b07e659 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-15b6ccca-9f70-4869-9175-505b5b07e659 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:49 devstack sudo[106810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:50:49 devstack sudo[106810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:49 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a8c28351-055a-461e-b49b-779ccf3a6e82 tempest-ProjectReaderTests-1379712565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5cec0116-eb1b-49ae-8a2a-07d59d3bf88d" returned: 0 in 0.542s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a8c28351-055a-461e-b49b-779ccf3a6e82 tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5cec0116-eb1b-49ae-8a2a-07d59d3bf88d.e052feb8-4c9f-4054-8d4e-1390bbbae7f5 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:49 devstack sudo[106814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5cec0116-eb1b-49ae-8a2a-07d59d3bf88d.e052feb8-4c9f-4054-8d4e-1390bbbae7f5 Nov 03 07:50:49 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:49 devstack sudo[106810]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-15b6ccca-9f70-4869-9175-505b5b07e659 tempest-CreateVolumesFromSnapshotTest-1905686095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.336s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:49 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-15b6ccca-9f70-4869-9175-505b5b07e659 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:50:50 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-15b6ccca-9f70-4869-9175-505b5b07e659 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Deleted volume successfully. Nov 03 07:50:50 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-15b6ccca-9f70-4869-9175-505b5b07e659 tempest-CreateVolumesFromSnapshotTest-1905686095 None] Lock "cinder-e72f94b1-f1db-4742-8b98-7b77499b6d0f-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:50 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a8c28351-055a-461e-b49b-779ccf3a6e82 tempest-ProjectReaderTests-1379712565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5cec0116-eb1b-49ae-8a2a-07d59d3bf88d.e052feb8-4c9f-4054-8d4e-1390bbbae7f5" returned: 0 in 0.438s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a8c28351-055a-461e-b49b-779ccf3a6e82 tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5cec0116-eb1b-49ae-8a2a-07d59d3bf88d.e052feb8-4c9f-4054-8d4e-1390bbbae7f5 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:50 devstack sudo[106821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5cec0116-eb1b-49ae-8a2a-07d59d3bf88d.e052feb8-4c9f-4054-8d4e-1390bbbae7f5 Nov 03 07:50:50 devstack sudo[106821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:50 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a62b749-2745-4418-85b8-aa46f718b701 tempest-CinderUnicodeTest-1600781424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:50:50 devstack sudo[106821]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:50 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0a62b749-2745-4418-85b8-aa46f718b701 tempest-CinderUnicodeTest-1600781424 None] Flow 'volume_create_manager' (3a6db56b-0777-451b-b3e1-16a3b02317b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:50 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0a62b749-2745-4418-85b8-aa46f718b701 tempest-CinderUnicodeTest-1600781424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42639cb4-efb0-4be1-a19f-5b769720b88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a8c28351-055a-461e-b49b-779ccf3a6e82 tempest-ProjectReaderTests-1379712565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5cec0116-eb1b-49ae-8a2a-07d59d3bf88d.e052feb8-4c9f-4054-8d4e-1390bbbae7f5" returned: 0 in 0.355s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:50 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0a62b749-2745-4418-85b8-aa46f718b701 tempest-CinderUnicodeTest-1600781424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42639cb4-efb0-4be1-a19f-5b769720b88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:50Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26136263-e48d-4458-9674-412b48d04c70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d8dfce210404e1494f9e24876febddc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:51Z,use_quota=True,user_id='f3dec25275154775a432b1eec7fc1166',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:50 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0a62b749-2745-4418-85b8-aa46f718b701 tempest-CinderUnicodeTest-1600781424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38f491db-4680-446d-a08f-e20d8bc6a72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:50 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0a62b749-2745-4418-85b8-aa46f718b701 tempest-CinderUnicodeTest-1600781424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38f491db-4680-446d-a08f-e20d8bc6a72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:50 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0a62b749-2745-4418-85b8-aa46f718b701 tempest-CinderUnicodeTest-1600781424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffbdaa57-09d1-48ea-86ac-8b8785e8dab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:50 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0a62b749-2745-4418-85b8-aa46f718b701 tempest-CinderUnicodeTest-1600781424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffbdaa57-09d1-48ea-86ac-8b8785e8dab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26136263-e48d-4458-9674-412b48d04c70', 'volume_name': 'volume-26136263-e48d-4458-9674-412b48d04c70', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:50 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0a62b749-2745-4418-85b8-aa46f718b701 tempest-CinderUnicodeTest-1600781424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06e4c3c3-0c60-4338-a512-e4cd91ea3259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:50 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0a62b749-2745-4418-85b8-aa46f718b701 tempest-CinderUnicodeTest-1600781424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06e4c3c3-0c60-4338-a512-e4cd91ea3259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:50 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0a62b749-2745-4418-85b8-aa46f718b701 tempest-CinderUnicodeTest-1600781424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91db5f93-ef39-45b0-8c6a-b347d0289650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:50 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-0a62b749-2745-4418-85b8-aa46f718b701 tempest-CinderUnicodeTest-1600781424 None] Volume 26136263-e48d-4458-9674-412b48d04c70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26136263-e48d-4458-9674-412b48d04c70', 'volume_size': 1} Nov 03 07:50:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0a62b749-2745-4418-85b8-aa46f718b701 tempest-CinderUnicodeTest-1600781424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0a62b749-2745-4418-85b8-aa46f718b701 tempest-CinderUnicodeTest-1600781424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:50 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-0a62b749-2745-4418-85b8-aa46f718b701 tempest-CinderUnicodeTest-1600781424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:50Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26136263-e48d-4458-9674-412b48d04c70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d8dfce210404e1494f9e24876febddc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:51Z,use_quota=True,user_id='f3dec25275154775a432b1eec7fc1166',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:50:50 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-0a62b749-2745-4418-85b8-aa46f718b701 tempest-CinderUnicodeTest-1600781424 None] Creating volume 26136263-e48d-4458-9674-412b48d04c70 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:50:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0a62b749-2745-4418-85b8-aa46f718b701 tempest-CinderUnicodeTest-1600781424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0a62b749-2745-4418-85b8-aa46f718b701 tempest-CinderUnicodeTest-1600781424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:50 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-0a62b749-2745-4418-85b8-aa46f718b701 tempest-CinderUnicodeTest-1600781424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:50 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-0a62b749-2745-4418-85b8-aa46f718b701 tempest-CinderUnicodeTest-1600781424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0a62b749-2745-4418-85b8-aa46f718b701 tempest-CinderUnicodeTest-1600781424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:50 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-0a62b749-2745-4418-85b8-aa46f718b701 tempest-CinderUnicodeTest-1600781424 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:50:50 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-0a62b749-2745-4418-85b8-aa46f718b701 tempest-CinderUnicodeTest-1600781424 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:50:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0a62b749-2745-4418-85b8-aa46f718b701 tempest-CinderUnicodeTest-1600781424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-26136263-e48d-4458-9674-412b48d04c70 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:50 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a8c28351-055a-461e-b49b-779ccf3a6e82 tempest-ProjectReaderTests-1379712565 None] Lock "cinder-quobyte-e052feb8-4c9f-4054-8d4e-1390bbbae7f5" released by "_delete_snapshot" :: held 2.075s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:50 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a8c28351-055a-461e-b49b-779ccf3a6e82 tempest-ProjectReaderTests-1379712565 None] Lock "cinder-quobyte-5cec0116-eb1b-49ae-8a2a-07d59d3bf88d" released by "delete_snapshot" :: held 2.113s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:50 devstack sudo[106824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-26136263-e48d-4458-9674-412b48d04c70 1073741824 Nov 03 07:50:50 devstack sudo[106824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:50 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-a8c28351-055a-461e-b49b-779ccf3a6e82 tempest-ProjectReaderTests-1379712565 None] Created reservations ['bef86ba5-6755-4d45-8893-ecfbccf8ef06', 'fab25b11-b596-4b74-a18e-b2f350e5de10', '6518e694-dc5f-4dc3-990b-1b957d4bf30e', 'd821b1b2-32d4-4104-ac88-156096f206f7'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:50:50 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-a8c28351-055a-461e-b49b-779ccf3a6e82 tempest-ProjectReaderTests-1379712565 None] Delete snapshot completed successfully. Nov 03 07:50:50 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a8c28351-055a-461e-b49b-779ccf3a6e82 tempest-ProjectReaderTests-1379712565 None] Lock "cinder-e052feb8-4c9f-4054-8d4e-1390bbbae7f5-delete_snapshot" released by "delete_snapshot" :: held 2.328s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:51 devstack sudo[106824]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0a62b749-2745-4418-85b8-aa46f718b701 tempest-CinderUnicodeTest-1600781424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-26136263-e48d-4458-9674-412b48d04c70 1073741824" returned: 0 in 0.591s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0a62b749-2745-4418-85b8-aa46f718b701 tempest-CinderUnicodeTest-1600781424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-26136263-e48d-4458-9674-412b48d04c70 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:51 devstack sudo[106831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-26136263-e48d-4458-9674-412b48d04c70 Nov 03 07:50:51 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:51 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0a62b749-2745-4418-85b8-aa46f718b701 tempest-CinderUnicodeTest-1600781424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-26136263-e48d-4458-9674-412b48d04c70" returned: 0 in 0.296s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:51 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-0a62b749-2745-4418-85b8-aa46f718b701 tempest-CinderUnicodeTest-1600781424 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:50:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0a62b749-2745-4418-85b8-aa46f718b701 tempest-CinderUnicodeTest-1600781424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:51 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0a62b749-2745-4418-85b8-aa46f718b701 tempest-CinderUnicodeTest-1600781424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91db5f93-ef39-45b0-8c6a-b347d0289650) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26136263-e48d-4458-9674-412b48d04c70', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:51 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0a62b749-2745-4418-85b8-aa46f718b701 tempest-CinderUnicodeTest-1600781424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58adc610-f013-4c54-9663-7a706736c031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:51 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-0a62b749-2745-4418-85b8-aa46f718b701 tempest-CinderUnicodeTest-1600781424 None] Volume volume-26136263-e48d-4458-9674-412b48d04c70 (26136263-e48d-4458-9674-412b48d04c70): created successfully Nov 03 07:50:51 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0a62b749-2745-4418-85b8-aa46f718b701 tempest-CinderUnicodeTest-1600781424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58adc610-f013-4c54-9663-7a706736c031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:51 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0a62b749-2745-4418-85b8-aa46f718b701 tempest-CinderUnicodeTest-1600781424 None] Flow 'volume_create_manager' (3a6db56b-0777-451b-b3e1-16a3b02317b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:51 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-0a62b749-2745-4418-85b8-aa46f718b701 tempest-CinderUnicodeTest-1600781424 None] Created volume successfully. Nov 03 07:50:51 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-f15d6957-6c19-4f61-a6ba-bc2feb0985b3 tempest-ProjectReaderTests-1379712565 None] Acquiring lock "cinder-5cec0116-eb1b-49ae-8a2a-07d59d3bf88d-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:51 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-f15d6957-6c19-4f61-a6ba-bc2feb0985b3 tempest-ProjectReaderTests-1379712565 None] Lock "cinder-5cec0116-eb1b-49ae-8a2a-07d59d3bf88d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:51 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-f15d6957-6c19-4f61-a6ba-bc2feb0985b3 tempest-ProjectReaderTests-1379712565 None] Acquiring lock "cinder-quobyte-5cec0116-eb1b-49ae-8a2a-07d59d3bf88d" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:50:51 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-f15d6957-6c19-4f61-a6ba-bc2feb0985b3 tempest-ProjectReaderTests-1379712565 None] Lock "cinder-quobyte-5cec0116-eb1b-49ae-8a2a-07d59d3bf88d" acquired by "delete_volume" :: waited 0.023s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:50:51 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a30c43-d9f6-41af-99e1-0a0ac497b2e3]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f15d6957-6c19-4f61-a6ba-bc2feb0985b3 tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5cec0116-eb1b-49ae-8a2a-07d59d3bf88d {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:52 devstack sudo[106834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5cec0116-eb1b-49ae-8a2a-07d59d3bf88d Nov 03 07:50:52 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:52 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f15d6957-6c19-4f61-a6ba-bc2feb0985b3 tempest-ProjectReaderTests-1379712565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5cec0116-eb1b-49ae-8a2a-07d59d3bf88d" returned: 0 in 0.416s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f15d6957-6c19-4f61-a6ba-bc2feb0985b3 tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5cec0116-eb1b-49ae-8a2a-07d59d3bf88d {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:52 devstack sudo[106840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5cec0116-eb1b-49ae-8a2a-07d59d3bf88d Nov 03 07:50:52 devstack sudo[106840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:52 devstack sudo[106840]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f15d6957-6c19-4f61-a6ba-bc2feb0985b3 tempest-ProjectReaderTests-1379712565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-5cec0116-eb1b-49ae-8a2a-07d59d3bf88d" returned: 0 in 0.331s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:52 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-f15d6957-6c19-4f61-a6ba-bc2feb0985b3 tempest-ProjectReaderTests-1379712565 None] Lock "cinder-quobyte-5cec0116-eb1b-49ae-8a2a-07d59d3bf88d" released by "delete_volume" :: held 0.835s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:52 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-f15d6957-6c19-4f61-a6ba-bc2feb0985b3 tempest-ProjectReaderTests-1379712565 None] Created reservations ['89e61e61-08ff-4cf6-96f9-2dc8253000e3', '46c85b91-fb55-4da9-aaa1-077488a69b18', 'a75ba502-720a-4554-ad5e-6302bec40e5c', '3a0a2aa8-8876-4c24-bcbe-21c8a24d1120'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:50:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-f15d6957-6c19-4f61-a6ba-bc2feb0985b3 tempest-ProjectReaderTests-1379712565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-f15d6957-6c19-4f61-a6ba-bc2feb0985b3 tempest-ProjectReaderTests-1379712565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:52 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-f15d6957-6c19-4f61-a6ba-bc2feb0985b3 tempest-ProjectReaderTests-1379712565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:52 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-f15d6957-6c19-4f61-a6ba-bc2feb0985b3 tempest-ProjectReaderTests-1379712565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-f15d6957-6c19-4f61-a6ba-bc2feb0985b3 tempest-ProjectReaderTests-1379712565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f15d6957-6c19-4f61-a6ba-bc2feb0985b3 tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:53 devstack sudo[106843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:50:53 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:53 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f15d6957-6c19-4f61-a6ba-bc2feb0985b3 tempest-ProjectReaderTests-1379712565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.340s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:53 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-f15d6957-6c19-4f61-a6ba-bc2feb0985b3 tempest-ProjectReaderTests-1379712565 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:50:53 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-f15d6957-6c19-4f61-a6ba-bc2feb0985b3 tempest-ProjectReaderTests-1379712565 None] Deleted volume successfully. Nov 03 07:50:53 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-f15d6957-6c19-4f61-a6ba-bc2feb0985b3 tempest-ProjectReaderTests-1379712565 None] Lock "cinder-5cec0116-eb1b-49ae-8a2a-07d59d3bf88d-delete_volume" released by "delete_volume" :: held 1.508s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:50:53 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b3e1def-2db2-4881-bf5f-c520acdee01c tempest-CinderUnicodeTest-1600781424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:50:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0b3e1def-2db2-4881-bf5f-c520acdee01c tempest-CinderUnicodeTest-1600781424 None] Flow 'volume_create_manager' (7ec23599-4891-47d2-8eab-d356f6038b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0b3e1def-2db2-4881-bf5f-c520acdee01c tempest-CinderUnicodeTest-1600781424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db41f858-4cc2-438d-b944-91b8d951c16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0b3e1def-2db2-4881-bf5f-c520acdee01c tempest-CinderUnicodeTest-1600781424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db41f858-4cc2-438d-b944-91b8d951c16e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:53Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1551532376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66ff5bd3-a928-41e7-9bd2-27449a34be82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d8dfce210404e1494f9e24876febddc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:53Z,use_quota=True,user_id='f3dec25275154775a432b1eec7fc1166',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0b3e1def-2db2-4881-bf5f-c520acdee01c tempest-CinderUnicodeTest-1600781424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f85705c8-dcdc-408a-b9fd-03b2085c504f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0b3e1def-2db2-4881-bf5f-c520acdee01c tempest-CinderUnicodeTest-1600781424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f85705c8-dcdc-408a-b9fd-03b2085c504f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0b3e1def-2db2-4881-bf5f-c520acdee01c tempest-CinderUnicodeTest-1600781424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d52ab36-53a4-4f5a-b43f-e718741a96c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0b3e1def-2db2-4881-bf5f-c520acdee01c tempest-CinderUnicodeTest-1600781424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d52ab36-53a4-4f5a-b43f-e718741a96c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66ff5bd3-a928-41e7-9bd2-27449a34be82', 'volume_name': 'volume-66ff5bd3-a928-41e7-9bd2-27449a34be82', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0b3e1def-2db2-4881-bf5f-c520acdee01c tempest-CinderUnicodeTest-1600781424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f15c0f0-43f3-49f2-ac23-0ac5370f2452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0b3e1def-2db2-4881-bf5f-c520acdee01c tempest-CinderUnicodeTest-1600781424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f15c0f0-43f3-49f2-ac23-0ac5370f2452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0b3e1def-2db2-4881-bf5f-c520acdee01c tempest-CinderUnicodeTest-1600781424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb009cfd-2ff9-4e73-8c04-c3c71a348484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:53 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-0b3e1def-2db2-4881-bf5f-c520acdee01c tempest-CinderUnicodeTest-1600781424 None] Volume 66ff5bd3-a928-41e7-9bd2-27449a34be82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66ff5bd3-a928-41e7-9bd2-27449a34be82', 'volume_size': 1} Nov 03 07:50:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0b3e1def-2db2-4881-bf5f-c520acdee01c tempest-CinderUnicodeTest-1600781424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0b3e1def-2db2-4881-bf5f-c520acdee01c tempest-CinderUnicodeTest-1600781424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:53 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-0b3e1def-2db2-4881-bf5f-c520acdee01c tempest-CinderUnicodeTest-1600781424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:53Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1551532376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66ff5bd3-a928-41e7-9bd2-27449a34be82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d8dfce210404e1494f9e24876febddc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:53Z,use_quota=True,user_id='f3dec25275154775a432b1eec7fc1166',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:50:53 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-0b3e1def-2db2-4881-bf5f-c520acdee01c tempest-CinderUnicodeTest-1600781424 None] Creating volume 66ff5bd3-a928-41e7-9bd2-27449a34be82 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:50:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0b3e1def-2db2-4881-bf5f-c520acdee01c tempest-CinderUnicodeTest-1600781424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0b3e1def-2db2-4881-bf5f-c520acdee01c tempest-CinderUnicodeTest-1600781424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:53 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-0b3e1def-2db2-4881-bf5f-c520acdee01c tempest-CinderUnicodeTest-1600781424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:53 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-0b3e1def-2db2-4881-bf5f-c520acdee01c tempest-CinderUnicodeTest-1600781424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0b3e1def-2db2-4881-bf5f-c520acdee01c tempest-CinderUnicodeTest-1600781424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:53 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-0b3e1def-2db2-4881-bf5f-c520acdee01c tempest-CinderUnicodeTest-1600781424 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:50:53 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-0b3e1def-2db2-4881-bf5f-c520acdee01c tempest-CinderUnicodeTest-1600781424 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:50:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0b3e1def-2db2-4881-bf5f-c520acdee01c tempest-CinderUnicodeTest-1600781424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-66ff5bd3-a928-41e7-9bd2-27449a34be82 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:53 devstack sudo[106846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-66ff5bd3-a928-41e7-9bd2-27449a34be82 1073741824 Nov 03 07:50:53 devstack sudo[106846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:53 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-6303149b-e813-4fb2-86e8-df40d7359c27 tempest-ProjectReaderTests-1379712565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:50:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-6303149b-e813-4fb2-86e8-df40d7359c27 tempest-ProjectReaderTests-1379712565 None] Flow 'volume_create_manager' (8e3f721d-8600-48cc-9fb1-073cd9e1f794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-6303149b-e813-4fb2-86e8-df40d7359c27 tempest-ProjectReaderTests-1379712565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70da573f-91eb-45f0-9f21-49fba4e9daa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-6303149b-e813-4fb2-86e8-df40d7359c27 tempest-ProjectReaderTests-1379712565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70da573f-91eb-45f0-9f21-49fba4e9daa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-169798905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d37c5172-5d55-4349-9ff0-ee981609729c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e063beebf62e4f73889c7cf7c63d85ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:54Z,use_quota=True,user_id='51c0eb5e9adb43cf9694fdbca9269bec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-6303149b-e813-4fb2-86e8-df40d7359c27 tempest-ProjectReaderTests-1379712565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfaf9b19-dff0-41e7-a582-5d80a61f823f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-6303149b-e813-4fb2-86e8-df40d7359c27 tempest-ProjectReaderTests-1379712565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfaf9b19-dff0-41e7-a582-5d80a61f823f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-6303149b-e813-4fb2-86e8-df40d7359c27 tempest-ProjectReaderTests-1379712565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (996b1a0c-281b-4b2d-97f7-a6f1f01c2679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-6303149b-e813-4fb2-86e8-df40d7359c27 tempest-ProjectReaderTests-1379712565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (996b1a0c-281b-4b2d-97f7-a6f1f01c2679) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd37c5172-5d55-4349-9ff0-ee981609729c', 'volume_name': 'volume-d37c5172-5d55-4349-9ff0-ee981609729c', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-6303149b-e813-4fb2-86e8-df40d7359c27 tempest-ProjectReaderTests-1379712565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b21b9200-b169-4fad-b840-0cb27997cf48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-6303149b-e813-4fb2-86e8-df40d7359c27 tempest-ProjectReaderTests-1379712565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b21b9200-b169-4fad-b840-0cb27997cf48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-6303149b-e813-4fb2-86e8-df40d7359c27 tempest-ProjectReaderTests-1379712565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c44e2446-d86b-423d-b2d6-24cebc64f519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:53 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-6303149b-e813-4fb2-86e8-df40d7359c27 tempest-ProjectReaderTests-1379712565 None] Volume d37c5172-5d55-4349-9ff0-ee981609729c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d37c5172-5d55-4349-9ff0-ee981609729c', 'volume_size': 1} Nov 03 07:50:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-6303149b-e813-4fb2-86e8-df40d7359c27 tempest-ProjectReaderTests-1379712565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:54 devstack sudo[106846]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0b3e1def-2db2-4881-bf5f-c520acdee01c tempest-CinderUnicodeTest-1600781424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-66ff5bd3-a928-41e7-9bd2-27449a34be82 1073741824" returned: 0 in 0.573s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0b3e1def-2db2-4881-bf5f-c520acdee01c tempest-CinderUnicodeTest-1600781424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-66ff5bd3-a928-41e7-9bd2-27449a34be82 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:54 devstack sudo[106852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-66ff5bd3-a928-41e7-9bd2-27449a34be82 Nov 03 07:50:54 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:54 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0b3e1def-2db2-4881-bf5f-c520acdee01c tempest-CinderUnicodeTest-1600781424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-66ff5bd3-a928-41e7-9bd2-27449a34be82" returned: 0 in 0.332s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:54 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-0b3e1def-2db2-4881-bf5f-c520acdee01c tempest-CinderUnicodeTest-1600781424 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:50:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0b3e1def-2db2-4881-bf5f-c520acdee01c tempest-CinderUnicodeTest-1600781424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-6303149b-e813-4fb2-86e8-df40d7359c27 tempest-ProjectReaderTests-1379712565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.630s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:54 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-6303149b-e813-4fb2-86e8-df40d7359c27 tempest-ProjectReaderTests-1379712565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-169798905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d37c5172-5d55-4349-9ff0-ee981609729c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e063beebf62e4f73889c7cf7c63d85ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:54Z,use_quota=True,user_id='51c0eb5e9adb43cf9694fdbca9269bec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:50:54 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-6303149b-e813-4fb2-86e8-df40d7359c27 tempest-ProjectReaderTests-1379712565 None] Creating volume d37c5172-5d55-4349-9ff0-ee981609729c {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:50:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-6303149b-e813-4fb2-86e8-df40d7359c27 tempest-ProjectReaderTests-1379712565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-6303149b-e813-4fb2-86e8-df40d7359c27 tempest-ProjectReaderTests-1379712565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:54 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-6303149b-e813-4fb2-86e8-df40d7359c27 tempest-ProjectReaderTests-1379712565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:54 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-6303149b-e813-4fb2-86e8-df40d7359c27 tempest-ProjectReaderTests-1379712565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-6303149b-e813-4fb2-86e8-df40d7359c27 tempest-ProjectReaderTests-1379712565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:54 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-6303149b-e813-4fb2-86e8-df40d7359c27 tempest-ProjectReaderTests-1379712565 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:50:54 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-6303149b-e813-4fb2-86e8-df40d7359c27 tempest-ProjectReaderTests-1379712565 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:50:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6303149b-e813-4fb2-86e8-df40d7359c27 tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d37c5172-5d55-4349-9ff0-ee981609729c 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:54 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0b3e1def-2db2-4881-bf5f-c520acdee01c tempest-CinderUnicodeTest-1600781424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb009cfd-2ff9-4e73-8c04-c3c71a348484) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66ff5bd3-a928-41e7-9bd2-27449a34be82', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:54 devstack sudo[106855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d37c5172-5d55-4349-9ff0-ee981609729c 1073741824 Nov 03 07:50:54 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0b3e1def-2db2-4881-bf5f-c520acdee01c tempest-CinderUnicodeTest-1600781424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad137529-6800-4bfa-bacc-48e003e37c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:54 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:54 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-0b3e1def-2db2-4881-bf5f-c520acdee01c tempest-CinderUnicodeTest-1600781424 None] Volume volume-66ff5bd3-a928-41e7-9bd2-27449a34be82 (66ff5bd3-a928-41e7-9bd2-27449a34be82): created successfully Nov 03 07:50:54 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0b3e1def-2db2-4881-bf5f-c520acdee01c tempest-CinderUnicodeTest-1600781424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad137529-6800-4bfa-bacc-48e003e37c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:54 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0b3e1def-2db2-4881-bf5f-c520acdee01c tempest-CinderUnicodeTest-1600781424 None] Flow 'volume_create_manager' (7ec23599-4891-47d2-8eab-d356f6038b04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:54 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-0b3e1def-2db2-4881-bf5f-c520acdee01c tempest-CinderUnicodeTest-1600781424 None] Created volume successfully. Nov 03 07:50:54 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac9ce60a-7604-4eac-bac1-9c86cef72f49 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:50:54 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ac9ce60a-7604-4eac-bac1-9c86cef72f49 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Flow 'volume_create_manager' (5b8ed9df-c7d8-43e8-a104-19cd6f0c51ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:54 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ac9ce60a-7604-4eac-bac1-9c86cef72f49 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c2a9ad0-f025-4a91-be85-e7c92491fdf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:54 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ac9ce60a-7604-4eac-bac1-9c86cef72f49 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c2a9ad0-f025-4a91-be85-e7c92491fdf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-109689809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e77db5c5-3d80-4cc6-bbdb-583bab4c9764,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7380acb0cb634e8ea83bc86e6f4859c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:55Z,use_quota=True,user_id='c2a82384ce6c4791a6a63d8a90f486d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:54 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ac9ce60a-7604-4eac-bac1-9c86cef72f49 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91ffafdd-5071-4602-881a-0ef26d28d8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:54 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ac9ce60a-7604-4eac-bac1-9c86cef72f49 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91ffafdd-5071-4602-881a-0ef26d28d8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:54 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ac9ce60a-7604-4eac-bac1-9c86cef72f49 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60f210ae-b242-4071-970c-4abbe9184307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:54 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ac9ce60a-7604-4eac-bac1-9c86cef72f49 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60f210ae-b242-4071-970c-4abbe9184307) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e77db5c5-3d80-4cc6-bbdb-583bab4c9764', 'volume_name': 'volume-e77db5c5-3d80-4cc6-bbdb-583bab4c9764', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:54 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ac9ce60a-7604-4eac-bac1-9c86cef72f49 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa3c5485-45db-4bd4-8f53-a1bfe8bd7a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:54 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ac9ce60a-7604-4eac-bac1-9c86cef72f49 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa3c5485-45db-4bd4-8f53-a1bfe8bd7a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:54 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ac9ce60a-7604-4eac-bac1-9c86cef72f49 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48574b9e-cb05-42c3-97e9-784ce7d8a013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:54 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-ac9ce60a-7604-4eac-bac1-9c86cef72f49 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Volume e77db5c5-3d80-4cc6-bbdb-583bab4c9764: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e77db5c5-3d80-4cc6-bbdb-583bab4c9764', 'volume_size': 1} Nov 03 07:50:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-ac9ce60a-7604-4eac-bac1-9c86cef72f49 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:55 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6303149b-e813-4fb2-86e8-df40d7359c27 tempest-ProjectReaderTests-1379712565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d37c5172-5d55-4349-9ff0-ee981609729c 1073741824" returned: 0 in 0.683s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6303149b-e813-4fb2-86e8-df40d7359c27 tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d37c5172-5d55-4349-9ff0-ee981609729c {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:55 devstack sudo[106861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d37c5172-5d55-4349-9ff0-ee981609729c Nov 03 07:50:55 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:55 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6303149b-e813-4fb2-86e8-df40d7359c27 tempest-ProjectReaderTests-1379712565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d37c5172-5d55-4349-9ff0-ee981609729c" returned: 0 in 0.296s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:55 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-6303149b-e813-4fb2-86e8-df40d7359c27 tempest-ProjectReaderTests-1379712565 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:50:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-6303149b-e813-4fb2-86e8-df40d7359c27 tempest-ProjectReaderTests-1379712565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-ac9ce60a-7604-4eac-bac1-9c86cef72f49 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.737s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:55 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-ac9ce60a-7604-4eac-bac1-9c86cef72f49 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-109689809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e77db5c5-3d80-4cc6-bbdb-583bab4c9764,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7380acb0cb634e8ea83bc86e6f4859c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:55Z,use_quota=True,user_id='c2a82384ce6c4791a6a63d8a90f486d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:50:55 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-ac9ce60a-7604-4eac-bac1-9c86cef72f49 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Creating volume e77db5c5-3d80-4cc6-bbdb-583bab4c9764 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:50:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-ac9ce60a-7604-4eac-bac1-9c86cef72f49 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-ac9ce60a-7604-4eac-bac1-9c86cef72f49 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:55 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-ac9ce60a-7604-4eac-bac1-9c86cef72f49 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:50:55 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-ac9ce60a-7604-4eac-bac1-9c86cef72f49 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:50:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-ac9ce60a-7604-4eac-bac1-9c86cef72f49 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:55 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-ac9ce60a-7604-4eac-bac1-9c86cef72f49 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:50:55 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-ac9ce60a-7604-4eac-bac1-9c86cef72f49 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:50:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ac9ce60a-7604-4eac-bac1-9c86cef72f49 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e77db5c5-3d80-4cc6-bbdb-583bab4c9764 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:55 devstack sudo[106864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e77db5c5-3d80-4cc6-bbdb-583bab4c9764 1073741824 Nov 03 07:50:55 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:55 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-6303149b-e813-4fb2-86e8-df40d7359c27 tempest-ProjectReaderTests-1379712565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c44e2446-d86b-423d-b2d6-24cebc64f519) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d37c5172-5d55-4349-9ff0-ee981609729c', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:55 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-6303149b-e813-4fb2-86e8-df40d7359c27 tempest-ProjectReaderTests-1379712565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b330096e-6816-407e-bf26-c964bb3823b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:55 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-6303149b-e813-4fb2-86e8-df40d7359c27 tempest-ProjectReaderTests-1379712565 None] Volume volume-d37c5172-5d55-4349-9ff0-ee981609729c (d37c5172-5d55-4349-9ff0-ee981609729c): created successfully Nov 03 07:50:55 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-6303149b-e813-4fb2-86e8-df40d7359c27 tempest-ProjectReaderTests-1379712565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b330096e-6816-407e-bf26-c964bb3823b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:55 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-6303149b-e813-4fb2-86e8-df40d7359c27 tempest-ProjectReaderTests-1379712565 None] Flow 'volume_create_manager' (8e3f721d-8600-48cc-9fb1-073cd9e1f794) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:55 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-6303149b-e813-4fb2-86e8-df40d7359c27 tempest-ProjectReaderTests-1379712565 None] Created volume successfully. Nov 03 07:50:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-6613c320-7d50-48cb-ace6-31aa17ca2c55 tempest-CinderUnicodeTest-1600781424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-cdda0f63-8c09-4934-aee8-3f6011eadaa8 tempest-ProjectReaderTests-1379712565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:56 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ac9ce60a-7604-4eac-bac1-9c86cef72f49 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e77db5c5-3d80-4cc6-bbdb-583bab4c9764 1073741824" returned: 0 in 0.574s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ac9ce60a-7604-4eac-bac1-9c86cef72f49 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e77db5c5-3d80-4cc6-bbdb-583bab4c9764 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:56 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e77db5c5-3d80-4cc6-bbdb-583bab4c9764 Nov 03 07:50:56 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:56 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ac9ce60a-7604-4eac-bac1-9c86cef72f49 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e77db5c5-3d80-4cc6-bbdb-583bab4c9764" returned: 0 in 0.242s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:56 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-ac9ce60a-7604-4eac-bac1-9c86cef72f49 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:50:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-ac9ce60a-7604-4eac-bac1-9c86cef72f49 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-6613c320-7d50-48cb-ace6-31aa17ca2c55 tempest-CinderUnicodeTest-1600781424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.742s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:56 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-6613c320-7d50-48cb-ace6-31aa17ca2c55 tempest-CinderUnicodeTest-1600781424 None] Creating offline snapshot ad4d57a9-1f2f-445f-80a5-28f6725c1dbc of volume 66ff5bd3-a928-41e7-9bd2-27449a34be82 {{(pid=86875) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:50:56 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ac9ce60a-7604-4eac-bac1-9c86cef72f49 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48574b9e-cb05-42c3-97e9-784ce7d8a013) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e77db5c5-3d80-4cc6-bbdb-583bab4c9764', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:56 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ac9ce60a-7604-4eac-bac1-9c86cef72f49 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d34e18e3-5c59-4213-921d-aaf22bbf178a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:56 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df8bf67-7727-4f37-b1a3-babd3859302b]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6613c320-7d50-48cb-ace6-31aa17ca2c55 tempest-CinderUnicodeTest-1600781424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-66ff5bd3-a928-41e7-9bd2-27449a34be82 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:56 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-ac9ce60a-7604-4eac-bac1-9c86cef72f49 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Volume volume-e77db5c5-3d80-4cc6-bbdb-583bab4c9764 (e77db5c5-3d80-4cc6-bbdb-583bab4c9764): created successfully Nov 03 07:50:56 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ac9ce60a-7604-4eac-bac1-9c86cef72f49 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d34e18e3-5c59-4213-921d-aaf22bbf178a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:56 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ac9ce60a-7604-4eac-bac1-9c86cef72f49 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Flow 'volume_create_manager' (5b8ed9df-c7d8-43e8-a104-19cd6f0c51ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:56 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-ac9ce60a-7604-4eac-bac1-9c86cef72f49 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Created volume successfully. Nov 03 07:50:56 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-66ff5bd3-a928-41e7-9bd2-27449a34be82 Nov 03 07:50:56 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:57 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6613c320-7d50-48cb-ace6-31aa17ca2c55 tempest-CinderUnicodeTest-1600781424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-66ff5bd3-a928-41e7-9bd2-27449a34be82" returned: 0 in 0.458s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6613c320-7d50-48cb-ace6-31aa17ca2c55 tempest-CinderUnicodeTest-1600781424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-66ff5bd3-a928-41e7-9bd2-27449a34be82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-66ff5bd3-a928-41e7-9bd2-27449a34be82.ad4d57a9-1f2f-445f-80a5-28f6725c1dbc 1G {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:57 devstack sudo[106878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-66ff5bd3-a928-41e7-9bd2-27449a34be82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-66ff5bd3-a928-41e7-9bd2-27449a34be82.ad4d57a9-1f2f-445f-80a5-28f6725c1dbc 1G Nov 03 07:50:57 devstack sudo[106878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:57 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-38012988-c6ce-434d-ada1-58361ee0c464 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:50:57 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-38012988-c6ce-434d-ada1-58361ee0c464 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Flow 'volume_create_manager' (2aa7c750-1ed9-4eb2-bcd0-5b8a04be2e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:57 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-38012988-c6ce-434d-ada1-58361ee0c464 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a84d3b7-c731-469b-b81b-5c7637c3e385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:57 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-38012988-c6ce-434d-ada1-58361ee0c464 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a84d3b7-c731-469b-b81b-5c7637c3e385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2085745213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f9f47d2-80df-43a3-ad4d-efcdb526ff26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7380acb0cb634e8ea83bc86e6f4859c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:57Z,use_quota=True,user_id='c2a82384ce6c4791a6a63d8a90f486d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:57 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-38012988-c6ce-434d-ada1-58361ee0c464 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ca64f28-fc67-4be6-a262-62c504a0e0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:57 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-38012988-c6ce-434d-ada1-58361ee0c464 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ca64f28-fc67-4be6-a262-62c504a0e0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:57 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-38012988-c6ce-434d-ada1-58361ee0c464 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7585ac57-74a9-4444-aa9b-f08d6ec3572c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:57 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-38012988-c6ce-434d-ada1-58361ee0c464 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7585ac57-74a9-4444-aa9b-f08d6ec3572c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f9f47d2-80df-43a3-ad4d-efcdb526ff26', 'volume_name': 'volume-6f9f47d2-80df-43a3-ad4d-efcdb526ff26', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:57 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-38012988-c6ce-434d-ada1-58361ee0c464 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (660199a7-3150-4546-ad32-99d1f9b1dbc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:57 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-38012988-c6ce-434d-ada1-58361ee0c464 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (660199a7-3150-4546-ad32-99d1f9b1dbc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:57 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-38012988-c6ce-434d-ada1-58361ee0c464 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1a0b614-0689-46e3-9a65-1b0ca2b0dd7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:57 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-38012988-c6ce-434d-ada1-58361ee0c464 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Volume 6f9f47d2-80df-43a3-ad4d-efcdb526ff26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f9f47d2-80df-43a3-ad4d-efcdb526ff26', 'volume_size': 1} Nov 03 07:50:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-38012988-c6ce-434d-ada1-58361ee0c464 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:57 devstack sudo[106878]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6613c320-7d50-48cb-ace6-31aa17ca2c55 tempest-CinderUnicodeTest-1600781424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-66ff5bd3-a928-41e7-9bd2-27449a34be82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-66ff5bd3-a928-41e7-9bd2-27449a34be82.ad4d57a9-1f2f-445f-80a5-28f6725c1dbc 1G" returned: 0 in 0.620s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6613c320-7d50-48cb-ace6-31aa17ca2c55 tempest-CinderUnicodeTest-1600781424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66ff5bd3-a928-41e7-9bd2-27449a34be82 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-66ff5bd3-a928-41e7-9bd2-27449a34be82.ad4d57a9-1f2f-445f-80a5-28f6725c1dbc {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:57 devstack sudo[106884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66ff5bd3-a928-41e7-9bd2-27449a34be82 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-66ff5bd3-a928-41e7-9bd2-27449a34be82.ad4d57a9-1f2f-445f-80a5-28f6725c1dbc Nov 03 07:50:57 devstack sudo[106884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:57 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-88d82783-48e2-4821-958a-b8901ea8ad82 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:50:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-88d82783-48e2-4821-958a-b8901ea8ad82 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Flow 'volume_create_manager' (f8170a2c-05f7-4b47-b82c-024ea5460c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-88d82783-48e2-4821-958a-b8901ea8ad82 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (180aaaaa-bbf6-4118-99b3-f3eed2a48aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-88d82783-48e2-4821-958a-b8901ea8ad82 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (180aaaaa-bbf6-4118-99b3-f3eed2a48aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-557284080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa1f0fba-1ed2-4215-92c1-88433bafed4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7380acb0cb634e8ea83bc86e6f4859c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:58Z,use_quota=True,user_id='c2a82384ce6c4791a6a63d8a90f486d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-88d82783-48e2-4821-958a-b8901ea8ad82 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f677a1bf-3d2d-45e2-ad9d-14f158b9ea8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-88d82783-48e2-4821-958a-b8901ea8ad82 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f677a1bf-3d2d-45e2-ad9d-14f158b9ea8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-88d82783-48e2-4821-958a-b8901ea8ad82 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac7a2179-93d1-4527-9e04-16010d5230ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-88d82783-48e2-4821-958a-b8901ea8ad82 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac7a2179-93d1-4527-9e04-16010d5230ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa1f0fba-1ed2-4215-92c1-88433bafed4d', 'volume_name': 'volume-fa1f0fba-1ed2-4215-92c1-88433bafed4d', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-88d82783-48e2-4821-958a-b8901ea8ad82 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b4f8341-109c-4c21-b3d2-c46e85248c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-88d82783-48e2-4821-958a-b8901ea8ad82 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b4f8341-109c-4c21-b3d2-c46e85248c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-88d82783-48e2-4821-958a-b8901ea8ad82 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c83d645f-ed9f-4c35-bb02-1b0678c3780f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:58 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-88d82783-48e2-4821-958a-b8901ea8ad82 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Volume fa1f0fba-1ed2-4215-92c1-88433bafed4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa1f0fba-1ed2-4215-92c1-88433bafed4d', 'volume_size': 1} Nov 03 07:50:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-88d82783-48e2-4821-958a-b8901ea8ad82 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:58 devstack sudo[106884]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6613c320-7d50-48cb-ace6-31aa17ca2c55 tempest-CinderUnicodeTest-1600781424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66ff5bd3-a928-41e7-9bd2-27449a34be82 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-66ff5bd3-a928-41e7-9bd2-27449a34be82.ad4d57a9-1f2f-445f-80a5-28f6725c1dbc" returned: 0 in 0.488s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:58 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-6613c320-7d50-48cb-ace6-31aa17ca2c55 tempest-CinderUnicodeTest-1600781424 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-66ff5bd3-a928-41e7-9bd2-27449a34be82.ad4d57a9-1f2f-445f-80a5-28f6725c1dbc is being set with open permissions: ugo+rw Nov 03 07:50:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6613c320-7d50-48cb-ace6-31aa17ca2c55 tempest-CinderUnicodeTest-1600781424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-66ff5bd3-a928-41e7-9bd2-27449a34be82.ad4d57a9-1f2f-445f-80a5-28f6725c1dbc {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:58 devstack sudo[106891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-66ff5bd3-a928-41e7-9bd2-27449a34be82.ad4d57a9-1f2f-445f-80a5-28f6725c1dbc Nov 03 07:50:58 devstack sudo[106891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:58 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed0f177a-03ba-4bd1-b1bc-65b55770694d tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:50:58 devstack sudo[106891]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ed0f177a-03ba-4bd1-b1bc-65b55770694d tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Flow 'volume_create_manager' (7604840f-48ce-47d8-a377-5154d9168fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ed0f177a-03ba-4bd1-b1bc-65b55770694d tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (668d0d3a-7c6f-4f8c-b0ec-4c591fd77295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6613c320-7d50-48cb-ace6-31aa17ca2c55 tempest-CinderUnicodeTest-1600781424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-66ff5bd3-a928-41e7-9bd2-27449a34be82.ad4d57a9-1f2f-445f-80a5-28f6725c1dbc" returned: 0 in 0.311s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ed0f177a-03ba-4bd1-b1bc-65b55770694d tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (668d0d3a-7c6f-4f8c-b0ec-4c591fd77295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1694617107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e599b49a-e25e-49df-9b7a-b05f339a2631,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7380acb0cb634e8ea83bc86e6f4859c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:58Z,use_quota=True,user_id='c2a82384ce6c4791a6a63d8a90f486d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ed0f177a-03ba-4bd1-b1bc-65b55770694d tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b32d0edd-f1a0-4222-b5ae-e113fb2c3c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ed0f177a-03ba-4bd1-b1bc-65b55770694d tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b32d0edd-f1a0-4222-b5ae-e113fb2c3c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ed0f177a-03ba-4bd1-b1bc-65b55770694d tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (498570ac-86f3-4e0d-a80d-f59c534894ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ed0f177a-03ba-4bd1-b1bc-65b55770694d tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (498570ac-86f3-4e0d-a80d-f59c534894ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e599b49a-e25e-49df-9b7a-b05f339a2631', 'volume_name': 'volume-e599b49a-e25e-49df-9b7a-b05f339a2631', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ed0f177a-03ba-4bd1-b1bc-65b55770694d tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d30190f4-c0b7-472d-acd6-8b91feac8ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ed0f177a-03ba-4bd1-b1bc-65b55770694d tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d30190f4-c0b7-472d-acd6-8b91feac8ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ed0f177a-03ba-4bd1-b1bc-65b55770694d tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49b8c3dc-c8f9-495b-b934-19d24cbab5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:58 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-ed0f177a-03ba-4bd1-b1bc-65b55770694d tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Volume e599b49a-e25e-49df-9b7a-b05f339a2631: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e599b49a-e25e-49df-9b7a-b05f339a2631', 'volume_size': 1} Nov 03 07:50:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-ed0f177a-03ba-4bd1-b1bc-65b55770694d tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6613c320-7d50-48cb-ace6-31aa17ca2c55 tempest-CinderUnicodeTest-1600781424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-66ff5bd3-a928-41e7-9bd2-27449a34be82.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:58 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-66ff5bd3-a928-41e7-9bd2-27449a34be82.info Nov 03 07:50:58 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:58 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a457919-0eea-4277-9693-d2f704098caa tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:50:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7a457919-0eea-4277-9693-d2f704098caa tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Flow 'volume_create_manager' (cca547dc-9733-415f-97bd-3cf376bffb36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:58 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7a457919-0eea-4277-9693-d2f704098caa tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (881b9937-e13d-472f-b041-651f12c8cfa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6613c320-7d50-48cb-ace6-31aa17ca2c55 tempest-CinderUnicodeTest-1600781424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-66ff5bd3-a928-41e7-9bd2-27449a34be82.info" returned: 0 in 0.353s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:58 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-6613c320-7d50-48cb-ace6-31aa17ca2c55 tempest-CinderUnicodeTest-1600781424 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-66ff5bd3-a928-41e7-9bd2-27449a34be82.info is being set with open permissions: ugo+rw Nov 03 07:50:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6613c320-7d50-48cb-ace6-31aa17ca2c55 tempest-CinderUnicodeTest-1600781424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-66ff5bd3-a928-41e7-9bd2-27449a34be82.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7a457919-0eea-4277-9693-d2f704098caa tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (881b9937-e13d-472f-b041-651f12c8cfa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1453034587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e73233b7-f226-469d-85d5-7e25084e5784,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7380acb0cb634e8ea83bc86e6f4859c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:59Z,use_quota=True,user_id='c2a82384ce6c4791a6a63d8a90f486d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:58 devstack sudo[106897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-66ff5bd3-a928-41e7-9bd2-27449a34be82.info Nov 03 07:50:58 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7a457919-0eea-4277-9693-d2f704098caa tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f13c0982-b189-4681-b1c4-82d6ab33bd45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7a457919-0eea-4277-9693-d2f704098caa tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f13c0982-b189-4681-b1c4-82d6ab33bd45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7a457919-0eea-4277-9693-d2f704098caa tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6389c6d8-5b0c-42ce-972f-5b02140a14d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7a457919-0eea-4277-9693-d2f704098caa tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6389c6d8-5b0c-42ce-972f-5b02140a14d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e73233b7-f226-469d-85d5-7e25084e5784', 'volume_name': 'volume-e73233b7-f226-469d-85d5-7e25084e5784', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7a457919-0eea-4277-9693-d2f704098caa tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ba91d61-fd62-4bc3-a58c-34a82269f4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7a457919-0eea-4277-9693-d2f704098caa tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ba91d61-fd62-4bc3-a58c-34a82269f4b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:58 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7a457919-0eea-4277-9693-d2f704098caa tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0ec7772-5107-4923-9924-f0f7f194bca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:58 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-7a457919-0eea-4277-9693-d2f704098caa tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Volume e73233b7-f226-469d-85d5-7e25084e5784: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e73233b7-f226-469d-85d5-7e25084e5784', 'volume_size': 1} Nov 03 07:50:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7a457919-0eea-4277-9693-d2f704098caa tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:59 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6613c320-7d50-48cb-ace6-31aa17ca2c55 tempest-CinderUnicodeTest-1600781424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-66ff5bd3-a928-41e7-9bd2-27449a34be82.info" returned: 0 in 0.297s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-6613c320-7d50-48cb-ace6-31aa17ca2c55 tempest-CinderUnicodeTest-1600781424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.702s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:50:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-cdda0f63-8c09-4934-aee8-3f6011eadaa8 tempest-ProjectReaderTests-1379712565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.025s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:50:59 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-cdda0f63-8c09-4934-aee8-3f6011eadaa8 tempest-ProjectReaderTests-1379712565 None] Creating offline snapshot 035e505a-0a71-4750-bff2-914d261938b1 of volume d37c5172-5d55-4349-9ff0-ee981609729c {{(pid=86875) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:50:59 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-e05cb773-6c0c-4617-8ae4-987d91d96c3b tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:50:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e05cb773-6c0c-4617-8ae4-987d91d96c3b tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Flow 'volume_create_manager' (558129f8-2cef-4b66-90da-882517bea80b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:50:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e05cb773-6c0c-4617-8ae4-987d91d96c3b tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db7aee51-9238-4c56-9e38-d7c9f96acea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:59 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[18bcb9d7-5861-4b56-913b-f1e2c8c3e2cd]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:50:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-cdda0f63-8c09-4934-aee8-3f6011eadaa8 tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d37c5172-5d55-4349-9ff0-ee981609729c {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:59 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-6613c320-7d50-48cb-ace6-31aa17ca2c55 tempest-CinderUnicodeTest-1600781424 None] Create snapshot completed successfully Nov 03 07:50:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e05cb773-6c0c-4617-8ae4-987d91d96c3b tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db7aee51-9238-4c56-9e38-d7c9f96acea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-387001296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ba22102-2b82-4abf-bd46-a8dc2b33c6ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7380acb0cb634e8ea83bc86e6f4859c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:59Z,use_quota=True,user_id='c2a82384ce6c4791a6a63d8a90f486d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e05cb773-6c0c-4617-8ae4-987d91d96c3b tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa184615-216e-47ed-b3e9-1001515fce32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e05cb773-6c0c-4617-8ae4-987d91d96c3b tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa184615-216e-47ed-b3e9-1001515fce32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e05cb773-6c0c-4617-8ae4-987d91d96c3b tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43bc1d87-e0d1-4169-9f46-ce778145b67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e05cb773-6c0c-4617-8ae4-987d91d96c3b tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43bc1d87-e0d1-4169-9f46-ce778145b67e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ba22102-2b82-4abf-bd46-a8dc2b33c6ef', 'volume_name': 'volume-3ba22102-2b82-4abf-bd46-a8dc2b33c6ef', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e05cb773-6c0c-4617-8ae4-987d91d96c3b tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0c05fb0-12c6-4052-9021-d8a381c2a99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e05cb773-6c0c-4617-8ae4-987d91d96c3b tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0c05fb0-12c6-4052-9021-d8a381c2a99b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:50:59 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e05cb773-6c0c-4617-8ae4-987d91d96c3b tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a9ea1bb-bf12-459c-b48e-0c984ba7e736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:50:59 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-e05cb773-6c0c-4617-8ae4-987d91d96c3b tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Volume 3ba22102-2b82-4abf-bd46-a8dc2b33c6ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ba22102-2b82-4abf-bd46-a8dc2b33c6ef', 'volume_size': 1} Nov 03 07:50:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e05cb773-6c0c-4617-8ae4-987d91d96c3b tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:50:59 devstack sudo[106900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d37c5172-5d55-4349-9ff0-ee981609729c Nov 03 07:50:59 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:50:59 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root Nov 03 07:50:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-cdda0f63-8c09-4934-aee8-3f6011eadaa8 tempest-ProjectReaderTests-1379712565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d37c5172-5d55-4349-9ff0-ee981609729c" returned: 0 in 0.404s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:50:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-cdda0f63-8c09-4934-aee8-3f6011eadaa8 tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d37c5172-5d55-4349-9ff0-ee981609729c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d37c5172-5d55-4349-9ff0-ee981609729c.035e505a-0a71-4750-bff2-914d261938b1 1G {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:50:59 devstack sudo[106905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d37c5172-5d55-4349-9ff0-ee981609729c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d37c5172-5d55-4349-9ff0-ee981609729c.035e505a-0a71-4750-bff2-914d261938b1 1G Nov 03 07:50:59 devstack sudo[106905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:00 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-7e67b67a-93be-46ef-954a-f80c0e84434d tempest-CinderUnicodeTest-1600781424 None] Acquiring lock "cinder-ad4d57a9-1f2f-445f-80a5-28f6725c1dbc-delete_snapshot" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:00 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-7e67b67a-93be-46ef-954a-f80c0e84434d tempest-CinderUnicodeTest-1600781424 None] Lock "cinder-ad4d57a9-1f2f-445f-80a5-28f6725c1dbc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:00 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-7e67b67a-93be-46ef-954a-f80c0e84434d tempest-CinderUnicodeTest-1600781424 None] Acquiring lock "cinder-quobyte-66ff5bd3-a928-41e7-9bd2-27449a34be82" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:00 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-7e67b67a-93be-46ef-954a-f80c0e84434d tempest-CinderUnicodeTest-1600781424 None] Lock "cinder-quobyte-66ff5bd3-a928-41e7-9bd2-27449a34be82" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:00 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-7e67b67a-93be-46ef-954a-f80c0e84434d tempest-CinderUnicodeTest-1600781424 None] Acquiring lock "cinder-quobyte-ad4d57a9-1f2f-445f-80a5-28f6725c1dbc" by "_delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:00 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-7e67b67a-93be-46ef-954a-f80c0e84434d tempest-CinderUnicodeTest-1600781424 None] Lock "cinder-quobyte-ad4d57a9-1f2f-445f-80a5-28f6725c1dbc" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:00 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-7e67b67a-93be-46ef-954a-f80c0e84434d tempest-CinderUnicodeTest-1600781424 None] Deleting offline snapshot ad4d57a9-1f2f-445f-80a5-28f6725c1dbc of volume 66ff5bd3-a928-41e7-9bd2-27449a34be82 {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:51:00 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-7e67b67a-93be-46ef-954a-f80c0e84434d tempest-CinderUnicodeTest-1600781424 None] snapshot_file for this snap is: volume-66ff5bd3-a928-41e7-9bd2-27449a34be82.ad4d57a9-1f2f-445f-80a5-28f6725c1dbc {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:51:00 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ac3db9-8b59-4cf9-b53a-6582a73878e9]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7e67b67a-93be-46ef-954a-f80c0e84434d tempest-CinderUnicodeTest-1600781424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-66ff5bd3-a928-41e7-9bd2-27449a34be82.ad4d57a9-1f2f-445f-80a5-28f6725c1dbc {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:00 devstack sudo[106905]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-cdda0f63-8c09-4934-aee8-3f6011eadaa8 tempest-ProjectReaderTests-1379712565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d37c5172-5d55-4349-9ff0-ee981609729c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d37c5172-5d55-4349-9ff0-ee981609729c.035e505a-0a71-4750-bff2-914d261938b1 1G" returned: 0 in 0.558s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-cdda0f63-8c09-4934-aee8-3f6011eadaa8 tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d37c5172-5d55-4349-9ff0-ee981609729c -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d37c5172-5d55-4349-9ff0-ee981609729c.035e505a-0a71-4750-bff2-914d261938b1 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:00 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d37c5172-5d55-4349-9ff0-ee981609729c -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d37c5172-5d55-4349-9ff0-ee981609729c.035e505a-0a71-4750-bff2-914d261938b1 Nov 03 07:51:00 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:00 devstack sudo[106910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-66ff5bd3-a928-41e7-9bd2-27449a34be82.ad4d57a9-1f2f-445f-80a5-28f6725c1dbc Nov 03 07:51:00 devstack sudo[106910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:00 devstack sudo[106910]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7e67b67a-93be-46ef-954a-f80c0e84434d tempest-CinderUnicodeTest-1600781424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-66ff5bd3-a928-41e7-9bd2-27449a34be82.ad4d57a9-1f2f-445f-80a5-28f6725c1dbc" returned: 0 in 0.490s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:00 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-7e67b67a-93be-46ef-954a-f80c0e84434d tempest-CinderUnicodeTest-1600781424 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66ff5bd3-a928-41e7-9bd2-27449a34be82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:51:00 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[b940cbee-9080-42c3-93ac-400bf4b151e1]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7e67b67a-93be-46ef-954a-f80c0e84434d tempest-CinderUnicodeTest-1600781424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-66ff5bd3-a928-41e7-9bd2-27449a34be82 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:00 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-cdda0f63-8c09-4934-aee8-3f6011eadaa8 tempest-ProjectReaderTests-1379712565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d37c5172-5d55-4349-9ff0-ee981609729c -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d37c5172-5d55-4349-9ff0-ee981609729c.035e505a-0a71-4750-bff2-914d261938b1" returned: 0 in 0.460s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:00 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-cdda0f63-8c09-4934-aee8-3f6011eadaa8 tempest-ProjectReaderTests-1379712565 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d37c5172-5d55-4349-9ff0-ee981609729c.035e505a-0a71-4750-bff2-914d261938b1 is being set with open permissions: ugo+rw Nov 03 07:51:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-cdda0f63-8c09-4934-aee8-3f6011eadaa8 tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d37c5172-5d55-4349-9ff0-ee981609729c.035e505a-0a71-4750-bff2-914d261938b1 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:00 devstack sudo[106924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d37c5172-5d55-4349-9ff0-ee981609729c.035e505a-0a71-4750-bff2-914d261938b1 Nov 03 07:51:00 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:00 devstack sudo[106923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-66ff5bd3-a928-41e7-9bd2-27449a34be82 Nov 03 07:51:00 devstack sudo[106923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:01 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-cdda0f63-8c09-4934-aee8-3f6011eadaa8 tempest-ProjectReaderTests-1379712565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d37c5172-5d55-4349-9ff0-ee981609729c.035e505a-0a71-4750-bff2-914d261938b1" returned: 0 in 0.346s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-cdda0f63-8c09-4934-aee8-3f6011eadaa8 tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d37c5172-5d55-4349-9ff0-ee981609729c.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:01 devstack sudo[106931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d37c5172-5d55-4349-9ff0-ee981609729c.info Nov 03 07:51:01 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:01 devstack sudo[106923]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7e67b67a-93be-46ef-954a-f80c0e84434d tempest-CinderUnicodeTest-1600781424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-66ff5bd3-a928-41e7-9bd2-27449a34be82" returned: 0 in 0.449s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7e67b67a-93be-46ef-954a-f80c0e84434d tempest-CinderUnicodeTest-1600781424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-66ff5bd3-a928-41e7-9bd2-27449a34be82.ad4d57a9-1f2f-445f-80a5-28f6725c1dbc {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:01 devstack sudo[106933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-66ff5bd3-a928-41e7-9bd2-27449a34be82.ad4d57a9-1f2f-445f-80a5-28f6725c1dbc Nov 03 07:51:01 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:01 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-cdda0f63-8c09-4934-aee8-3f6011eadaa8 tempest-ProjectReaderTests-1379712565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d37c5172-5d55-4349-9ff0-ee981609729c.info" returned: 0 in 0.322s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:01 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-cdda0f63-8c09-4934-aee8-3f6011eadaa8 tempest-ProjectReaderTests-1379712565 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d37c5172-5d55-4349-9ff0-ee981609729c.info is being set with open permissions: ugo+rw Nov 03 07:51:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-cdda0f63-8c09-4934-aee8-3f6011eadaa8 tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d37c5172-5d55-4349-9ff0-ee981609729c.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:01 devstack sudo[106938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d37c5172-5d55-4349-9ff0-ee981609729c.info Nov 03 07:51:01 devstack sudo[106938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:01 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7e67b67a-93be-46ef-954a-f80c0e84434d tempest-CinderUnicodeTest-1600781424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-66ff5bd3-a928-41e7-9bd2-27449a34be82.ad4d57a9-1f2f-445f-80a5-28f6725c1dbc" returned: 0 in 0.403s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7e67b67a-93be-46ef-954a-f80c0e84434d tempest-CinderUnicodeTest-1600781424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-66ff5bd3-a928-41e7-9bd2-27449a34be82.ad4d57a9-1f2f-445f-80a5-28f6725c1dbc {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:01 devstack sudo[106942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-66ff5bd3-a928-41e7-9bd2-27449a34be82.ad4d57a9-1f2f-445f-80a5-28f6725c1dbc Nov 03 07:51:01 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:01 devstack sudo[106938]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-cdda0f63-8c09-4934-aee8-3f6011eadaa8 tempest-ProjectReaderTests-1379712565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d37c5172-5d55-4349-9ff0-ee981609729c.info" returned: 0 in 0.269s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-cdda0f63-8c09-4934-aee8-3f6011eadaa8 tempest-ProjectReaderTests-1379712565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.513s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-38012988-c6ce-434d-ada1-58361ee0c464 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.167s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:01 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-38012988-c6ce-434d-ada1-58361ee0c464 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2085745213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f9f47d2-80df-43a3-ad4d-efcdb526ff26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7380acb0cb634e8ea83bc86e6f4859c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:57Z,use_quota=True,user_id='c2a82384ce6c4791a6a63d8a90f486d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:51:01 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-38012988-c6ce-434d-ada1-58361ee0c464 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Creating volume 6f9f47d2-80df-43a3-ad4d-efcdb526ff26 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:51:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-38012988-c6ce-434d-ada1-58361ee0c464 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-38012988-c6ce-434d-ada1-58361ee0c464 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:01 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-38012988-c6ce-434d-ada1-58361ee0c464 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:01 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-38012988-c6ce-434d-ada1-58361ee0c464 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-38012988-c6ce-434d-ada1-58361ee0c464 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:01 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-38012988-c6ce-434d-ada1-58361ee0c464 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:51:01 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-38012988-c6ce-434d-ada1-58361ee0c464 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:51:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-38012988-c6ce-434d-ada1-58361ee0c464 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6f9f47d2-80df-43a3-ad4d-efcdb526ff26 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:01 devstack sudo[106945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6f9f47d2-80df-43a3-ad4d-efcdb526ff26 1073741824 Nov 03 07:51:01 devstack sudo[106945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:01 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-cdda0f63-8c09-4934-aee8-3f6011eadaa8 tempest-ProjectReaderTests-1379712565 None] Create snapshot completed successfully Nov 03 07:51:01 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7e67b67a-93be-46ef-954a-f80c0e84434d tempest-CinderUnicodeTest-1600781424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-66ff5bd3-a928-41e7-9bd2-27449a34be82.ad4d57a9-1f2f-445f-80a5-28f6725c1dbc" returned: 0 in 0.346s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:01 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-7e67b67a-93be-46ef-954a-f80c0e84434d tempest-CinderUnicodeTest-1600781424 None] Lock "cinder-quobyte-ad4d57a9-1f2f-445f-80a5-28f6725c1dbc" released by "_delete_snapshot" :: held 1.866s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:01 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-7e67b67a-93be-46ef-954a-f80c0e84434d tempest-CinderUnicodeTest-1600781424 None] Lock "cinder-quobyte-66ff5bd3-a928-41e7-9bd2-27449a34be82" released by "delete_snapshot" :: held 1.894s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:02 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-7e67b67a-93be-46ef-954a-f80c0e84434d tempest-CinderUnicodeTest-1600781424 None] Created reservations ['d22c3e69-a538-4ec7-8fef-61219d75b078', '705e8134-7b80-455d-b7de-e611c980fea8', '4392d725-5f2b-464c-a2d7-ff57aec1f20e', 'a274744d-8471-4a15-ae37-569b321dad8d'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:51:02 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-7e67b67a-93be-46ef-954a-f80c0e84434d tempest-CinderUnicodeTest-1600781424 None] Delete snapshot completed successfully. Nov 03 07:51:02 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-7e67b67a-93be-46ef-954a-f80c0e84434d tempest-CinderUnicodeTest-1600781424 None] Lock "cinder-ad4d57a9-1f2f-445f-80a5-28f6725c1dbc-delete_snapshot" released by "delete_snapshot" :: held 2.058s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:02 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d686dbcc-8d23-499f-b59c-f6b2d2522e87 tempest-CinderUnicodeTest-1600781424 None] Acquiring lock "cinder-66ff5bd3-a928-41e7-9bd2-27449a34be82-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:02 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d686dbcc-8d23-499f-b59c-f6b2d2522e87 tempest-CinderUnicodeTest-1600781424 None] Lock "cinder-66ff5bd3-a928-41e7-9bd2-27449a34be82-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:02 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d686dbcc-8d23-499f-b59c-f6b2d2522e87 tempest-CinderUnicodeTest-1600781424 None] Acquiring lock "cinder-quobyte-66ff5bd3-a928-41e7-9bd2-27449a34be82" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:02 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d686dbcc-8d23-499f-b59c-f6b2d2522e87 tempest-CinderUnicodeTest-1600781424 None] Lock "cinder-quobyte-66ff5bd3-a928-41e7-9bd2-27449a34be82" acquired by "delete_volume" :: waited 0.017s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:02 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa77a8a-1798-4fda-a7cc-79fe91cb9ceb]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d686dbcc-8d23-499f-b59c-f6b2d2522e87 tempest-CinderUnicodeTest-1600781424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-66ff5bd3-a928-41e7-9bd2-27449a34be82 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:02 devstack sudo[106945]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-38012988-c6ce-434d-ada1-58361ee0c464 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6f9f47d2-80df-43a3-ad4d-efcdb526ff26 1073741824" returned: 0 in 0.656s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-38012988-c6ce-434d-ada1-58361ee0c464 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6f9f47d2-80df-43a3-ad4d-efcdb526ff26 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:02 devstack sudo[106953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6f9f47d2-80df-43a3-ad4d-efcdb526ff26 Nov 03 07:51:02 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:02 devstack sudo[106952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-66ff5bd3-a928-41e7-9bd2-27449a34be82 Nov 03 07:51:02 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:02 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a74ab75f-d42a-447a-a80c-8e582bd4c043 tempest-ProjectReaderTests-1379712565 None] Acquiring lock "cinder-035e505a-0a71-4750-bff2-914d261938b1-delete_snapshot" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:02 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a74ab75f-d42a-447a-a80c-8e582bd4c043 tempest-ProjectReaderTests-1379712565 None] Lock "cinder-035e505a-0a71-4750-bff2-914d261938b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:02 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a74ab75f-d42a-447a-a80c-8e582bd4c043 tempest-ProjectReaderTests-1379712565 None] Acquiring lock "cinder-quobyte-d37c5172-5d55-4349-9ff0-ee981609729c" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:02 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a74ab75f-d42a-447a-a80c-8e582bd4c043 tempest-ProjectReaderTests-1379712565 None] Lock "cinder-quobyte-d37c5172-5d55-4349-9ff0-ee981609729c" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:02 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a74ab75f-d42a-447a-a80c-8e582bd4c043 tempest-ProjectReaderTests-1379712565 None] Acquiring lock "cinder-quobyte-035e505a-0a71-4750-bff2-914d261938b1" by "_delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:02 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a74ab75f-d42a-447a-a80c-8e582bd4c043 tempest-ProjectReaderTests-1379712565 None] Lock "cinder-quobyte-035e505a-0a71-4750-bff2-914d261938b1" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:02 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-a74ab75f-d42a-447a-a80c-8e582bd4c043 tempest-ProjectReaderTests-1379712565 None] Deleting offline snapshot 035e505a-0a71-4750-bff2-914d261938b1 of volume d37c5172-5d55-4349-9ff0-ee981609729c {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:51:02 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-a74ab75f-d42a-447a-a80c-8e582bd4c043 tempest-ProjectReaderTests-1379712565 None] snapshot_file for this snap is: volume-d37c5172-5d55-4349-9ff0-ee981609729c.035e505a-0a71-4750-bff2-914d261938b1 {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:51:02 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a33596e-a501-4fbc-8736-a51a8b32f48e]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a74ab75f-d42a-447a-a80c-8e582bd4c043 tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d37c5172-5d55-4349-9ff0-ee981609729c.035e505a-0a71-4750-bff2-914d261938b1 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:02 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-38012988-c6ce-434d-ada1-58361ee0c464 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6f9f47d2-80df-43a3-ad4d-efcdb526ff26" returned: 0 in 0.362s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:02 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-38012988-c6ce-434d-ada1-58361ee0c464 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:51:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-38012988-c6ce-434d-ada1-58361ee0c464 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-88d82783-48e2-4821-958a-b8901ea8ad82 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.768s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:02 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-88d82783-48e2-4821-958a-b8901ea8ad82 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-557284080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa1f0fba-1ed2-4215-92c1-88433bafed4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7380acb0cb634e8ea83bc86e6f4859c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:58Z,use_quota=True,user_id='c2a82384ce6c4791a6a63d8a90f486d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:51:02 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-88d82783-48e2-4821-958a-b8901ea8ad82 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Creating volume fa1f0fba-1ed2-4215-92c1-88433bafed4d {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:51:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-88d82783-48e2-4821-958a-b8901ea8ad82 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-88d82783-48e2-4821-958a-b8901ea8ad82 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:02 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-88d82783-48e2-4821-958a-b8901ea8ad82 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:02 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-88d82783-48e2-4821-958a-b8901ea8ad82 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-88d82783-48e2-4821-958a-b8901ea8ad82 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:02 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-88d82783-48e2-4821-958a-b8901ea8ad82 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:51:02 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-88d82783-48e2-4821-958a-b8901ea8ad82 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:51:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-88d82783-48e2-4821-958a-b8901ea8ad82 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-fa1f0fba-1ed2-4215-92c1-88433bafed4d 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:02 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:02 devstack sudo[106957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d37c5172-5d55-4349-9ff0-ee981609729c.035e505a-0a71-4750-bff2-914d261938b1 Nov 03 07:51:02 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:02 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-38012988-c6ce-434d-ada1-58361ee0c464 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1a0b614-0689-46e3-9a65-1b0ca2b0dd7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f9f47d2-80df-43a3-ad4d-efcdb526ff26', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:02 devstack sudo[106962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-fa1f0fba-1ed2-4215-92c1-88433bafed4d 1073741824 Nov 03 07:51:02 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-38012988-c6ce-434d-ada1-58361ee0c464 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c6aef0d-50a4-4c09-985a-81236bbc4df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:02 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d686dbcc-8d23-499f-b59c-f6b2d2522e87 tempest-CinderUnicodeTest-1600781424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-66ff5bd3-a928-41e7-9bd2-27449a34be82" returned: 0 in 0.522s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d686dbcc-8d23-499f-b59c-f6b2d2522e87 tempest-CinderUnicodeTest-1600781424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-66ff5bd3-a928-41e7-9bd2-27449a34be82 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:02 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-38012988-c6ce-434d-ada1-58361ee0c464 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Volume volume-6f9f47d2-80df-43a3-ad4d-efcdb526ff26 (6f9f47d2-80df-43a3-ad4d-efcdb526ff26): created successfully Nov 03 07:51:02 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-38012988-c6ce-434d-ada1-58361ee0c464 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c6aef0d-50a4-4c09-985a-81236bbc4df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:02 devstack sudo[106965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-66ff5bd3-a928-41e7-9bd2-27449a34be82 Nov 03 07:51:02 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:02 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-38012988-c6ce-434d-ada1-58361ee0c464 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Flow 'volume_create_manager' (2aa7c750-1ed9-4eb2-bcd0-5b8a04be2e78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:03 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-38012988-c6ce-434d-ada1-58361ee0c464 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Created volume successfully. Nov 03 07:51:03 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a74ab75f-d42a-447a-a80c-8e582bd4c043 tempest-ProjectReaderTests-1379712565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d37c5172-5d55-4349-9ff0-ee981609729c.035e505a-0a71-4750-bff2-914d261938b1" returned: 0 in 0.579s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-a74ab75f-d42a-447a-a80c-8e582bd4c043 tempest-ProjectReaderTests-1379712565 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d37c5172-5d55-4349-9ff0-ee981609729c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:51:03 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d686dbcc-8d23-499f-b59c-f6b2d2522e87 tempest-CinderUnicodeTest-1600781424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-66ff5bd3-a928-41e7-9bd2-27449a34be82" returned: 0 in 0.422s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:03 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5762b1-7da1-408c-a4ef-8383c1c274c7]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a74ab75f-d42a-447a-a80c-8e582bd4c043 tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d37c5172-5d55-4349-9ff0-ee981609729c {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:03 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d686dbcc-8d23-499f-b59c-f6b2d2522e87 tempest-CinderUnicodeTest-1600781424 None] Lock "cinder-quobyte-66ff5bd3-a928-41e7-9bd2-27449a34be82" released by "delete_volume" :: held 1.066s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:03 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:SELECT=222,cinder:INSERT=78,cinder:UPDATE=243,cinder:DELETE=26 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:51:03 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-d686dbcc-8d23-499f-b59c-f6b2d2522e87 tempest-CinderUnicodeTest-1600781424 None] Created reservations ['16c73ca6-d0b6-4a61-bf7f-6c79b20d3b7b', '93ebb6ac-ae0b-41cc-859b-f529cfd20766', '228554ea-072e-4239-b513-81334c8c13e5', '915d191f-4a64-4ca3-80bb-8bfb24c50e58'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:51:03 devstack sudo[106976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d37c5172-5d55-4349-9ff0-ee981609729c Nov 03 07:51:03 devstack sudo[106976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:03 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-88d82783-48e2-4821-958a-b8901ea8ad82 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-fa1f0fba-1ed2-4215-92c1-88433bafed4d 1073741824" returned: 0 in 0.685s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:03 devstack cinder-volume[86875]: DEBUG oslo_service.periodic_task [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86875) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:51:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-88d82783-48e2-4821-958a-b8901ea8ad82 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-fa1f0fba-1ed2-4215-92c1-88433bafed4d {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:03 devstack sudo[106978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:51:03 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-d686dbcc-8d23-499f-b59c-f6b2d2522e87 tempest-CinderUnicodeTest-1600781424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-d686dbcc-8d23-499f-b59c-f6b2d2522e87 tempest-CinderUnicodeTest-1600781424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-d686dbcc-8d23-499f-b59c-f6b2d2522e87 tempest-CinderUnicodeTest-1600781424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-d686dbcc-8d23-499f-b59c-f6b2d2522e87 tempest-CinderUnicodeTest-1600781424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-d686dbcc-8d23-499f-b59c-f6b2d2522e87 tempest-CinderUnicodeTest-1600781424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:03 devstack sudo[106979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-fa1f0fba-1ed2-4215-92c1-88433bafed4d Nov 03 07:51:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d686dbcc-8d23-499f-b59c-f6b2d2522e87 tempest-CinderUnicodeTest-1600781424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:03 devstack sudo[106979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:03 devstack sudo[106982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:51:03 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:03 devstack sudo[106976]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a74ab75f-d42a-447a-a80c-8e582bd4c043 tempest-ProjectReaderTests-1379712565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d37c5172-5d55-4349-9ff0-ee981609729c" returned: 0 in 0.514s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a74ab75f-d42a-447a-a80c-8e582bd4c043 tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d37c5172-5d55-4349-9ff0-ee981609729c.035e505a-0a71-4750-bff2-914d261938b1 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:03 devstack sudo[106987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d37c5172-5d55-4349-9ff0-ee981609729c.035e505a-0a71-4750-bff2-914d261938b1 Nov 03 07:51:03 devstack sudo[106987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:03 devstack sudo[106979]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-88d82783-48e2-4821-958a-b8901ea8ad82 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-fa1f0fba-1ed2-4215-92c1-88433bafed4d" returned: 0 in 0.349s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-88d82783-48e2-4821-958a-b8901ea8ad82 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:51:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-88d82783-48e2-4821-958a-b8901ea8ad82 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-ed0f177a-03ba-4bd1-b1bc-65b55770694d tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.475s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:04 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-ed0f177a-03ba-4bd1-b1bc-65b55770694d tempest-CreateVolumesFromSourceVolumeTest-483930564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1694617107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e599b49a-e25e-49df-9b7a-b05f339a2631,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7380acb0cb634e8ea83bc86e6f4859c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:58Z,use_quota=True,user_id='c2a82384ce6c4791a6a63d8a90f486d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:51:04 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-ed0f177a-03ba-4bd1-b1bc-65b55770694d tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Creating volume e599b49a-e25e-49df-9b7a-b05f339a2631 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:51:04 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-ed0f177a-03ba-4bd1-b1bc-65b55770694d tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-ed0f177a-03ba-4bd1-b1bc-65b55770694d tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:04 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-ed0f177a-03ba-4bd1-b1bc-65b55770694d tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:04 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:04 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-ed0f177a-03ba-4bd1-b1bc-65b55770694d tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-ed0f177a-03ba-4bd1-b1bc-65b55770694d tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:04 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-ed0f177a-03ba-4bd1-b1bc-65b55770694d tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:51:04 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-ed0f177a-03ba-4bd1-b1bc-65b55770694d tempest-CreateVolumesFromSourceVolumeTest-483930564 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:51:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ed0f177a-03ba-4bd1-b1bc-65b55770694d tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e599b49a-e25e-49df-9b7a-b05f339a2631 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d686dbcc-8d23-499f-b59c-f6b2d2522e87 tempest-CinderUnicodeTest-1600781424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.336s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.413s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:04 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-d686dbcc-8d23-499f-b59c-f6b2d2522e87 tempest-CinderUnicodeTest-1600781424 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:51:04 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:51:04 devstack sudo[106992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e599b49a-e25e-49df-9b7a-b05f339a2631 1073741824 Nov 03 07:51:04 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-d686dbcc-8d23-499f-b59c-f6b2d2522e87 tempest-CinderUnicodeTest-1600781424 None] Deleted volume successfully. Nov 03 07:51:04 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:04 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-88d82783-48e2-4821-958a-b8901ea8ad82 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c83d645f-ed9f-4c35-bb02-1b0678c3780f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa1f0fba-1ed2-4215-92c1-88433bafed4d', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:04 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-88d82783-48e2-4821-958a-b8901ea8ad82 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14cc9b5c-08b2-4bed-bc43-c93ab7a3c60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:04 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:UPDATE=307,cinder:SELECT=196,cinder:DELETE=24,cinder:INSERT=71 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:51:04 devstack cinder-volume[86875]: DEBUG oslo_service.periodic_task [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running periodic task VolumeManager._thread_info {{(pid=86875) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:51:04 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] thread count: 29 {{(pid=86875) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:51:04 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] thread info: [<_MainThread(MainThread, started 125626325639296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86875) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:51:04 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-88d82783-48e2-4821-958a-b8901ea8ad82 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Volume volume-fa1f0fba-1ed2-4215-92c1-88433bafed4d (fa1f0fba-1ed2-4215-92c1-88433bafed4d): created successfully Nov 03 07:51:04 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-88d82783-48e2-4821-958a-b8901ea8ad82 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14cc9b5c-08b2-4bed-bc43-c93ab7a3c60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:04 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-88d82783-48e2-4821-958a-b8901ea8ad82 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Flow 'volume_create_manager' (f8170a2c-05f7-4b47-b82c-024ea5460c99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:04 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d686dbcc-8d23-499f-b59c-f6b2d2522e87 tempest-CinderUnicodeTest-1600781424 None] Lock "cinder-66ff5bd3-a928-41e7-9bd2-27449a34be82-delete_volume" released by "delete_volume" :: held 1.851s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:04 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-88d82783-48e2-4821-958a-b8901ea8ad82 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Created volume successfully. Nov 03 07:51:04 devstack sudo[106987]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a74ab75f-d42a-447a-a80c-8e582bd4c043 tempest-ProjectReaderTests-1379712565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d37c5172-5d55-4349-9ff0-ee981609729c.035e505a-0a71-4750-bff2-914d261938b1" returned: 0 in 0.502s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a74ab75f-d42a-447a-a80c-8e582bd4c043 tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d37c5172-5d55-4349-9ff0-ee981609729c.035e505a-0a71-4750-bff2-914d261938b1 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:04 devstack sudo[107000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d37c5172-5d55-4349-9ff0-ee981609729c.035e505a-0a71-4750-bff2-914d261938b1 Nov 03 07:51:04 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:04 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-9f42e61c-c63b-4566-855a-9f10804ab22b tempest-CinderUnicodeTest-1600781424 None] Acquiring lock "cinder-26136263-e48d-4458-9674-412b48d04c70-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:04 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-9f42e61c-c63b-4566-855a-9f10804ab22b tempest-CinderUnicodeTest-1600781424 None] Lock "cinder-26136263-e48d-4458-9674-412b48d04c70-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:04 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ed0f177a-03ba-4bd1-b1bc-65b55770694d tempest-CreateVolumesFromSourceVolumeTest-483930564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e599b49a-e25e-49df-9b7a-b05f339a2631 1073741824" returned: 0 in 0.561s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:04 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-9f42e61c-c63b-4566-855a-9f10804ab22b tempest-CinderUnicodeTest-1600781424 None] Acquiring lock "cinder-quobyte-26136263-e48d-4458-9674-412b48d04c70" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ed0f177a-03ba-4bd1-b1bc-65b55770694d tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e599b49a-e25e-49df-9b7a-b05f339a2631 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:04 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-9f42e61c-c63b-4566-855a-9f10804ab22b tempest-CinderUnicodeTest-1600781424 None] Lock "cinder-quobyte-26136263-e48d-4458-9674-412b48d04c70" acquired by "delete_volume" :: waited 0.045s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:04 devstack sudo[107002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e599b49a-e25e-49df-9b7a-b05f339a2631 Nov 03 07:51:04 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:04 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[18fc70a2-39bc-4d91-91db-c01c2f25c81c]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9f42e61c-c63b-4566-855a-9f10804ab22b tempest-CinderUnicodeTest-1600781424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-26136263-e48d-4458-9674-412b48d04c70 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:04 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a74ab75f-d42a-447a-a80c-8e582bd4c043 tempest-ProjectReaderTests-1379712565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d37c5172-5d55-4349-9ff0-ee981609729c.035e505a-0a71-4750-bff2-914d261938b1" returned: 0 in 0.413s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:04 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a74ab75f-d42a-447a-a80c-8e582bd4c043 tempest-ProjectReaderTests-1379712565 None] Lock "cinder-quobyte-035e505a-0a71-4750-bff2-914d261938b1" released by "_delete_snapshot" :: held 2.173s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:04 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a74ab75f-d42a-447a-a80c-8e582bd4c043 tempest-ProjectReaderTests-1379712565 None] Lock "cinder-quobyte-d37c5172-5d55-4349-9ff0-ee981609729c" released by "delete_snapshot" :: held 2.199s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:04 devstack sudo[107005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-26136263-e48d-4458-9674-412b48d04c70 Nov 03 07:51:04 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:04 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:04 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-a74ab75f-d42a-447a-a80c-8e582bd4c043 tempest-ProjectReaderTests-1379712565 None] Created reservations ['4df1157d-9dad-4cf5-ab72-5c4920ef309d', 'ab14ed70-906e-4d08-ad32-f0750c7ab35e', '53d80c69-89e3-41ac-b6e4-9d2c1f5d48a8', 'ab9db442-067e-4f90-895f-f5a2f9e089b6'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:51:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ed0f177a-03ba-4bd1-b1bc-65b55770694d tempest-CreateVolumesFromSourceVolumeTest-483930564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e599b49a-e25e-49df-9b7a-b05f339a2631" returned: 0 in 0.309s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:04 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-ed0f177a-03ba-4bd1-b1bc-65b55770694d tempest-CreateVolumesFromSourceVolumeTest-483930564 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:51:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-ed0f177a-03ba-4bd1-b1bc-65b55770694d tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7a457919-0eea-4277-9693-d2f704098caa tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.955s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:04 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-7a457919-0eea-4277-9693-d2f704098caa tempest-CreateVolumesFromSourceVolumeTest-483930564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1453034587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e73233b7-f226-469d-85d5-7e25084e5784,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7380acb0cb634e8ea83bc86e6f4859c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:59Z,use_quota=True,user_id='c2a82384ce6c4791a6a63d8a90f486d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:51:04 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-7a457919-0eea-4277-9693-d2f704098caa tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Creating volume e73233b7-f226-469d-85d5-7e25084e5784 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:51:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7a457919-0eea-4277-9693-d2f704098caa tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7a457919-0eea-4277-9693-d2f704098caa tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:04 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-7a457919-0eea-4277-9693-d2f704098caa tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:04 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-7a457919-0eea-4277-9693-d2f704098caa tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7a457919-0eea-4277-9693-d2f704098caa tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:04 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-7a457919-0eea-4277-9693-d2f704098caa tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:51:04 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-7a457919-0eea-4277-9693-d2f704098caa tempest-CreateVolumesFromSourceVolumeTest-483930564 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:51:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7a457919-0eea-4277-9693-d2f704098caa tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e73233b7-f226-469d-85d5-7e25084e5784 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:04 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ed0f177a-03ba-4bd1-b1bc-65b55770694d tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49b8c3dc-c8f9-495b-b934-19d24cbab5d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e599b49a-e25e-49df-9b7a-b05f339a2631', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:04 devstack sudo[107008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e73233b7-f226-469d-85d5-7e25084e5784 1073741824 Nov 03 07:51:04 devstack sudo[107008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:04 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ed0f177a-03ba-4bd1-b1bc-65b55770694d tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f52fc32-ad8b-4fad-a09c-9c858f5e9a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:05 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-ed0f177a-03ba-4bd1-b1bc-65b55770694d tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Volume volume-e599b49a-e25e-49df-9b7a-b05f339a2631 (e599b49a-e25e-49df-9b7a-b05f339a2631): created successfully Nov 03 07:51:05 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ed0f177a-03ba-4bd1-b1bc-65b55770694d tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f52fc32-ad8b-4fad-a09c-9c858f5e9a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:05 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-ed0f177a-03ba-4bd1-b1bc-65b55770694d tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Flow 'volume_create_manager' (7604840f-48ce-47d8-a377-5154d9168fb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:05 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-ed0f177a-03ba-4bd1-b1bc-65b55770694d tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Created volume successfully. Nov 03 07:51:05 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-a74ab75f-d42a-447a-a80c-8e582bd4c043 tempest-ProjectReaderTests-1379712565 None] Delete snapshot completed successfully. Nov 03 07:51:05 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a74ab75f-d42a-447a-a80c-8e582bd4c043 tempest-ProjectReaderTests-1379712565 None] Lock "cinder-035e505a-0a71-4750-bff2-914d261938b1-delete_snapshot" released by "delete_snapshot" :: held 2.432s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:05 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9f42e61c-c63b-4566-855a-9f10804ab22b tempest-CinderUnicodeTest-1600781424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-26136263-e48d-4458-9674-412b48d04c70" returned: 0 in 0.473s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9f42e61c-c63b-4566-855a-9f10804ab22b tempest-CinderUnicodeTest-1600781424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-26136263-e48d-4458-9674-412b48d04c70 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:05 devstack sudo[107014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-26136263-e48d-4458-9674-412b48d04c70 Nov 03 07:51:05 devstack sudo[107014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:05 devstack sudo[107008]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7a457919-0eea-4277-9693-d2f704098caa tempest-CreateVolumesFromSourceVolumeTest-483930564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e73233b7-f226-469d-85d5-7e25084e5784 1073741824" returned: 0 in 0.523s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:05 devstack sudo[107014]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9f42e61c-c63b-4566-855a-9f10804ab22b tempest-CinderUnicodeTest-1600781424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-26136263-e48d-4458-9674-412b48d04c70" returned: 0 in 0.280s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:05 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-9f42e61c-c63b-4566-855a-9f10804ab22b tempest-CinderUnicodeTest-1600781424 None] Lock "cinder-quobyte-26136263-e48d-4458-9674-412b48d04c70" released by "delete_volume" :: held 0.841s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7a457919-0eea-4277-9693-d2f704098caa tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e73233b7-f226-469d-85d5-7e25084e5784 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:05 devstack sudo[107020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e73233b7-f226-469d-85d5-7e25084e5784 Nov 03 07:51:05 devstack sudo[107020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:05 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-9f42e61c-c63b-4566-855a-9f10804ab22b tempest-CinderUnicodeTest-1600781424 None] Created reservations ['0509578e-bdc2-45c4-a450-7c6fde461ac6', 'df03dc71-fc46-4944-9986-7a8df0c086d6', '2c97ebef-bab1-4950-a1b7-27d73c33135d', 'dfda40b7-dacb-46b4-80fe-fc7cd5e5ea92'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:51:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-9f42e61c-c63b-4566-855a-9f10804ab22b tempest-CinderUnicodeTest-1600781424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-9f42e61c-c63b-4566-855a-9f10804ab22b tempest-CinderUnicodeTest-1600781424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:05 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-9f42e61c-c63b-4566-855a-9f10804ab22b tempest-CinderUnicodeTest-1600781424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:05 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-9f42e61c-c63b-4566-855a-9f10804ab22b tempest-CinderUnicodeTest-1600781424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-9f42e61c-c63b-4566-855a-9f10804ab22b tempest-CinderUnicodeTest-1600781424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9f42e61c-c63b-4566-855a-9f10804ab22b tempest-CinderUnicodeTest-1600781424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:05 devstack sudo[107022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:51:05 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:05 devstack sudo[107020]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7a457919-0eea-4277-9693-d2f704098caa tempest-CreateVolumesFromSourceVolumeTest-483930564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e73233b7-f226-469d-85d5-7e25084e5784" returned: 0 in 0.371s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:05 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-7a457919-0eea-4277-9693-d2f704098caa tempest-CreateVolumesFromSourceVolumeTest-483930564 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:51:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7a457919-0eea-4277-9693-d2f704098caa tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e05cb773-6c0c-4617-8ae4-987d91d96c3b tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.498s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:05 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-e05cb773-6c0c-4617-8ae4-987d91d96c3b tempest-CreateVolumesFromSourceVolumeTest-483930564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:50:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-387001296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ba22102-2b82-4abf-bd46-a8dc2b33c6ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7380acb0cb634e8ea83bc86e6f4859c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:50:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:50:59Z,use_quota=True,user_id='c2a82384ce6c4791a6a63d8a90f486d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:51:05 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-e05cb773-6c0c-4617-8ae4-987d91d96c3b tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Creating volume 3ba22102-2b82-4abf-bd46-a8dc2b33c6ef {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:51:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e05cb773-6c0c-4617-8ae4-987d91d96c3b tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e05cb773-6c0c-4617-8ae4-987d91d96c3b tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:05 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-e05cb773-6c0c-4617-8ae4-987d91d96c3b tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:05 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-e05cb773-6c0c-4617-8ae4-987d91d96c3b tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e05cb773-6c0c-4617-8ae4-987d91d96c3b tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:05 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-e05cb773-6c0c-4617-8ae4-987d91d96c3b tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:51:05 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-e05cb773-6c0c-4617-8ae4-987d91d96c3b tempest-CreateVolumesFromSourceVolumeTest-483930564 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:51:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e05cb773-6c0c-4617-8ae4-987d91d96c3b tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3ba22102-2b82-4abf-bd46-a8dc2b33c6ef 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:05 devstack sudo[107025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3ba22102-2b82-4abf-bd46-a8dc2b33c6ef 1073741824 Nov 03 07:51:05 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:05 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-54f87b50-99cb-449a-b36e-6aa3d38e3cba tempest-ProjectReaderTests-1379712565 None] Acquiring lock "cinder-d37c5172-5d55-4349-9ff0-ee981609729c-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7a457919-0eea-4277-9693-d2f704098caa tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0ec7772-5107-4923-9924-f0f7f194bca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e73233b7-f226-469d-85d5-7e25084e5784', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7a457919-0eea-4277-9693-d2f704098caa tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f56c70df-f2ea-4113-8a2f-b5d25346ba28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:06 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-54f87b50-99cb-449a-b36e-6aa3d38e3cba tempest-ProjectReaderTests-1379712565 None] Lock "cinder-d37c5172-5d55-4349-9ff0-ee981609729c-delete_volume" acquired by "delete_volume" :: waited 0.115s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:06 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-7a457919-0eea-4277-9693-d2f704098caa tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Volume volume-e73233b7-f226-469d-85d5-7e25084e5784 (e73233b7-f226-469d-85d5-7e25084e5784): created successfully Nov 03 07:51:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7a457919-0eea-4277-9693-d2f704098caa tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f56c70df-f2ea-4113-8a2f-b5d25346ba28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:06 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-7a457919-0eea-4277-9693-d2f704098caa tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Flow 'volume_create_manager' (cca547dc-9733-415f-97bd-3cf376bffb36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:06 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-7a457919-0eea-4277-9693-d2f704098caa tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Created volume successfully. Nov 03 07:51:06 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-54f87b50-99cb-449a-b36e-6aa3d38e3cba tempest-ProjectReaderTests-1379712565 None] Acquiring lock "cinder-quobyte-d37c5172-5d55-4349-9ff0-ee981609729c" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:06 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-54f87b50-99cb-449a-b36e-6aa3d38e3cba tempest-ProjectReaderTests-1379712565 None] Lock "cinder-quobyte-d37c5172-5d55-4349-9ff0-ee981609729c" acquired by "delete_volume" :: waited 0.018s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:06 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-9f42e61c-c63b-4566-855a-9f10804ab22b tempest-CinderUnicodeTest-1600781424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.598s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:06 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-9f42e61c-c63b-4566-855a-9f10804ab22b tempest-CinderUnicodeTest-1600781424 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:51:06 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-9f42e61c-c63b-4566-855a-9f10804ab22b tempest-CinderUnicodeTest-1600781424 None] Deleted volume successfully. Nov 03 07:51:06 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91785fb-f064-4d3d-9a7e-f4d6e880fbe6]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-54f87b50-99cb-449a-b36e-6aa3d38e3cba tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d37c5172-5d55-4349-9ff0-ee981609729c {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:06 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-9f42e61c-c63b-4566-855a-9f10804ab22b tempest-CinderUnicodeTest-1600781424 None] Lock "cinder-26136263-e48d-4458-9674-412b48d04c70-delete_volume" released by "delete_volume" :: held 1.764s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:06 devstack sudo[107028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d37c5172-5d55-4349-9ff0-ee981609729c Nov 03 07:51:06 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:06 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e05cb773-6c0c-4617-8ae4-987d91d96c3b tempest-CreateVolumesFromSourceVolumeTest-483930564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3ba22102-2b82-4abf-bd46-a8dc2b33c6ef 1073741824" returned: 0 in 0.731s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e05cb773-6c0c-4617-8ae4-987d91d96c3b tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3ba22102-2b82-4abf-bd46-a8dc2b33c6ef {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:06 devstack sudo[107038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3ba22102-2b82-4abf-bd46-a8dc2b33c6ef Nov 03 07:51:06 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:06 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-54f87b50-99cb-449a-b36e-6aa3d38e3cba tempest-ProjectReaderTests-1379712565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d37c5172-5d55-4349-9ff0-ee981609729c" returned: 0 in 0.512s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-54f87b50-99cb-449a-b36e-6aa3d38e3cba tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d37c5172-5d55-4349-9ff0-ee981609729c {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:06 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d37c5172-5d55-4349-9ff0-ee981609729c Nov 03 07:51:06 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:07 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e05cb773-6c0c-4617-8ae4-987d91d96c3b tempest-CreateVolumesFromSourceVolumeTest-483930564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3ba22102-2b82-4abf-bd46-a8dc2b33c6ef" returned: 0 in 0.308s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:07 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-e05cb773-6c0c-4617-8ae4-987d91d96c3b tempest-CreateVolumesFromSourceVolumeTest-483930564 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:51:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e05cb773-6c0c-4617-8ae4-987d91d96c3b tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:07 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e05cb773-6c0c-4617-8ae4-987d91d96c3b tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a9ea1bb-bf12-459c-b48e-0c984ba7e736) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ba22102-2b82-4abf-bd46-a8dc2b33c6ef', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:07 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e05cb773-6c0c-4617-8ae4-987d91d96c3b tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5203e93b-05eb-4630-bb30-1cb041055400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:07 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-e05cb773-6c0c-4617-8ae4-987d91d96c3b tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Volume volume-3ba22102-2b82-4abf-bd46-a8dc2b33c6ef (3ba22102-2b82-4abf-bd46-a8dc2b33c6ef): created successfully Nov 03 07:51:07 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e05cb773-6c0c-4617-8ae4-987d91d96c3b tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5203e93b-05eb-4630-bb30-1cb041055400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:07 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e05cb773-6c0c-4617-8ae4-987d91d96c3b tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Flow 'volume_create_manager' (558129f8-2cef-4b66-90da-882517bea80b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:07 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-e05cb773-6c0c-4617-8ae4-987d91d96c3b tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Created volume successfully. Nov 03 07:51:07 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-54f87b50-99cb-449a-b36e-6aa3d38e3cba tempest-ProjectReaderTests-1379712565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d37c5172-5d55-4349-9ff0-ee981609729c" returned: 0 in 0.347s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:07 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-54f87b50-99cb-449a-b36e-6aa3d38e3cba tempest-ProjectReaderTests-1379712565 None] Lock "cinder-quobyte-d37c5172-5d55-4349-9ff0-ee981609729c" released by "delete_volume" :: held 0.978s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:07 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-54f87b50-99cb-449a-b36e-6aa3d38e3cba tempest-ProjectReaderTests-1379712565 None] Created reservations ['9ef6fdb3-b72b-431c-8977-acc967221095', '761107b8-573c-4764-9045-84ae3fb0cc42', '5ec2b91b-7592-4338-a719-b27469454559', '70777037-cd18-4500-9675-fbda62f4d909'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:51:07 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-eb952177-97df-4869-8801-137b4adecdcd tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Acquiring lock "cinder-3ba22102-2b82-4abf-bd46-a8dc2b33c6ef-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:07 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-eb952177-97df-4869-8801-137b4adecdcd tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Lock "cinder-3ba22102-2b82-4abf-bd46-a8dc2b33c6ef-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-54f87b50-99cb-449a-b36e-6aa3d38e3cba tempest-ProjectReaderTests-1379712565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-54f87b50-99cb-449a-b36e-6aa3d38e3cba tempest-ProjectReaderTests-1379712565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:07 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-54f87b50-99cb-449a-b36e-6aa3d38e3cba tempest-ProjectReaderTests-1379712565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:07 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-54f87b50-99cb-449a-b36e-6aa3d38e3cba tempest-ProjectReaderTests-1379712565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-54f87b50-99cb-449a-b36e-6aa3d38e3cba tempest-ProjectReaderTests-1379712565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-54f87b50-99cb-449a-b36e-6aa3d38e3cba tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:07 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-eb952177-97df-4869-8801-137b4adecdcd tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Acquiring lock "cinder-quobyte-3ba22102-2b82-4abf-bd46-a8dc2b33c6ef" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:07 devstack sudo[107044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:51:07 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:07 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-eb952177-97df-4869-8801-137b4adecdcd tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Lock "cinder-quobyte-3ba22102-2b82-4abf-bd46-a8dc2b33c6ef" acquired by "delete_volume" :: waited 0.029s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:07 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1e0886-413b-402e-936f-5affae8cbac8]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-eb952177-97df-4869-8801-137b4adecdcd tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3ba22102-2b82-4abf-bd46-a8dc2b33c6ef {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:07 devstack sudo[107046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3ba22102-2b82-4abf-bd46-a8dc2b33c6ef Nov 03 07:51:07 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:07 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-54f87b50-99cb-449a-b36e-6aa3d38e3cba tempest-ProjectReaderTests-1379712565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.324s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:07 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-54f87b50-99cb-449a-b36e-6aa3d38e3cba tempest-ProjectReaderTests-1379712565 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:51:07 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-54f87b50-99cb-449a-b36e-6aa3d38e3cba tempest-ProjectReaderTests-1379712565 None] Deleted volume successfully. Nov 03 07:51:07 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-54f87b50-99cb-449a-b36e-6aa3d38e3cba tempest-ProjectReaderTests-1379712565 None] Lock "cinder-d37c5172-5d55-4349-9ff0-ee981609729c-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:08 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-eb952177-97df-4869-8801-137b4adecdcd tempest-CreateVolumesFromSourceVolumeTest-483930564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3ba22102-2b82-4abf-bd46-a8dc2b33c6ef" returned: 0 in 0.593s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-eb952177-97df-4869-8801-137b4adecdcd tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3ba22102-2b82-4abf-bd46-a8dc2b33c6ef {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:08 devstack sudo[107054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3ba22102-2b82-4abf-bd46-a8dc2b33c6ef Nov 03 07:51:08 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:08 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-eb952177-97df-4869-8801-137b4adecdcd tempest-CreateVolumesFromSourceVolumeTest-483930564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3ba22102-2b82-4abf-bd46-a8dc2b33c6ef" returned: 0 in 0.449s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:08 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-eb952177-97df-4869-8801-137b4adecdcd tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Lock "cinder-quobyte-3ba22102-2b82-4abf-bd46-a8dc2b33c6ef" released by "delete_volume" :: held 1.103s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:08 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-eb952177-97df-4869-8801-137b4adecdcd tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Created reservations ['aac088bb-1f54-4910-9fb7-92e6ca77ae45', 'b06a00a1-2f95-4a87-bd95-6ec9e7f1356d', '3d92d382-8b48-46db-8b3a-0cd7fb4eabf4', '523d61de-6639-4dab-bf23-f7be4a949eda'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:51:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-eb952177-97df-4869-8801-137b4adecdcd tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-eb952177-97df-4869-8801-137b4adecdcd tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:08 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-eb952177-97df-4869-8801-137b4adecdcd tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:08 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-eb952177-97df-4869-8801-137b4adecdcd tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-eb952177-97df-4869-8801-137b4adecdcd tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-eb952177-97df-4869-8801-137b4adecdcd tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:08 devstack sudo[107057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:51:08 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:09 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-43312c5f-49a7-4f07-b574-470cea5356de tempest-ProjectReaderTests-1379712565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:51:09 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-43312c5f-49a7-4f07-b574-470cea5356de tempest-ProjectReaderTests-1379712565 None] Flow 'volume_create_manager' (cd7098c7-4b90-4af6-ae04-be66ab41be04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:09 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-43312c5f-49a7-4f07-b574-470cea5356de tempest-ProjectReaderTests-1379712565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f98130b-d08c-447d-9865-aeccf18fc468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:09 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-43312c5f-49a7-4f07-b574-470cea5356de tempest-ProjectReaderTests-1379712565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f98130b-d08c-447d-9865-aeccf18fc468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:51:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-574026909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bed39e50-9a35-478e-a052-fbac3573e9ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e063beebf62e4f73889c7cf7c63d85ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:51:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:51:09Z,use_quota=True,user_id='51c0eb5e9adb43cf9694fdbca9269bec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:09 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-43312c5f-49a7-4f07-b574-470cea5356de tempest-ProjectReaderTests-1379712565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (791fb7c6-7b5d-4b9c-af0a-76178eaa1191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:09 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-43312c5f-49a7-4f07-b574-470cea5356de tempest-ProjectReaderTests-1379712565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (791fb7c6-7b5d-4b9c-af0a-76178eaa1191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:09 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-43312c5f-49a7-4f07-b574-470cea5356de tempest-ProjectReaderTests-1379712565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2afe4e7-b9c9-4913-bf05-c539b1138e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:09 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-43312c5f-49a7-4f07-b574-470cea5356de tempest-ProjectReaderTests-1379712565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2afe4e7-b9c9-4913-bf05-c539b1138e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bed39e50-9a35-478e-a052-fbac3573e9ef', 'volume_name': 'volume-bed39e50-9a35-478e-a052-fbac3573e9ef', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:09 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-43312c5f-49a7-4f07-b574-470cea5356de tempest-ProjectReaderTests-1379712565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd9a822e-2ebf-4dbe-88a7-5db1e8cdef29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:09 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:09 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-43312c5f-49a7-4f07-b574-470cea5356de tempest-ProjectReaderTests-1379712565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd9a822e-2ebf-4dbe-88a7-5db1e8cdef29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:09 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-43312c5f-49a7-4f07-b574-470cea5356de tempest-ProjectReaderTests-1379712565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c5904fd-d855-47d5-a71c-f2f6e8931921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:09 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-43312c5f-49a7-4f07-b574-470cea5356de tempest-ProjectReaderTests-1379712565 None] Volume bed39e50-9a35-478e-a052-fbac3573e9ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bed39e50-9a35-478e-a052-fbac3573e9ef', 'volume_size': 1} Nov 03 07:51:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-43312c5f-49a7-4f07-b574-470cea5356de tempest-ProjectReaderTests-1379712565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-43312c5f-49a7-4f07-b574-470cea5356de tempest-ProjectReaderTests-1379712565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:09 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-43312c5f-49a7-4f07-b574-470cea5356de tempest-ProjectReaderTests-1379712565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:51:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-574026909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bed39e50-9a35-478e-a052-fbac3573e9ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e063beebf62e4f73889c7cf7c63d85ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:51:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:51:09Z,use_quota=True,user_id='51c0eb5e9adb43cf9694fdbca9269bec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:51:09 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-43312c5f-49a7-4f07-b574-470cea5356de tempest-ProjectReaderTests-1379712565 None] Creating volume bed39e50-9a35-478e-a052-fbac3573e9ef {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:51:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-43312c5f-49a7-4f07-b574-470cea5356de tempest-ProjectReaderTests-1379712565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-43312c5f-49a7-4f07-b574-470cea5356de tempest-ProjectReaderTests-1379712565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:09 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-43312c5f-49a7-4f07-b574-470cea5356de tempest-ProjectReaderTests-1379712565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:09 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-43312c5f-49a7-4f07-b574-470cea5356de tempest-ProjectReaderTests-1379712565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-43312c5f-49a7-4f07-b574-470cea5356de tempest-ProjectReaderTests-1379712565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:09 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-43312c5f-49a7-4f07-b574-470cea5356de tempest-ProjectReaderTests-1379712565 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:51:09 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-43312c5f-49a7-4f07-b574-470cea5356de tempest-ProjectReaderTests-1379712565 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:51:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-43312c5f-49a7-4f07-b574-470cea5356de tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bed39e50-9a35-478e-a052-fbac3573e9ef 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-eb952177-97df-4869-8801-137b4adecdcd tempest-CreateVolumesFromSourceVolumeTest-483930564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.349s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:09 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-eb952177-97df-4869-8801-137b4adecdcd tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:51:09 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-eb952177-97df-4869-8801-137b4adecdcd tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Deleted volume successfully. Nov 03 07:51:09 devstack sudo[107060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bed39e50-9a35-478e-a052-fbac3573e9ef 1073741824 Nov 03 07:51:09 devstack sudo[107060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:09 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-eb952177-97df-4869-8801-137b4adecdcd tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Lock "cinder-3ba22102-2b82-4abf-bd46-a8dc2b33c6ef-delete_volume" released by "delete_volume" :: held 1.887s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:09 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-7d8ef371-7769-4e06-934a-190026b77670 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Acquiring lock "cinder-e73233b7-f226-469d-85d5-7e25084e5784-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:09 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-7d8ef371-7769-4e06-934a-190026b77670 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Lock "cinder-e73233b7-f226-469d-85d5-7e25084e5784-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:09 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-7d8ef371-7769-4e06-934a-190026b77670 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Acquiring lock "cinder-quobyte-e73233b7-f226-469d-85d5-7e25084e5784" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:09 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-7d8ef371-7769-4e06-934a-190026b77670 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Lock "cinder-quobyte-e73233b7-f226-469d-85d5-7e25084e5784" acquired by "delete_volume" :: waited 0.028s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:09 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77f80b6-5b40-4429-9852-0e22ca664b22]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7d8ef371-7769-4e06-934a-190026b77670 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e73233b7-f226-469d-85d5-7e25084e5784 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:09 devstack sudo[107060]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-43312c5f-49a7-4f07-b574-470cea5356de tempest-ProjectReaderTests-1379712565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bed39e50-9a35-478e-a052-fbac3573e9ef 1073741824" returned: 0 in 0.664s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-43312c5f-49a7-4f07-b574-470cea5356de tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bed39e50-9a35-478e-a052-fbac3573e9ef {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:09 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bed39e50-9a35-478e-a052-fbac3573e9ef Nov 03 07:51:09 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:10 devstack sudo[107066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e73233b7-f226-469d-85d5-7e25084e5784 Nov 03 07:51:10 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:10 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-43312c5f-49a7-4f07-b574-470cea5356de tempest-ProjectReaderTests-1379712565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bed39e50-9a35-478e-a052-fbac3573e9ef" returned: 0 in 0.277s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:10 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-43312c5f-49a7-4f07-b574-470cea5356de tempest-ProjectReaderTests-1379712565 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:51:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-43312c5f-49a7-4f07-b574-470cea5356de tempest-ProjectReaderTests-1379712565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:10 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-43312c5f-49a7-4f07-b574-470cea5356de tempest-ProjectReaderTests-1379712565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c5904fd-d855-47d5-a71c-f2f6e8931921) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bed39e50-9a35-478e-a052-fbac3573e9ef', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:10 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-43312c5f-49a7-4f07-b574-470cea5356de tempest-ProjectReaderTests-1379712565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62ddc84f-8127-4dfa-9bc6-d17ee3d0b49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:10 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-43312c5f-49a7-4f07-b574-470cea5356de tempest-ProjectReaderTests-1379712565 None] Volume volume-bed39e50-9a35-478e-a052-fbac3573e9ef (bed39e50-9a35-478e-a052-fbac3573e9ef): created successfully Nov 03 07:51:10 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-43312c5f-49a7-4f07-b574-470cea5356de tempest-ProjectReaderTests-1379712565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62ddc84f-8127-4dfa-9bc6-d17ee3d0b49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:10 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-43312c5f-49a7-4f07-b574-470cea5356de tempest-ProjectReaderTests-1379712565 None] Flow 'volume_create_manager' (cd7098c7-4b90-4af6-ae04-be66ab41be04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:10 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7d8ef371-7769-4e06-934a-190026b77670 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e73233b7-f226-469d-85d5-7e25084e5784" returned: 0 in 0.457s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7d8ef371-7769-4e06-934a-190026b77670 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e73233b7-f226-469d-85d5-7e25084e5784 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:10 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-43312c5f-49a7-4f07-b574-470cea5356de tempest-ProjectReaderTests-1379712565 None] Created volume successfully. Nov 03 07:51:10 devstack sudo[107074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e73233b7-f226-469d-85d5-7e25084e5784 Nov 03 07:51:10 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:10 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7d8ef371-7769-4e06-934a-190026b77670 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e73233b7-f226-469d-85d5-7e25084e5784" returned: 0 in 0.364s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:10 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-7d8ef371-7769-4e06-934a-190026b77670 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Lock "cinder-quobyte-e73233b7-f226-469d-85d5-7e25084e5784" released by "delete_volume" :: held 0.889s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:10 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3538ddf-e90c-42cf-af2b-fd87a5e83fcc tempest-ProjectMemberTests-923615420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:51:10 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c3538ddf-e90c-42cf-af2b-fd87a5e83fcc tempest-ProjectMemberTests-923615420 None] Flow 'volume_create_manager' (2a2e204a-9e0b-4ec5-8a83-bb304b5cff9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:10 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c3538ddf-e90c-42cf-af2b-fd87a5e83fcc tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccd0751c-4140-40ea-8e3e-f13f861026dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:10 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-7d8ef371-7769-4e06-934a-190026b77670 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Created reservations ['e3ca109e-0a84-44c9-933e-bb133237364e', 'eae8296b-539e-4357-a4de-3d1e9ee73127', '321b3b2e-7971-43f3-a443-31b1d8b77596', 'fd99de8d-b53c-4055-8e6e-420e09f48938'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:51:10 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c3538ddf-e90c-42cf-af2b-fd87a5e83fcc tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccd0751c-4140-40ea-8e3e-f13f861026dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:51:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-765066847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e676f7e-5b45-47b8-9ca2-4d1988b43220,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed2c0b7d26474c8aaafc23b6762bdc56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:51:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:51:11Z,use_quota=True,user_id='7d2824260e354882bea7f7a6989d9f16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:10 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c3538ddf-e90c-42cf-af2b-fd87a5e83fcc tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bd56550-a6aa-4bca-9554-1685e9425bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:10 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c3538ddf-e90c-42cf-af2b-fd87a5e83fcc tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bd56550-a6aa-4bca-9554-1685e9425bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:10 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c3538ddf-e90c-42cf-af2b-fd87a5e83fcc tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d0ddf09-9984-4aeb-bb5c-5df52abf184c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:10 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c3538ddf-e90c-42cf-af2b-fd87a5e83fcc tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d0ddf09-9984-4aeb-bb5c-5df52abf184c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e676f7e-5b45-47b8-9ca2-4d1988b43220', 'volume_name': 'volume-2e676f7e-5b45-47b8-9ca2-4d1988b43220', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:10 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c3538ddf-e90c-42cf-af2b-fd87a5e83fcc tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a4baad0-39f6-41d6-ae39-4f4d17648de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:10 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c3538ddf-e90c-42cf-af2b-fd87a5e83fcc tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a4baad0-39f6-41d6-ae39-4f4d17648de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:10 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c3538ddf-e90c-42cf-af2b-fd87a5e83fcc tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ee2df4c-b8e4-43b5-b9e2-949ae76eacfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:10 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-c3538ddf-e90c-42cf-af2b-fd87a5e83fcc tempest-ProjectMemberTests-923615420 None] Volume 2e676f7e-5b45-47b8-9ca2-4d1988b43220: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e676f7e-5b45-47b8-9ca2-4d1988b43220', 'volume_size': 1} Nov 03 07:51:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-c3538ddf-e90c-42cf-af2b-fd87a5e83fcc tempest-ProjectMemberTests-923615420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-c3538ddf-e90c-42cf-af2b-fd87a5e83fcc tempest-ProjectMemberTests-923615420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:10 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-c3538ddf-e90c-42cf-af2b-fd87a5e83fcc tempest-ProjectMemberTests-923615420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:51:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-765066847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e676f7e-5b45-47b8-9ca2-4d1988b43220,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed2c0b7d26474c8aaafc23b6762bdc56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:51:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:51:11Z,use_quota=True,user_id='7d2824260e354882bea7f7a6989d9f16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:51:10 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-c3538ddf-e90c-42cf-af2b-fd87a5e83fcc tempest-ProjectMemberTests-923615420 None] Creating volume 2e676f7e-5b45-47b8-9ca2-4d1988b43220 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:51:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-c3538ddf-e90c-42cf-af2b-fd87a5e83fcc tempest-ProjectMemberTests-923615420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-c3538ddf-e90c-42cf-af2b-fd87a5e83fcc tempest-ProjectMemberTests-923615420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:10 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-c3538ddf-e90c-42cf-af2b-fd87a5e83fcc tempest-ProjectMemberTests-923615420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:10 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-c3538ddf-e90c-42cf-af2b-fd87a5e83fcc tempest-ProjectMemberTests-923615420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-c3538ddf-e90c-42cf-af2b-fd87a5e83fcc tempest-ProjectMemberTests-923615420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:10 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-c3538ddf-e90c-42cf-af2b-fd87a5e83fcc tempest-ProjectMemberTests-923615420 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:51:10 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-c3538ddf-e90c-42cf-af2b-fd87a5e83fcc tempest-ProjectMemberTests-923615420 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:51:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c3538ddf-e90c-42cf-af2b-fd87a5e83fcc tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2e676f7e-5b45-47b8-9ca2-4d1988b43220 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:10 devstack sudo[107077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2e676f7e-5b45-47b8-9ca2-4d1988b43220 1073741824 Nov 03 07:51:10 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7d8ef371-7769-4e06-934a-190026b77670 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7d8ef371-7769-4e06-934a-190026b77670 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:11 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-7d8ef371-7769-4e06-934a-190026b77670 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:11 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-7d8ef371-7769-4e06-934a-190026b77670 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7d8ef371-7769-4e06-934a-190026b77670 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7d8ef371-7769-4e06-934a-190026b77670 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:11 devstack sudo[107079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:51:11 devstack sudo[107079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:11 devstack sudo[107079]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7d8ef371-7769-4e06-934a-190026b77670 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.330s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:11 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-7d8ef371-7769-4e06-934a-190026b77670 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:51:11 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-7d8ef371-7769-4e06-934a-190026b77670 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Deleted volume successfully. Nov 03 07:51:11 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-7d8ef371-7769-4e06-934a-190026b77670 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Lock "cinder-e73233b7-f226-469d-85d5-7e25084e5784-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-4bf9c28a-911a-4122-8b50-2bd4fc3f6c93 tempest-ProjectReaderTests-1379712565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:11 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c3538ddf-e90c-42cf-af2b-fd87a5e83fcc tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2e676f7e-5b45-47b8-9ca2-4d1988b43220 1073741824" returned: 0 in 0.683s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c3538ddf-e90c-42cf-af2b-fd87a5e83fcc tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2e676f7e-5b45-47b8-9ca2-4d1988b43220 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:11 devstack sudo[107086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2e676f7e-5b45-47b8-9ca2-4d1988b43220 Nov 03 07:51:11 devstack sudo[107086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:11 devstack sudo[107086]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c3538ddf-e90c-42cf-af2b-fd87a5e83fcc tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2e676f7e-5b45-47b8-9ca2-4d1988b43220" returned: 0 in 0.267s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:11 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-c3538ddf-e90c-42cf-af2b-fd87a5e83fcc tempest-ProjectMemberTests-923615420 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:51:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-c3538ddf-e90c-42cf-af2b-fd87a5e83fcc tempest-ProjectMemberTests-923615420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-4bf9c28a-911a-4122-8b50-2bd4fc3f6c93 tempest-ProjectReaderTests-1379712565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.485s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:11 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c3538ddf-e90c-42cf-af2b-fd87a5e83fcc tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ee2df4c-b8e4-43b5-b9e2-949ae76eacfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e676f7e-5b45-47b8-9ca2-4d1988b43220', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:11 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c3538ddf-e90c-42cf-af2b-fd87a5e83fcc tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac37164d-c8f2-41ec-a6bb-54fee4ec89b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:11 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-4bf9c28a-911a-4122-8b50-2bd4fc3f6c93 tempest-ProjectReaderTests-1379712565 None] Creating offline snapshot 8030a815-bdbc-4eff-91a0-71bd8ece5e10 of volume bed39e50-9a35-478e-a052-fbac3573e9ef {{(pid=86875) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:51:11 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-c3538ddf-e90c-42cf-af2b-fd87a5e83fcc tempest-ProjectMemberTests-923615420 None] Volume volume-2e676f7e-5b45-47b8-9ca2-4d1988b43220 (2e676f7e-5b45-47b8-9ca2-4d1988b43220): created successfully Nov 03 07:51:11 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c3538ddf-e90c-42cf-af2b-fd87a5e83fcc tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac37164d-c8f2-41ec-a6bb-54fee4ec89b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:11 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c3538ddf-e90c-42cf-af2b-fd87a5e83fcc tempest-ProjectMemberTests-923615420 None] Flow 'volume_create_manager' (2a2e204a-9e0b-4ec5-8a83-bb304b5cff9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:11 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-8c65ac64-dc1b-4707-9b7f-a6f5183147d4 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Acquiring lock "cinder-e599b49a-e25e-49df-9b7a-b05f339a2631-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:11 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c7f685-547a-4ed2-a24f-3c6d75f9620f]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4bf9c28a-911a-4122-8b50-2bd4fc3f6c93 tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bed39e50-9a35-478e-a052-fbac3573e9ef {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:12 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-c3538ddf-e90c-42cf-af2b-fd87a5e83fcc tempest-ProjectMemberTests-923615420 None] Created volume successfully. Nov 03 07:51:12 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-8c65ac64-dc1b-4707-9b7f-a6f5183147d4 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Lock "cinder-e599b49a-e25e-49df-9b7a-b05f339a2631-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:12 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-8c65ac64-dc1b-4707-9b7f-a6f5183147d4 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Acquiring lock "cinder-quobyte-e599b49a-e25e-49df-9b7a-b05f339a2631" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:12 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-8c65ac64-dc1b-4707-9b7f-a6f5183147d4 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Lock "cinder-quobyte-e599b49a-e25e-49df-9b7a-b05f339a2631" acquired by "delete_volume" :: waited 0.020s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:12 devstack sudo[107089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bed39e50-9a35-478e-a052-fbac3573e9ef Nov 03 07:51:12 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:12 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c35bef-80c1-4220-b6f5-4d820450180b]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:12 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8c65ac64-dc1b-4707-9b7f-a6f5183147d4 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e599b49a-e25e-49df-9b7a-b05f339a2631 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:12 devstack sudo[107091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e599b49a-e25e-49df-9b7a-b05f339a2631 Nov 03 07:51:12 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:12 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:12 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4bf9c28a-911a-4122-8b50-2bd4fc3f6c93 tempest-ProjectReaderTests-1379712565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bed39e50-9a35-478e-a052-fbac3573e9ef" returned: 0 in 0.443s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:12 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4bf9c28a-911a-4122-8b50-2bd4fc3f6c93 tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bed39e50-9a35-478e-a052-fbac3573e9ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bed39e50-9a35-478e-a052-fbac3573e9ef.8030a815-bdbc-4eff-91a0-71bd8ece5e10 1G {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:12 devstack sudo[107096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bed39e50-9a35-478e-a052-fbac3573e9ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bed39e50-9a35-478e-a052-fbac3573e9ef.8030a815-bdbc-4eff-91a0-71bd8ece5e10 1G Nov 03 07:51:12 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:12 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:12 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8c65ac64-dc1b-4707-9b7f-a6f5183147d4 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e599b49a-e25e-49df-9b7a-b05f339a2631" returned: 0 in 0.448s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:12 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8c65ac64-dc1b-4707-9b7f-a6f5183147d4 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e599b49a-e25e-49df-9b7a-b05f339a2631 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:12 devstack sudo[107102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e599b49a-e25e-49df-9b7a-b05f339a2631 Nov 03 07:51:12 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:12 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:12 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8c65ac64-dc1b-4707-9b7f-a6f5183147d4 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e599b49a-e25e-49df-9b7a-b05f339a2631" returned: 0 in 0.291s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:12 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-8c65ac64-dc1b-4707-9b7f-a6f5183147d4 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Lock "cinder-quobyte-e599b49a-e25e-49df-9b7a-b05f339a2631" released by "delete_volume" :: held 0.796s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:12 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-8c65ac64-dc1b-4707-9b7f-a6f5183147d4 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Created reservations ['4f578071-f1a9-4e3e-a9db-46b532fa4974', 'bd281bf5-2600-4b06-befe-6510bf0e9ede', '4c6ec859-7ae0-44e7-bb2d-ccd80dfc7c82', '443046d5-f3eb-4bfb-b29b-6f700a550ae6'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:51:12 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:12 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4bf9c28a-911a-4122-8b50-2bd4fc3f6c93 tempest-ProjectReaderTests-1379712565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bed39e50-9a35-478e-a052-fbac3573e9ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bed39e50-9a35-478e-a052-fbac3573e9ef.8030a815-bdbc-4eff-91a0-71bd8ece5e10 1G" returned: 0 in 0.539s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:12 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4bf9c28a-911a-4122-8b50-2bd4fc3f6c93 tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bed39e50-9a35-478e-a052-fbac3573e9ef -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bed39e50-9a35-478e-a052-fbac3573e9ef.8030a815-bdbc-4eff-91a0-71bd8ece5e10 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:12 devstack sudo[107108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bed39e50-9a35-478e-a052-fbac3573e9ef -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bed39e50-9a35-478e-a052-fbac3573e9ef.8030a815-bdbc-4eff-91a0-71bd8ece5e10 Nov 03 07:51:12 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-8c65ac64-dc1b-4707-9b7f-a6f5183147d4 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-8c65ac64-dc1b-4707-9b7f-a6f5183147d4 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:13 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-8c65ac64-dc1b-4707-9b7f-a6f5183147d4 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:13 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-8c65ac64-dc1b-4707-9b7f-a6f5183147d4 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-8c65ac64-dc1b-4707-9b7f-a6f5183147d4 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8c65ac64-dc1b-4707-9b7f-a6f5183147d4 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:13 devstack sudo[107110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:51:13 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:13 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-8a48092f-1289-4abb-8412-0af9409a4c49 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Acquiring lock "cinder-fa1f0fba-1ed2-4215-92c1-88433bafed4d-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:13 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-8a48092f-1289-4abb-8412-0af9409a4c49 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Lock "cinder-fa1f0fba-1ed2-4215-92c1-88433bafed4d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:13 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-8a48092f-1289-4abb-8412-0af9409a4c49 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Acquiring lock "cinder-quobyte-fa1f0fba-1ed2-4215-92c1-88433bafed4d" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:13 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-8a48092f-1289-4abb-8412-0af9409a4c49 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Lock "cinder-quobyte-fa1f0fba-1ed2-4215-92c1-88433bafed4d" acquired by "delete_volume" :: waited 0.047s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:13 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1736534-e62d-410a-a944-7de9ed59c40d]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8a48092f-1289-4abb-8412-0af9409a4c49 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-fa1f0fba-1ed2-4215-92c1-88433bafed4d {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-4cb4b05f-c391-4fa2-b412-87e8de218b80 tempest-ProjectMemberTests-923615420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:13 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4bf9c28a-911a-4122-8b50-2bd4fc3f6c93 tempest-ProjectReaderTests-1379712565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bed39e50-9a35-478e-a052-fbac3573e9ef -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bed39e50-9a35-478e-a052-fbac3573e9ef.8030a815-bdbc-4eff-91a0-71bd8ece5e10" returned: 0 in 0.514s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:13 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-4bf9c28a-911a-4122-8b50-2bd4fc3f6c93 tempest-ProjectReaderTests-1379712565 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bed39e50-9a35-478e-a052-fbac3573e9ef.8030a815-bdbc-4eff-91a0-71bd8ece5e10 is being set with open permissions: ugo+rw Nov 03 07:51:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4bf9c28a-911a-4122-8b50-2bd4fc3f6c93 tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bed39e50-9a35-478e-a052-fbac3573e9ef.8030a815-bdbc-4eff-91a0-71bd8ece5e10 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:13 devstack sudo[107116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bed39e50-9a35-478e-a052-fbac3573e9ef.8030a815-bdbc-4eff-91a0-71bd8ece5e10 Nov 03 07:51:13 devstack sudo[107116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:13 devstack sudo[107115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-fa1f0fba-1ed2-4215-92c1-88433bafed4d Nov 03 07:51:13 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:13 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8c65ac64-dc1b-4707-9b7f-a6f5183147d4 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.508s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:13 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-8c65ac64-dc1b-4707-9b7f-a6f5183147d4 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:51:13 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-8c65ac64-dc1b-4707-9b7f-a6f5183147d4 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Deleted volume successfully. Nov 03 07:51:13 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-8c65ac64-dc1b-4707-9b7f-a6f5183147d4 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Lock "cinder-e599b49a-e25e-49df-9b7a-b05f339a2631-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:13 devstack sudo[107116]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4bf9c28a-911a-4122-8b50-2bd4fc3f6c93 tempest-ProjectReaderTests-1379712565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bed39e50-9a35-478e-a052-fbac3573e9ef.8030a815-bdbc-4eff-91a0-71bd8ece5e10" returned: 0 in 0.353s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4bf9c28a-911a-4122-8b50-2bd4fc3f6c93 tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bed39e50-9a35-478e-a052-fbac3573e9ef.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:13 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8a48092f-1289-4abb-8412-0af9409a4c49 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-fa1f0fba-1ed2-4215-92c1-88433bafed4d" returned: 0 in 0.433s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8a48092f-1289-4abb-8412-0af9409a4c49 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-fa1f0fba-1ed2-4215-92c1-88433bafed4d {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:13 devstack sudo[107124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bed39e50-9a35-478e-a052-fbac3573e9ef.info Nov 03 07:51:13 devstack sudo[107124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:13 devstack sudo[107125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-fa1f0fba-1ed2-4215-92c1-88433bafed4d Nov 03 07:51:13 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:14 devstack sudo[107124]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:14 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4bf9c28a-911a-4122-8b50-2bd4fc3f6c93 tempest-ProjectReaderTests-1379712565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bed39e50-9a35-478e-a052-fbac3573e9ef.info" returned: 0 in 0.289s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:14 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-4bf9c28a-911a-4122-8b50-2bd4fc3f6c93 tempest-ProjectReaderTests-1379712565 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bed39e50-9a35-478e-a052-fbac3573e9ef.info is being set with open permissions: ugo+rw Nov 03 07:51:14 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4bf9c28a-911a-4122-8b50-2bd4fc3f6c93 tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bed39e50-9a35-478e-a052-fbac3573e9ef.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:14 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:14 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8a48092f-1289-4abb-8412-0af9409a4c49 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-fa1f0fba-1ed2-4215-92c1-88433bafed4d" returned: 0 in 0.293s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:14 devstack sudo[107130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bed39e50-9a35-478e-a052-fbac3573e9ef.info Nov 03 07:51:14 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:14 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-8a48092f-1289-4abb-8412-0af9409a4c49 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Lock "cinder-quobyte-fa1f0fba-1ed2-4215-92c1-88433bafed4d" released by "delete_volume" :: held 0.802s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:14 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-8a48092f-1289-4abb-8412-0af9409a4c49 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Created reservations ['10bc3385-7a58-41b0-be32-23f9b725d2bb', 'b5c18808-5e4b-4939-ace5-b7f650a60167', '7ab831c0-5da0-43b4-863a-a6aaaf2dab03', 'acb98fa7-b205-4f97-a710-1fac8d7f9647'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:51:14 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-8a48092f-1289-4abb-8412-0af9409a4c49 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:14 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-8a48092f-1289-4abb-8412-0af9409a4c49 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:14 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-8a48092f-1289-4abb-8412-0af9409a4c49 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:14 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-8a48092f-1289-4abb-8412-0af9409a4c49 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:14 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-8a48092f-1289-4abb-8412-0af9409a4c49 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:14 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8a48092f-1289-4abb-8412-0af9409a4c49 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:14 devstack sudo[107132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:51:14 devstack sudo[107132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:14 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:14 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4bf9c28a-911a-4122-8b50-2bd4fc3f6c93 tempest-ProjectReaderTests-1379712565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bed39e50-9a35-478e-a052-fbac3573e9ef.info" returned: 0 in 0.290s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:14 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-4bf9c28a-911a-4122-8b50-2bd4fc3f6c93 tempest-ProjectReaderTests-1379712565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.564s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:14 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-4cb4b05f-c391-4fa2-b412-87e8de218b80 tempest-ProjectMemberTests-923615420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.012s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:14 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-4cb4b05f-c391-4fa2-b412-87e8de218b80 tempest-ProjectMemberTests-923615420 None] Creating offline snapshot 1e6c955d-c7ed-4bdf-bac6-92d77c93e0f7 of volume 2e676f7e-5b45-47b8-9ca2-4d1988b43220 {{(pid=86875) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:51:14 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d050cf-8229-4f76-93a6-3577f2d883a3]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:14 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4cb4b05f-c391-4fa2-b412-87e8de218b80 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2e676f7e-5b45-47b8-9ca2-4d1988b43220 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:14 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-4bf9c28a-911a-4122-8b50-2bd4fc3f6c93 tempest-ProjectReaderTests-1379712565 None] Create snapshot completed successfully Nov 03 07:51:14 devstack sudo[107132]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:14 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8a48092f-1289-4abb-8412-0af9409a4c49 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.286s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:14 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-8a48092f-1289-4abb-8412-0af9409a4c49 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:51:14 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-8a48092f-1289-4abb-8412-0af9409a4c49 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Deleted volume successfully. Nov 03 07:51:14 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-8a48092f-1289-4abb-8412-0af9409a4c49 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Lock "cinder-fa1f0fba-1ed2-4215-92c1-88433bafed4d-delete_volume" released by "delete_volume" :: held 1.414s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:14 devstack sudo[107135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2e676f7e-5b45-47b8-9ca2-4d1988b43220 Nov 03 07:51:14 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:14 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-48dda6fb-e500-4966-b6f6-00b73c8621e3 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Acquiring lock "cinder-6f9f47d2-80df-43a3-ad4d-efcdb526ff26-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:14 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-48dda6fb-e500-4966-b6f6-00b73c8621e3 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Lock "cinder-6f9f47d2-80df-43a3-ad4d-efcdb526ff26-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:14 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-48dda6fb-e500-4966-b6f6-00b73c8621e3 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Acquiring lock "cinder-quobyte-6f9f47d2-80df-43a3-ad4d-efcdb526ff26" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:14 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-48dda6fb-e500-4966-b6f6-00b73c8621e3 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Lock "cinder-quobyte-6f9f47d2-80df-43a3-ad4d-efcdb526ff26" acquired by "delete_volume" :: waited 0.022s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:14 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[4928763d-8d58-448f-bc9a-0407bab0e72f]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:14 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-48dda6fb-e500-4966-b6f6-00b73c8621e3 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6f9f47d2-80df-43a3-ad4d-efcdb526ff26 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:14 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:14 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4cb4b05f-c391-4fa2-b412-87e8de218b80 tempest-ProjectMemberTests-923615420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2e676f7e-5b45-47b8-9ca2-4d1988b43220" returned: 0 in 0.445s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:14 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4cb4b05f-c391-4fa2-b412-87e8de218b80 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2e676f7e-5b45-47b8-9ca2-4d1988b43220,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2e676f7e-5b45-47b8-9ca2-4d1988b43220.1e6c955d-c7ed-4bdf-bac6-92d77c93e0f7 1G {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:15 devstack sudo[107142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2e676f7e-5b45-47b8-9ca2-4d1988b43220,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2e676f7e-5b45-47b8-9ca2-4d1988b43220.1e6c955d-c7ed-4bdf-bac6-92d77c93e0f7 1G Nov 03 07:51:15 devstack sudo[107142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:15 devstack sudo[107138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6f9f47d2-80df-43a3-ad4d-efcdb526ff26 Nov 03 07:51:15 devstack sudo[107138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:15 devstack sudo[107138]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-48dda6fb-e500-4966-b6f6-00b73c8621e3 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6f9f47d2-80df-43a3-ad4d-efcdb526ff26" returned: 0 in 0.505s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-48dda6fb-e500-4966-b6f6-00b73c8621e3 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6f9f47d2-80df-43a3-ad4d-efcdb526ff26 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:15 devstack sudo[107152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6f9f47d2-80df-43a3-ad4d-efcdb526ff26 Nov 03 07:51:15 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:15 devstack sudo[107142]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4cb4b05f-c391-4fa2-b412-87e8de218b80 tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2e676f7e-5b45-47b8-9ca2-4d1988b43220,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2e676f7e-5b45-47b8-9ca2-4d1988b43220.1e6c955d-c7ed-4bdf-bac6-92d77c93e0f7 1G" returned: 0 in 0.550s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4cb4b05f-c391-4fa2-b412-87e8de218b80 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e676f7e-5b45-47b8-9ca2-4d1988b43220 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2e676f7e-5b45-47b8-9ca2-4d1988b43220.1e6c955d-c7ed-4bdf-bac6-92d77c93e0f7 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:15 devstack sudo[107155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e676f7e-5b45-47b8-9ca2-4d1988b43220 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2e676f7e-5b45-47b8-9ca2-4d1988b43220.1e6c955d-c7ed-4bdf-bac6-92d77c93e0f7 Nov 03 07:51:15 devstack sudo[107155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:15 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-48dda6fb-e500-4966-b6f6-00b73c8621e3 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-6f9f47d2-80df-43a3-ad4d-efcdb526ff26" returned: 0 in 0.365s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:15 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-18f761d0-01e9-455e-9eed-717e1fc16c26 tempest-ProjectReaderTests-1379712565 None] Acquiring lock "cinder-8030a815-bdbc-4eff-91a0-71bd8ece5e10-delete_snapshot" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:15 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-48dda6fb-e500-4966-b6f6-00b73c8621e3 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Lock "cinder-quobyte-6f9f47d2-80df-43a3-ad4d-efcdb526ff26" released by "delete_volume" :: held 0.950s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:15 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-18f761d0-01e9-455e-9eed-717e1fc16c26 tempest-ProjectReaderTests-1379712565 None] Lock "cinder-8030a815-bdbc-4eff-91a0-71bd8ece5e10-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:15 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-18f761d0-01e9-455e-9eed-717e1fc16c26 tempest-ProjectReaderTests-1379712565 None] Acquiring lock "cinder-quobyte-bed39e50-9a35-478e-a052-fbac3573e9ef" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:15 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-18f761d0-01e9-455e-9eed-717e1fc16c26 tempest-ProjectReaderTests-1379712565 None] Lock "cinder-quobyte-bed39e50-9a35-478e-a052-fbac3573e9ef" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:15 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-18f761d0-01e9-455e-9eed-717e1fc16c26 tempest-ProjectReaderTests-1379712565 None] Acquiring lock "cinder-quobyte-8030a815-bdbc-4eff-91a0-71bd8ece5e10" by "_delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:15 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-18f761d0-01e9-455e-9eed-717e1fc16c26 tempest-ProjectReaderTests-1379712565 None] Lock "cinder-quobyte-8030a815-bdbc-4eff-91a0-71bd8ece5e10" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:15 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-18f761d0-01e9-455e-9eed-717e1fc16c26 tempest-ProjectReaderTests-1379712565 None] Deleting offline snapshot 8030a815-bdbc-4eff-91a0-71bd8ece5e10 of volume bed39e50-9a35-478e-a052-fbac3573e9ef {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:51:15 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-18f761d0-01e9-455e-9eed-717e1fc16c26 tempest-ProjectReaderTests-1379712565 None] snapshot_file for this snap is: volume-bed39e50-9a35-478e-a052-fbac3573e9ef.8030a815-bdbc-4eff-91a0-71bd8ece5e10 {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:51:15 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c89513d-44cd-4bd8-99f2-5401d172a58c]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-18f761d0-01e9-455e-9eed-717e1fc16c26 tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bed39e50-9a35-478e-a052-fbac3573e9ef.8030a815-bdbc-4eff-91a0-71bd8ece5e10 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:15 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-48dda6fb-e500-4966-b6f6-00b73c8621e3 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Created reservations ['c1633389-0f9d-446e-83af-b469628b9bf7', '0f528ea9-9bca-49b2-b2f8-c9973355314c', '151007e8-0928-40cf-b7f2-7f4106e0ee51', '3f6317de-c297-40fe-b94b-d6fb712eaa52'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:51:15 devstack sudo[107155]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4cb4b05f-c391-4fa2-b412-87e8de218b80 tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e676f7e-5b45-47b8-9ca2-4d1988b43220 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2e676f7e-5b45-47b8-9ca2-4d1988b43220.1e6c955d-c7ed-4bdf-bac6-92d77c93e0f7" returned: 0 in 0.448s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:15 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-4cb4b05f-c391-4fa2-b412-87e8de218b80 tempest-ProjectMemberTests-923615420 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2e676f7e-5b45-47b8-9ca2-4d1988b43220.1e6c955d-c7ed-4bdf-bac6-92d77c93e0f7 is being set with open permissions: ugo+rw Nov 03 07:51:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4cb4b05f-c391-4fa2-b412-87e8de218b80 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2e676f7e-5b45-47b8-9ca2-4d1988b43220.1e6c955d-c7ed-4bdf-bac6-92d77c93e0f7 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-48dda6fb-e500-4966-b6f6-00b73c8621e3 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-48dda6fb-e500-4966-b6f6-00b73c8621e3 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:16 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-48dda6fb-e500-4966-b6f6-00b73c8621e3 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:16 devstack sudo[107163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2e676f7e-5b45-47b8-9ca2-4d1988b43220.1e6c955d-c7ed-4bdf-bac6-92d77c93e0f7 Nov 03 07:51:16 devstack sudo[107161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bed39e50-9a35-478e-a052-fbac3573e9ef.8030a815-bdbc-4eff-91a0-71bd8ece5e10 Nov 03 07:51:16 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:16 devstack sudo[107161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:16 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-48dda6fb-e500-4966-b6f6-00b73c8621e3 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-48dda6fb-e500-4966-b6f6-00b73c8621e3 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-48dda6fb-e500-4966-b6f6-00b73c8621e3 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:16 devstack sudo[107166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:51:16 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:16 devstack sudo[107161]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-18f761d0-01e9-455e-9eed-717e1fc16c26 tempest-ProjectReaderTests-1379712565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bed39e50-9a35-478e-a052-fbac3573e9ef.8030a815-bdbc-4eff-91a0-71bd8ece5e10" returned: 0 in 0.411s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:16 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-18f761d0-01e9-455e-9eed-717e1fc16c26 tempest-ProjectReaderTests-1379712565 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bed39e50-9a35-478e-a052-fbac3573e9ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:51:16 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-48dda6fb-e500-4966-b6f6-00b73c8621e3 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.304s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:16 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-48dda6fb-e500-4966-b6f6-00b73c8621e3 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:51:16 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-48dda6fb-e500-4966-b6f6-00b73c8621e3 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Deleted volume successfully. Nov 03 07:51:16 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:16 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa821e2-99fe-4381-9bbd-60ee94f2ec98]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-18f761d0-01e9-455e-9eed-717e1fc16c26 tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bed39e50-9a35-478e-a052-fbac3573e9ef {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4cb4b05f-c391-4fa2-b412-87e8de218b80 tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2e676f7e-5b45-47b8-9ca2-4d1988b43220.1e6c955d-c7ed-4bdf-bac6-92d77c93e0f7" returned: 0 in 0.375s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:16 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-48dda6fb-e500-4966-b6f6-00b73c8621e3 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Lock "cinder-6f9f47d2-80df-43a3-ad4d-efcdb526ff26-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4cb4b05f-c391-4fa2-b412-87e8de218b80 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2e676f7e-5b45-47b8-9ca2-4d1988b43220.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:16 devstack sudo[107174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2e676f7e-5b45-47b8-9ca2-4d1988b43220.info Nov 03 07:51:16 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:16 devstack sudo[107173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bed39e50-9a35-478e-a052-fbac3573e9ef Nov 03 07:51:16 devstack sudo[107173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:16 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b890844-623d-4a59-8595-e1580ce80647 tempest-SnapshotDependencyTests-758997837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:51:16 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:16 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0b890844-623d-4a59-8595-e1580ce80647 tempest-SnapshotDependencyTests-758997837 None] Flow 'volume_create_manager' (a3e01c08-3e35-4e92-98ee-60becf29b538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:16 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0b890844-623d-4a59-8595-e1580ce80647 tempest-SnapshotDependencyTests-758997837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c9c430c-b9e0-45b0-ae60-25204f700924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4cb4b05f-c391-4fa2-b412-87e8de218b80 tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2e676f7e-5b45-47b8-9ca2-4d1988b43220.info" returned: 0 in 0.322s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:16 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-4cb4b05f-c391-4fa2-b412-87e8de218b80 tempest-ProjectMemberTests-923615420 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2e676f7e-5b45-47b8-9ca2-4d1988b43220.info is being set with open permissions: ugo+rw Nov 03 07:51:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4cb4b05f-c391-4fa2-b412-87e8de218b80 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2e676f7e-5b45-47b8-9ca2-4d1988b43220.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:16 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0b890844-623d-4a59-8595-e1580ce80647 tempest-SnapshotDependencyTests-758997837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c9c430c-b9e0-45b0-ae60-25204f700924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:51:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-925242428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a07d499-f559-4dd5-a760-d34fd7d99601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0eeba35bc37f470ba93fae21b5e23a74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:51:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:51:17Z,use_quota=True,user_id='f9ad5eb603b8431db45050e979f6e85a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:16 devstack sudo[107180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2e676f7e-5b45-47b8-9ca2-4d1988b43220.info Nov 03 07:51:16 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:16 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0b890844-623d-4a59-8595-e1580ce80647 tempest-SnapshotDependencyTests-758997837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8ddb14e-04ab-469c-9a32-50f988d1dac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:16 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0b890844-623d-4a59-8595-e1580ce80647 tempest-SnapshotDependencyTests-758997837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8ddb14e-04ab-469c-9a32-50f988d1dac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:16 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0b890844-623d-4a59-8595-e1580ce80647 tempest-SnapshotDependencyTests-758997837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47e79101-6270-440d-aa5c-ce7758d1e78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:16 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0b890844-623d-4a59-8595-e1580ce80647 tempest-SnapshotDependencyTests-758997837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47e79101-6270-440d-aa5c-ce7758d1e78c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a07d499-f559-4dd5-a760-d34fd7d99601', 'volume_name': 'volume-2a07d499-f559-4dd5-a760-d34fd7d99601', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:16 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0b890844-623d-4a59-8595-e1580ce80647 tempest-SnapshotDependencyTests-758997837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58a53bc8-64d3-4946-ac55-301b0da057eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:16 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0b890844-623d-4a59-8595-e1580ce80647 tempest-SnapshotDependencyTests-758997837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58a53bc8-64d3-4946-ac55-301b0da057eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:16 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0b890844-623d-4a59-8595-e1580ce80647 tempest-SnapshotDependencyTests-758997837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e472276c-a898-418b-a1bb-aeb091d69eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:16 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-0b890844-623d-4a59-8595-e1580ce80647 tempest-SnapshotDependencyTests-758997837 None] Volume 2a07d499-f559-4dd5-a760-d34fd7d99601: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a07d499-f559-4dd5-a760-d34fd7d99601', 'volume_size': 1} Nov 03 07:51:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0b890844-623d-4a59-8595-e1580ce80647 tempest-SnapshotDependencyTests-758997837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:16 devstack sudo[107173]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-18f761d0-01e9-455e-9eed-717e1fc16c26 tempest-ProjectReaderTests-1379712565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bed39e50-9a35-478e-a052-fbac3573e9ef" returned: 0 in 0.455s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-18f761d0-01e9-455e-9eed-717e1fc16c26 tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bed39e50-9a35-478e-a052-fbac3573e9ef.8030a815-bdbc-4eff-91a0-71bd8ece5e10 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:16 devstack sudo[107183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bed39e50-9a35-478e-a052-fbac3573e9ef.8030a815-bdbc-4eff-91a0-71bd8ece5e10 Nov 03 07:51:16 devstack sudo[107183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:16 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-4cb4b05f-c391-4fa2-b412-87e8de218b80 tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2e676f7e-5b45-47b8-9ca2-4d1988b43220.info" returned: 0 in 0.275s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-4cb4b05f-c391-4fa2-b412-87e8de218b80 tempest-ProjectMemberTests-923615420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.541s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0b890844-623d-4a59-8595-e1580ce80647 tempest-SnapshotDependencyTests-758997837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.236s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:17 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-0b890844-623d-4a59-8595-e1580ce80647 tempest-SnapshotDependencyTests-758997837 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:51:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-925242428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a07d499-f559-4dd5-a760-d34fd7d99601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0eeba35bc37f470ba93fae21b5e23a74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:51:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:51:17Z,use_quota=True,user_id='f9ad5eb603b8431db45050e979f6e85a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:51:17 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-0b890844-623d-4a59-8595-e1580ce80647 tempest-SnapshotDependencyTests-758997837 None] Creating volume 2a07d499-f559-4dd5-a760-d34fd7d99601 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:51:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0b890844-623d-4a59-8595-e1580ce80647 tempest-SnapshotDependencyTests-758997837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0b890844-623d-4a59-8595-e1580ce80647 tempest-SnapshotDependencyTests-758997837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:17 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-0b890844-623d-4a59-8595-e1580ce80647 tempest-SnapshotDependencyTests-758997837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:17 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-0b890844-623d-4a59-8595-e1580ce80647 tempest-SnapshotDependencyTests-758997837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0b890844-623d-4a59-8595-e1580ce80647 tempest-SnapshotDependencyTests-758997837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:17 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-0b890844-623d-4a59-8595-e1580ce80647 tempest-SnapshotDependencyTests-758997837 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:51:17 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-0b890844-623d-4a59-8595-e1580ce80647 tempest-SnapshotDependencyTests-758997837 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:51:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0b890844-623d-4a59-8595-e1580ce80647 tempest-SnapshotDependencyTests-758997837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2a07d499-f559-4dd5-a760-d34fd7d99601 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:17 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-49f09d65-2a70-4268-bc52-dd4865846ef7 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Acquiring lock "cinder-e77db5c5-3d80-4cc6-bbdb-583bab4c9764-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:17 devstack sudo[107186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2a07d499-f559-4dd5-a760-d34fd7d99601 1073741824 Nov 03 07:51:17 devstack sudo[107186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:17 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-49f09d65-2a70-4268-bc52-dd4865846ef7 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Lock "cinder-e77db5c5-3d80-4cc6-bbdb-583bab4c9764-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:17 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-4cb4b05f-c391-4fa2-b412-87e8de218b80 tempest-ProjectMemberTests-923615420 None] Create snapshot completed successfully Nov 03 07:51:17 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-49f09d65-2a70-4268-bc52-dd4865846ef7 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Acquiring lock "cinder-quobyte-e77db5c5-3d80-4cc6-bbdb-583bab4c9764" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:17 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-49f09d65-2a70-4268-bc52-dd4865846ef7 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Lock "cinder-quobyte-e77db5c5-3d80-4cc6-bbdb-583bab4c9764" acquired by "delete_volume" :: waited 0.017s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:17 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c01a8a-e319-4cc5-8565-f836fe3514b4]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-49f09d65-2a70-4268-bc52-dd4865846ef7 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e77db5c5-3d80-4cc6-bbdb-583bab4c9764 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:17 devstack sudo[107183]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-18f761d0-01e9-455e-9eed-717e1fc16c26 tempest-ProjectReaderTests-1379712565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bed39e50-9a35-478e-a052-fbac3573e9ef.8030a815-bdbc-4eff-91a0-71bd8ece5e10" returned: 0 in 0.400s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-18f761d0-01e9-455e-9eed-717e1fc16c26 tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bed39e50-9a35-478e-a052-fbac3573e9ef.8030a815-bdbc-4eff-91a0-71bd8ece5e10 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:17 devstack sudo[107192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bed39e50-9a35-478e-a052-fbac3573e9ef.8030a815-bdbc-4eff-91a0-71bd8ece5e10 Nov 03 07:51:17 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:17 devstack sudo[107191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e77db5c5-3d80-4cc6-bbdb-583bab4c9764 Nov 03 07:51:17 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:17 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-18f761d0-01e9-455e-9eed-717e1fc16c26 tempest-ProjectReaderTests-1379712565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bed39e50-9a35-478e-a052-fbac3573e9ef.8030a815-bdbc-4eff-91a0-71bd8ece5e10" returned: 0 in 0.269s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:17 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-18f761d0-01e9-455e-9eed-717e1fc16c26 tempest-ProjectReaderTests-1379712565 None] Lock "cinder-quobyte-8030a815-bdbc-4eff-91a0-71bd8ece5e10" released by "_delete_snapshot" :: held 1.656s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:17 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-18f761d0-01e9-455e-9eed-717e1fc16c26 tempest-ProjectReaderTests-1379712565 None] Lock "cinder-quobyte-bed39e50-9a35-478e-a052-fbac3573e9ef" released by "delete_snapshot" :: held 1.695s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:17 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:17 devstack sudo[107186]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0b890844-623d-4a59-8595-e1580ce80647 tempest-SnapshotDependencyTests-758997837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2a07d499-f559-4dd5-a760-d34fd7d99601 1073741824" returned: 0 in 0.531s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-49f09d65-2a70-4268-bc52-dd4865846ef7 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e77db5c5-3d80-4cc6-bbdb-583bab4c9764" returned: 0 in 0.408s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-49f09d65-2a70-4268-bc52-dd4865846ef7 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e77db5c5-3d80-4cc6-bbdb-583bab4c9764 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:17 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e77db5c5-3d80-4cc6-bbdb-583bab4c9764 Nov 03 07:51:17 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:17 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-18f761d0-01e9-455e-9eed-717e1fc16c26 tempest-ProjectReaderTests-1379712565 None] Created reservations ['8ee1e90b-520e-4788-b70d-f878ae0de6c9', '065590e2-53eb-46c4-83b7-df48e6015a29', '1b4aa02e-70b4-4203-8fb8-b6e665787cae', '1c8e0736-c4b3-43fb-99e8-9d9427df1883'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:51:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0b890844-623d-4a59-8595-e1580ce80647 tempest-SnapshotDependencyTests-758997837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2a07d499-f559-4dd5-a760-d34fd7d99601 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:17 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-430a0955-3a8e-478e-8650-0f22dace5d9c tempest-ProjectMemberTests-923615420 None] Acquiring lock "cinder-1e6c955d-c7ed-4bdf-bac6-92d77c93e0f7-delete_snapshot" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:17 devstack sudo[107206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2a07d499-f559-4dd5-a760-d34fd7d99601 Nov 03 07:51:17 devstack sudo[107206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:17 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-430a0955-3a8e-478e-8650-0f22dace5d9c tempest-ProjectMemberTests-923615420 None] Lock "cinder-1e6c955d-c7ed-4bdf-bac6-92d77c93e0f7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:17 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-430a0955-3a8e-478e-8650-0f22dace5d9c tempest-ProjectMemberTests-923615420 None] Acquiring lock "cinder-quobyte-2e676f7e-5b45-47b8-9ca2-4d1988b43220" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:17 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-430a0955-3a8e-478e-8650-0f22dace5d9c tempest-ProjectMemberTests-923615420 None] Lock "cinder-quobyte-2e676f7e-5b45-47b8-9ca2-4d1988b43220" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:17 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-430a0955-3a8e-478e-8650-0f22dace5d9c tempest-ProjectMemberTests-923615420 None] Acquiring lock "cinder-quobyte-1e6c955d-c7ed-4bdf-bac6-92d77c93e0f7" by "_delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:17 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-18f761d0-01e9-455e-9eed-717e1fc16c26 tempest-ProjectReaderTests-1379712565 None] Delete snapshot completed successfully. Nov 03 07:51:17 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-430a0955-3a8e-478e-8650-0f22dace5d9c tempest-ProjectMemberTests-923615420 None] Lock "cinder-quobyte-1e6c955d-c7ed-4bdf-bac6-92d77c93e0f7" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:17 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-430a0955-3a8e-478e-8650-0f22dace5d9c tempest-ProjectMemberTests-923615420 None] Deleting offline snapshot 1e6c955d-c7ed-4bdf-bac6-92d77c93e0f7 of volume 2e676f7e-5b45-47b8-9ca2-4d1988b43220 {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:51:17 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-430a0955-3a8e-478e-8650-0f22dace5d9c tempest-ProjectMemberTests-923615420 None] snapshot_file for this snap is: volume-2e676f7e-5b45-47b8-9ca2-4d1988b43220.1e6c955d-c7ed-4bdf-bac6-92d77c93e0f7 {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:51:17 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-18f761d0-01e9-455e-9eed-717e1fc16c26 tempest-ProjectReaderTests-1379712565 None] Lock "cinder-8030a815-bdbc-4eff-91a0-71bd8ece5e10-delete_snapshot" released by "delete_snapshot" :: held 2.000s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:17 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3fbb08-b37f-4713-934b-fee44858d153]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-430a0955-3a8e-478e-8650-0f22dace5d9c tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2e676f7e-5b45-47b8-9ca2-4d1988b43220.1e6c955d-c7ed-4bdf-bac6-92d77c93e0f7 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:17 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-54bd906c-d086-4b5e-9584-f5660ecf0287 tempest-ProjectReaderTests-1379712565 None] Acquiring lock "cinder-bed39e50-9a35-478e-a052-fbac3573e9ef-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:17 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-54bd906c-d086-4b5e-9584-f5660ecf0287 tempest-ProjectReaderTests-1379712565 None] Lock "cinder-bed39e50-9a35-478e-a052-fbac3573e9ef-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:17 devstack sudo[107214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2e676f7e-5b45-47b8-9ca2-4d1988b43220.1e6c955d-c7ed-4bdf-bac6-92d77c93e0f7 Nov 03 07:51:17 devstack sudo[107214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:17 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-49f09d65-2a70-4268-bc52-dd4865846ef7 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-e77db5c5-3d80-4cc6-bbdb-583bab4c9764" returned: 0 in 0.423s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:18 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-54bd906c-d086-4b5e-9584-f5660ecf0287 tempest-ProjectReaderTests-1379712565 None] Acquiring lock "cinder-quobyte-bed39e50-9a35-478e-a052-fbac3573e9ef" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:18 devstack sudo[107206]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:18 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0b890844-623d-4a59-8595-e1580ce80647 tempest-SnapshotDependencyTests-758997837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2a07d499-f559-4dd5-a760-d34fd7d99601" returned: 0 in 0.394s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:18 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-0b890844-623d-4a59-8595-e1580ce80647 tempest-SnapshotDependencyTests-758997837 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:51:18 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0b890844-623d-4a59-8595-e1580ce80647 tempest-SnapshotDependencyTests-758997837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:18 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-49f09d65-2a70-4268-bc52-dd4865846ef7 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Lock "cinder-quobyte-e77db5c5-3d80-4cc6-bbdb-583bab4c9764" released by "delete_volume" :: held 0.884s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:18 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0b890844-623d-4a59-8595-e1580ce80647 tempest-SnapshotDependencyTests-758997837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e472276c-a898-418b-a1bb-aeb091d69eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a07d499-f559-4dd5-a760-d34fd7d99601', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:18 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0b890844-623d-4a59-8595-e1580ce80647 tempest-SnapshotDependencyTests-758997837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a844473c-a87c-417e-b7a6-23033c3011a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:18 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-54bd906c-d086-4b5e-9584-f5660ecf0287 tempest-ProjectReaderTests-1379712565 None] Lock "cinder-quobyte-bed39e50-9a35-478e-a052-fbac3573e9ef" acquired by "delete_volume" :: waited 0.041s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:18 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-0b890844-623d-4a59-8595-e1580ce80647 tempest-SnapshotDependencyTests-758997837 None] Volume volume-2a07d499-f559-4dd5-a760-d34fd7d99601 (2a07d499-f559-4dd5-a760-d34fd7d99601): created successfully Nov 03 07:51:18 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0b890844-623d-4a59-8595-e1580ce80647 tempest-SnapshotDependencyTests-758997837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a844473c-a87c-417e-b7a6-23033c3011a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:18 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0b890844-623d-4a59-8595-e1580ce80647 tempest-SnapshotDependencyTests-758997837 None] Flow 'volume_create_manager' (a3e01c08-3e35-4e92-98ee-60becf29b538) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:18 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[118994af-5ac1-4450-b9e5-3c408f03e414]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:18 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-54bd906c-d086-4b5e-9584-f5660ecf0287 tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bed39e50-9a35-478e-a052-fbac3573e9ef {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:18 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-0b890844-623d-4a59-8595-e1580ce80647 tempest-SnapshotDependencyTests-758997837 None] Created volume successfully. Nov 03 07:51:18 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-49f09d65-2a70-4268-bc52-dd4865846ef7 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Created reservations ['ccf2d652-b111-4f83-95cb-f6925c7e33be', '8c89ab60-381a-4fd1-b27c-042bce0aacbf', '786ea6f8-7e1d-49b5-ae30-2fcec6a6095f', '97487c0d-935d-43fe-b5c7-eba79b533795'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:51:18 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-49f09d65-2a70-4268-bc52-dd4865846ef7 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:18 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-49f09d65-2a70-4268-bc52-dd4865846ef7 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:18 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-49f09d65-2a70-4268-bc52-dd4865846ef7 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:18 devstack sudo[107218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bed39e50-9a35-478e-a052-fbac3573e9ef Nov 03 07:51:18 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:18 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-49f09d65-2a70-4268-bc52-dd4865846ef7 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:18 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-49f09d65-2a70-4268-bc52-dd4865846ef7 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:18 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-49f09d65-2a70-4268-bc52-dd4865846ef7 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:18 devstack sudo[107214]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:18 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-430a0955-3a8e-478e-8650-0f22dace5d9c tempest-ProjectMemberTests-923615420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2e676f7e-5b45-47b8-9ca2-4d1988b43220.1e6c955d-c7ed-4bdf-bac6-92d77c93e0f7" returned: 0 in 0.484s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:18 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-430a0955-3a8e-478e-8650-0f22dace5d9c tempest-ProjectMemberTests-923615420 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e676f7e-5b45-47b8-9ca2-4d1988b43220(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:51:18 devstack sudo[107224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:51:18 devstack sudo[107224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:18 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55ccbd9-d773-47ff-8ec9-e1f85c73b6d8]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:18 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-430a0955-3a8e-478e-8650-0f22dace5d9c tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2e676f7e-5b45-47b8-9ca2-4d1988b43220 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:18 devstack sudo[107226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2e676f7e-5b45-47b8-9ca2-4d1988b43220 Nov 03 07:51:18 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:18 devstack sudo[107224]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:18 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-49f09d65-2a70-4268-bc52-dd4865846ef7 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.261s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:18 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-49f09d65-2a70-4268-bc52-dd4865846ef7 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:51:18 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-49f09d65-2a70-4268-bc52-dd4865846ef7 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Deleted volume successfully. Nov 03 07:51:18 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:18 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-54bd906c-d086-4b5e-9584-f5660ecf0287 tempest-ProjectReaderTests-1379712565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bed39e50-9a35-478e-a052-fbac3573e9ef" returned: 0 in 0.446s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:18 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-54bd906c-d086-4b5e-9584-f5660ecf0287 tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bed39e50-9a35-478e-a052-fbac3573e9ef {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:18 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-49f09d65-2a70-4268-bc52-dd4865846ef7 tempest-CreateVolumesFromSourceVolumeTest-483930564 None] Lock "cinder-e77db5c5-3d80-4cc6-bbdb-583bab4c9764-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:18 devstack sudo[107232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bed39e50-9a35-478e-a052-fbac3573e9ef Nov 03 07:51:18 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:18 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:18 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-430a0955-3a8e-478e-8650-0f22dace5d9c tempest-ProjectMemberTests-923615420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2e676f7e-5b45-47b8-9ca2-4d1988b43220" returned: 0 in 0.430s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:18 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-430a0955-3a8e-478e-8650-0f22dace5d9c tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2e676f7e-5b45-47b8-9ca2-4d1988b43220.1e6c955d-c7ed-4bdf-bac6-92d77c93e0f7 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:18 devstack sudo[107237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2e676f7e-5b45-47b8-9ca2-4d1988b43220.1e6c955d-c7ed-4bdf-bac6-92d77c93e0f7 Nov 03 07:51:18 devstack sudo[107237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:18 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:18 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-54bd906c-d086-4b5e-9584-f5660ecf0287 tempest-ProjectReaderTests-1379712565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-bed39e50-9a35-478e-a052-fbac3573e9ef" returned: 0 in 0.300s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:18 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-54bd906c-d086-4b5e-9584-f5660ecf0287 tempest-ProjectReaderTests-1379712565 None] Lock "cinder-quobyte-bed39e50-9a35-478e-a052-fbac3573e9ef" released by "delete_volume" :: held 0.835s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:18 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-54bd906c-d086-4b5e-9584-f5660ecf0287 tempest-ProjectReaderTests-1379712565 None] Created reservations ['41ee58c9-2925-43bc-a14a-3f730d359f7b', 'a3192dc0-5b91-40db-befd-8564ad2828d5', 'b8899853-72d3-4584-b064-0e0c1ade12a8', '7a79c3c9-adb9-47be-84ec-066cd4269475'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:51:19 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-54bd906c-d086-4b5e-9584-f5660ecf0287 tempest-ProjectReaderTests-1379712565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:19 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-54bd906c-d086-4b5e-9584-f5660ecf0287 tempest-ProjectReaderTests-1379712565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:19 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-54bd906c-d086-4b5e-9584-f5660ecf0287 tempest-ProjectReaderTests-1379712565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:19 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-54bd906c-d086-4b5e-9584-f5660ecf0287 tempest-ProjectReaderTests-1379712565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:19 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-54bd906c-d086-4b5e-9584-f5660ecf0287 tempest-ProjectReaderTests-1379712565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:19 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-54bd906c-d086-4b5e-9584-f5660ecf0287 tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:19 devstack sudo[107242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:51:19 devstack sudo[107242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:19 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3c885beb-34ff-484e-80c0-e754a9213a0e tempest-SnapshotDependencyTests-758997837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:19 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3c885beb-34ff-484e-80c0-e754a9213a0e tempest-SnapshotDependencyTests-758997837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:19 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-3c885beb-34ff-484e-80c0-e754a9213a0e tempest-SnapshotDependencyTests-758997837 None] Creating offline snapshot 796343bd-5a57-4d96-8b50-236a4140771b of volume 2a07d499-f559-4dd5-a760-d34fd7d99601 {{(pid=86875) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:51:19 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66bed52-c0e7-43a3-8664-21b034f9078e]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:19 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3c885beb-34ff-484e-80c0-e754a9213a0e tempest-SnapshotDependencyTests-758997837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2a07d499-f559-4dd5-a760-d34fd7d99601 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:19 devstack sudo[107237]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:19 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-430a0955-3a8e-478e-8650-0f22dace5d9c tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2e676f7e-5b45-47b8-9ca2-4d1988b43220.1e6c955d-c7ed-4bdf-bac6-92d77c93e0f7" returned: 0 in 0.446s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:19 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-430a0955-3a8e-478e-8650-0f22dace5d9c tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2e676f7e-5b45-47b8-9ca2-4d1988b43220.1e6c955d-c7ed-4bdf-bac6-92d77c93e0f7 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:19 devstack sudo[107246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2a07d499-f559-4dd5-a760-d34fd7d99601 Nov 03 07:51:19 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:19 devstack sudo[107247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2e676f7e-5b45-47b8-9ca2-4d1988b43220.1e6c955d-c7ed-4bdf-bac6-92d77c93e0f7 Nov 03 07:51:19 devstack sudo[107247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:19 devstack sudo[107242]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:19 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-54bd906c-d086-4b5e-9584-f5660ecf0287 tempest-ProjectReaderTests-1379712565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.344s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:19 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-54bd906c-d086-4b5e-9584-f5660ecf0287 tempest-ProjectReaderTests-1379712565 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:51:19 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-54bd906c-d086-4b5e-9584-f5660ecf0287 tempest-ProjectReaderTests-1379712565 None] Deleted volume successfully. Nov 03 07:51:19 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-54bd906c-d086-4b5e-9584-f5660ecf0287 tempest-ProjectReaderTests-1379712565 None] Lock "cinder-bed39e50-9a35-478e-a052-fbac3573e9ef-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:19 devstack sudo[107247]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:19 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-430a0955-3a8e-478e-8650-0f22dace5d9c tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2e676f7e-5b45-47b8-9ca2-4d1988b43220.1e6c955d-c7ed-4bdf-bac6-92d77c93e0f7" returned: 0 in 0.376s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:19 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-430a0955-3a8e-478e-8650-0f22dace5d9c tempest-ProjectMemberTests-923615420 None] Lock "cinder-quobyte-1e6c955d-c7ed-4bdf-bac6-92d77c93e0f7" released by "_delete_snapshot" :: held 1.913s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:19 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-430a0955-3a8e-478e-8650-0f22dace5d9c tempest-ProjectMemberTests-923615420 None] Lock "cinder-quobyte-2e676f7e-5b45-47b8-9ca2-4d1988b43220" released by "delete_snapshot" :: held 1.955s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:19 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4e2a92c-93fa-4cad-8964-cd832e71c4ac tempest-ProjectReaderTests-1379712565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:51:19 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:19 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b4e2a92c-93fa-4cad-8964-cd832e71c4ac tempest-ProjectReaderTests-1379712565 None] Flow 'volume_create_manager' (4c2e282e-48d3-4f49-8237-08adcd0c1ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:19 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b4e2a92c-93fa-4cad-8964-cd832e71c4ac tempest-ProjectReaderTests-1379712565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ecf7174-0f65-418d-b326-f33fe5cccae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:19 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3c885beb-34ff-484e-80c0-e754a9213a0e tempest-SnapshotDependencyTests-758997837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2a07d499-f559-4dd5-a760-d34fd7d99601" returned: 0 in 0.598s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:19 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3c885beb-34ff-484e-80c0-e754a9213a0e tempest-SnapshotDependencyTests-758997837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2a07d499-f559-4dd5-a760-d34fd7d99601,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2a07d499-f559-4dd5-a760-d34fd7d99601.796343bd-5a57-4d96-8b50-236a4140771b 1G {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:19 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b4e2a92c-93fa-4cad-8964-cd832e71c4ac tempest-ProjectReaderTests-1379712565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ecf7174-0f65-418d-b326-f33fe5cccae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-668003243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4836cd4a-f52d-462a-934c-f1de31d243c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e063beebf62e4f73889c7cf7c63d85ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:51:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:51:20Z,use_quota=True,user_id='51c0eb5e9adb43cf9694fdbca9269bec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:19 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b4e2a92c-93fa-4cad-8964-cd832e71c4ac tempest-ProjectReaderTests-1379712565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c33ec9d-c04f-423c-96f5-2e6bc6ce738f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:19 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b4e2a92c-93fa-4cad-8964-cd832e71c4ac tempest-ProjectReaderTests-1379712565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c33ec9d-c04f-423c-96f5-2e6bc6ce738f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:19 devstack sudo[107256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2a07d499-f559-4dd5-a760-d34fd7d99601,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2a07d499-f559-4dd5-a760-d34fd7d99601.796343bd-5a57-4d96-8b50-236a4140771b 1G Nov 03 07:51:19 devstack sudo[107256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:19 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b4e2a92c-93fa-4cad-8964-cd832e71c4ac tempest-ProjectReaderTests-1379712565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (940f8f74-7d01-4437-81b5-7527f4cca9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:19 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b4e2a92c-93fa-4cad-8964-cd832e71c4ac tempest-ProjectReaderTests-1379712565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (940f8f74-7d01-4437-81b5-7527f4cca9f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4836cd4a-f52d-462a-934c-f1de31d243c6', 'volume_name': 'volume-4836cd4a-f52d-462a-934c-f1de31d243c6', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:19 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b4e2a92c-93fa-4cad-8964-cd832e71c4ac tempest-ProjectReaderTests-1379712565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58b27d02-05e5-4d8b-b41d-71a234a90fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:19 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b4e2a92c-93fa-4cad-8964-cd832e71c4ac tempest-ProjectReaderTests-1379712565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58b27d02-05e5-4d8b-b41d-71a234a90fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:19 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b4e2a92c-93fa-4cad-8964-cd832e71c4ac tempest-ProjectReaderTests-1379712565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61bebd14-c478-48d7-9079-2e855b7767dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:19 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-b4e2a92c-93fa-4cad-8964-cd832e71c4ac tempest-ProjectReaderTests-1379712565 None] Volume 4836cd4a-f52d-462a-934c-f1de31d243c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4836cd4a-f52d-462a-934c-f1de31d243c6', 'volume_size': 1} Nov 03 07:51:19 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b4e2a92c-93fa-4cad-8964-cd832e71c4ac tempest-ProjectReaderTests-1379712565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:19 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-430a0955-3a8e-478e-8650-0f22dace5d9c tempest-ProjectMemberTests-923615420 None] Created reservations ['92082a92-2490-4df7-b35f-d8c957409f91', '8039e652-b762-4340-b9ff-856a738eaadb', '11b91918-f56b-4ece-b992-5bd5352e7d21', '9fddd9a2-a921-4980-aa4c-80d39b129c4e'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:51:19 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-430a0955-3a8e-478e-8650-0f22dace5d9c tempest-ProjectMemberTests-923615420 None] Delete snapshot completed successfully. Nov 03 07:51:19 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-430a0955-3a8e-478e-8650-0f22dace5d9c tempest-ProjectMemberTests-923615420 None] Lock "cinder-1e6c955d-c7ed-4bdf-bac6-92d77c93e0f7-delete_snapshot" released by "delete_snapshot" :: held 2.206s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:20 devstack sudo[107256]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3c885beb-34ff-484e-80c0-e754a9213a0e tempest-SnapshotDependencyTests-758997837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2a07d499-f559-4dd5-a760-d34fd7d99601,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2a07d499-f559-4dd5-a760-d34fd7d99601.796343bd-5a57-4d96-8b50-236a4140771b 1G" returned: 0 in 0.494s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3c885beb-34ff-484e-80c0-e754a9213a0e tempest-SnapshotDependencyTests-758997837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a07d499-f559-4dd5-a760-d34fd7d99601 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2a07d499-f559-4dd5-a760-d34fd7d99601.796343bd-5a57-4d96-8b50-236a4140771b {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:20 devstack sudo[107262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a07d499-f559-4dd5-a760-d34fd7d99601 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2a07d499-f559-4dd5-a760-d34fd7d99601.796343bd-5a57-4d96-8b50-236a4140771b Nov 03 07:51:20 devstack sudo[107262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:20 devstack sudo[107262]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3c885beb-34ff-484e-80c0-e754a9213a0e tempest-SnapshotDependencyTests-758997837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a07d499-f559-4dd5-a760-d34fd7d99601 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2a07d499-f559-4dd5-a760-d34fd7d99601.796343bd-5a57-4d96-8b50-236a4140771b" returned: 0 in 0.307s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:20 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-3c885beb-34ff-484e-80c0-e754a9213a0e tempest-SnapshotDependencyTests-758997837 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2a07d499-f559-4dd5-a760-d34fd7d99601.796343bd-5a57-4d96-8b50-236a4140771b is being set with open permissions: ugo+rw Nov 03 07:51:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3c885beb-34ff-484e-80c0-e754a9213a0e tempest-SnapshotDependencyTests-758997837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2a07d499-f559-4dd5-a760-d34fd7d99601.796343bd-5a57-4d96-8b50-236a4140771b {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:20 devstack sudo[107269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2a07d499-f559-4dd5-a760-d34fd7d99601.796343bd-5a57-4d96-8b50-236a4140771b Nov 03 07:51:20 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:20 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3c885beb-34ff-484e-80c0-e754a9213a0e tempest-SnapshotDependencyTests-758997837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2a07d499-f559-4dd5-a760-d34fd7d99601.796343bd-5a57-4d96-8b50-236a4140771b" returned: 0 in 0.278s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3c885beb-34ff-484e-80c0-e754a9213a0e tempest-SnapshotDependencyTests-758997837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2a07d499-f559-4dd5-a760-d34fd7d99601.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:20 devstack sudo[107272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2a07d499-f559-4dd5-a760-d34fd7d99601.info Nov 03 07:51:20 devstack sudo[107272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:20 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-75625c4d-a6c4-4529-b3ad-6cf4de226e46 tempest-ProjectMemberTests-923615420 None] Acquiring lock "cinder-2e676f7e-5b45-47b8-9ca2-4d1988b43220-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:20 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-75625c4d-a6c4-4529-b3ad-6cf4de226e46 tempest-ProjectMemberTests-923615420 None] Lock "cinder-2e676f7e-5b45-47b8-9ca2-4d1988b43220-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:20 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-75625c4d-a6c4-4529-b3ad-6cf4de226e46 tempest-ProjectMemberTests-923615420 None] Acquiring lock "cinder-quobyte-2e676f7e-5b45-47b8-9ca2-4d1988b43220" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:20 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-75625c4d-a6c4-4529-b3ad-6cf4de226e46 tempest-ProjectMemberTests-923615420 None] Lock "cinder-quobyte-2e676f7e-5b45-47b8-9ca2-4d1988b43220" acquired by "delete_volume" :: waited 0.025s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:21 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c3c5bf-cdbc-424c-bb26-3906b14b04cd]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-75625c4d-a6c4-4529-b3ad-6cf4de226e46 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2e676f7e-5b45-47b8-9ca2-4d1988b43220 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:21 devstack sudo[107274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2e676f7e-5b45-47b8-9ca2-4d1988b43220 Nov 03 07:51:21 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:21 devstack sudo[107272]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3c885beb-34ff-484e-80c0-e754a9213a0e tempest-SnapshotDependencyTests-758997837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2a07d499-f559-4dd5-a760-d34fd7d99601.info" returned: 0 in 0.319s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:21 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-3c885beb-34ff-484e-80c0-e754a9213a0e tempest-SnapshotDependencyTests-758997837 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2a07d499-f559-4dd5-a760-d34fd7d99601.info is being set with open permissions: ugo+rw Nov 03 07:51:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3c885beb-34ff-484e-80c0-e754a9213a0e tempest-SnapshotDependencyTests-758997837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2a07d499-f559-4dd5-a760-d34fd7d99601.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:21 devstack sudo[107277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2a07d499-f559-4dd5-a760-d34fd7d99601.info Nov 03 07:51:21 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:21 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-75625c4d-a6c4-4529-b3ad-6cf4de226e46 tempest-ProjectMemberTests-923615420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2e676f7e-5b45-47b8-9ca2-4d1988b43220" returned: 0 in 0.396s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-75625c4d-a6c4-4529-b3ad-6cf4de226e46 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2e676f7e-5b45-47b8-9ca2-4d1988b43220 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:21 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3c885beb-34ff-484e-80c0-e754a9213a0e tempest-SnapshotDependencyTests-758997837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2a07d499-f559-4dd5-a760-d34fd7d99601.info" returned: 0 in 0.280s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:21 devstack sudo[107283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2e676f7e-5b45-47b8-9ca2-4d1988b43220 Nov 03 07:51:21 devstack sudo[107283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3c885beb-34ff-484e-80c0-e754a9213a0e tempest-SnapshotDependencyTests-758997837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.386s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b4e2a92c-93fa-4cad-8964-cd832e71c4ac tempest-ProjectReaderTests-1379712565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.687s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:21 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b4e2a92c-93fa-4cad-8964-cd832e71c4ac tempest-ProjectReaderTests-1379712565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-668003243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4836cd4a-f52d-462a-934c-f1de31d243c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e063beebf62e4f73889c7cf7c63d85ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:51:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:51:20Z,use_quota=True,user_id='51c0eb5e9adb43cf9694fdbca9269bec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:51:21 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-b4e2a92c-93fa-4cad-8964-cd832e71c4ac tempest-ProjectReaderTests-1379712565 None] Creating volume 4836cd4a-f52d-462a-934c-f1de31d243c6 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:51:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b4e2a92c-93fa-4cad-8964-cd832e71c4ac tempest-ProjectReaderTests-1379712565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b4e2a92c-93fa-4cad-8964-cd832e71c4ac tempest-ProjectReaderTests-1379712565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:21 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b4e2a92c-93fa-4cad-8964-cd832e71c4ac tempest-ProjectReaderTests-1379712565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:21 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b4e2a92c-93fa-4cad-8964-cd832e71c4ac tempest-ProjectReaderTests-1379712565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b4e2a92c-93fa-4cad-8964-cd832e71c4ac tempest-ProjectReaderTests-1379712565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:21 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b4e2a92c-93fa-4cad-8964-cd832e71c4ac tempest-ProjectReaderTests-1379712565 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:51:21 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-b4e2a92c-93fa-4cad-8964-cd832e71c4ac tempest-ProjectReaderTests-1379712565 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:51:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b4e2a92c-93fa-4cad-8964-cd832e71c4ac tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4836cd4a-f52d-462a-934c-f1de31d243c6 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:21 devstack sudo[107285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4836cd4a-f52d-462a-934c-f1de31d243c6 1073741824 Nov 03 07:51:21 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:21 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-3c885beb-34ff-484e-80c0-e754a9213a0e tempest-SnapshotDependencyTests-758997837 None] Create snapshot completed successfully Nov 03 07:51:21 devstack sudo[107283]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-75625c4d-a6c4-4529-b3ad-6cf4de226e46 tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2e676f7e-5b45-47b8-9ca2-4d1988b43220" returned: 0 in 0.295s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:21 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-75625c4d-a6c4-4529-b3ad-6cf4de226e46 tempest-ProjectMemberTests-923615420 None] Lock "cinder-quobyte-2e676f7e-5b45-47b8-9ca2-4d1988b43220" released by "delete_volume" :: held 0.758s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:21 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-75625c4d-a6c4-4529-b3ad-6cf4de226e46 tempest-ProjectMemberTests-923615420 None] Created reservations ['37b9a77d-2953-404a-b89f-1a2243e03290', '0f1dac8b-b6b6-4473-bef8-68c76f776e5c', 'ae223ff3-4343-4e9e-aefa-2c0a4ce0c80c', '6361c1d3-445d-4039-8a5b-c6c1f7baf974'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:51:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-75625c4d-a6c4-4529-b3ad-6cf4de226e46 tempest-ProjectMemberTests-923615420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-75625c4d-a6c4-4529-b3ad-6cf4de226e46 tempest-ProjectMemberTests-923615420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:21 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-75625c4d-a6c4-4529-b3ad-6cf4de226e46 tempest-ProjectMemberTests-923615420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:21 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-75625c4d-a6c4-4529-b3ad-6cf4de226e46 tempest-ProjectMemberTests-923615420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-75625c4d-a6c4-4529-b3ad-6cf4de226e46 tempest-ProjectMemberTests-923615420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-75625c4d-a6c4-4529-b3ad-6cf4de226e46 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:21 devstack sudo[107292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:51:21 devstack sudo[107292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:22 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b4e2a92c-93fa-4cad-8964-cd832e71c4ac tempest-ProjectReaderTests-1379712565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4836cd4a-f52d-462a-934c-f1de31d243c6 1073741824" returned: 0 in 0.530s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b4e2a92c-93fa-4cad-8964-cd832e71c4ac tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4836cd4a-f52d-462a-934c-f1de31d243c6 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:22 devstack sudo[107294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4836cd4a-f52d-462a-934c-f1de31d243c6 Nov 03 07:51:22 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:22 devstack sudo[107292]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-75625c4d-a6c4-4529-b3ad-6cf4de226e46 tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.284s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:22 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-75625c4d-a6c4-4529-b3ad-6cf4de226e46 tempest-ProjectMemberTests-923615420 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:51:22 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-75625c4d-a6c4-4529-b3ad-6cf4de226e46 tempest-ProjectMemberTests-923615420 None] Deleted volume successfully. Nov 03 07:51:22 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-75625c4d-a6c4-4529-b3ad-6cf4de226e46 tempest-ProjectMemberTests-923615420 None] Lock "cinder-2e676f7e-5b45-47b8-9ca2-4d1988b43220-delete_volume" released by "delete_volume" :: held 1.295s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:22 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b4e2a92c-93fa-4cad-8964-cd832e71c4ac tempest-ProjectReaderTests-1379712565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4836cd4a-f52d-462a-934c-f1de31d243c6" returned: 0 in 0.317s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:22 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b4e2a92c-93fa-4cad-8964-cd832e71c4ac tempest-ProjectReaderTests-1379712565 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:51:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b4e2a92c-93fa-4cad-8964-cd832e71c4ac tempest-ProjectReaderTests-1379712565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:22 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b4e2a92c-93fa-4cad-8964-cd832e71c4ac tempest-ProjectReaderTests-1379712565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61bebd14-c478-48d7-9079-2e855b7767dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4836cd4a-f52d-462a-934c-f1de31d243c6', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:22 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b4e2a92c-93fa-4cad-8964-cd832e71c4ac tempest-ProjectReaderTests-1379712565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (135d68c0-9629-48cb-afe6-05775855a348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:22 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-b4e2a92c-93fa-4cad-8964-cd832e71c4ac tempest-ProjectReaderTests-1379712565 None] Volume volume-4836cd4a-f52d-462a-934c-f1de31d243c6 (4836cd4a-f52d-462a-934c-f1de31d243c6): created successfully Nov 03 07:51:22 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b4e2a92c-93fa-4cad-8964-cd832e71c4ac tempest-ProjectReaderTests-1379712565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (135d68c0-9629-48cb-afe6-05775855a348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:22 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b4e2a92c-93fa-4cad-8964-cd832e71c4ac tempest-ProjectReaderTests-1379712565 None] Flow 'volume_create_manager' (4c2e282e-48d3-4f49-8237-08adcd0c1ac5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:22 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-b4e2a92c-93fa-4cad-8964-cd832e71c4ac tempest-ProjectReaderTests-1379712565 None] Created volume successfully. Nov 03 07:51:22 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ae1eeca-3b83-4289-965a-cf8c9651b047 tempest-ProjectMemberTests-923615420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:51:22 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0ae1eeca-3b83-4289-965a-cf8c9651b047 tempest-ProjectMemberTests-923615420 None] Flow 'volume_create_manager' (44e67d65-e2c5-4f21-853a-61d7c86574ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:22 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0ae1eeca-3b83-4289-965a-cf8c9651b047 tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d45ca999-df49-4d6f-8307-04bff9cfb3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:22 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0ae1eeca-3b83-4289-965a-cf8c9651b047 tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d45ca999-df49-4d6f-8307-04bff9cfb3e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:51:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-817365007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cab7e1f-00e5-4b9c-8346-895681df7534,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed2c0b7d26474c8aaafc23b6762bdc56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:51:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:51:23Z,use_quota=True,user_id='7d2824260e354882bea7f7a6989d9f16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:22 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0ae1eeca-3b83-4289-965a-cf8c9651b047 tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70aa707e-2ca6-4620-9cd2-be7c929cfa48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:22 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0ae1eeca-3b83-4289-965a-cf8c9651b047 tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70aa707e-2ca6-4620-9cd2-be7c929cfa48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:22 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0ae1eeca-3b83-4289-965a-cf8c9651b047 tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5adcff4-9c35-4c8c-ad32-8b60bd39d2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:22 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0ae1eeca-3b83-4289-965a-cf8c9651b047 tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5adcff4-9c35-4c8c-ad32-8b60bd39d2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cab7e1f-00e5-4b9c-8346-895681df7534', 'volume_name': 'volume-7cab7e1f-00e5-4b9c-8346-895681df7534', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:22 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0ae1eeca-3b83-4289-965a-cf8c9651b047 tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d767da3-5218-4748-b547-49009fad168c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:22 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0ae1eeca-3b83-4289-965a-cf8c9651b047 tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d767da3-5218-4748-b547-49009fad168c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:22 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0ae1eeca-3b83-4289-965a-cf8c9651b047 tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83f0b21a-0046-4a9b-a452-f5f1ca8f19d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:22 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-0ae1eeca-3b83-4289-965a-cf8c9651b047 tempest-ProjectMemberTests-923615420 None] Volume 7cab7e1f-00e5-4b9c-8346-895681df7534: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cab7e1f-00e5-4b9c-8346-895681df7534', 'volume_size': 1} Nov 03 07:51:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0ae1eeca-3b83-4289-965a-cf8c9651b047 tempest-ProjectMemberTests-923615420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0ae1eeca-3b83-4289-965a-cf8c9651b047 tempest-ProjectMemberTests-923615420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:22 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-0ae1eeca-3b83-4289-965a-cf8c9651b047 tempest-ProjectMemberTests-923615420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:51:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-817365007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cab7e1f-00e5-4b9c-8346-895681df7534,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed2c0b7d26474c8aaafc23b6762bdc56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:51:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:51:23Z,use_quota=True,user_id='7d2824260e354882bea7f7a6989d9f16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:51:22 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-0ae1eeca-3b83-4289-965a-cf8c9651b047 tempest-ProjectMemberTests-923615420 None] Creating volume 7cab7e1f-00e5-4b9c-8346-895681df7534 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:51:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0ae1eeca-3b83-4289-965a-cf8c9651b047 tempest-ProjectMemberTests-923615420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0ae1eeca-3b83-4289-965a-cf8c9651b047 tempest-ProjectMemberTests-923615420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:22 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-0ae1eeca-3b83-4289-965a-cf8c9651b047 tempest-ProjectMemberTests-923615420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:22 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-0ae1eeca-3b83-4289-965a-cf8c9651b047 tempest-ProjectMemberTests-923615420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0ae1eeca-3b83-4289-965a-cf8c9651b047 tempest-ProjectMemberTests-923615420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:22 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-0ae1eeca-3b83-4289-965a-cf8c9651b047 tempest-ProjectMemberTests-923615420 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:51:22 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-0ae1eeca-3b83-4289-965a-cf8c9651b047 tempest-ProjectMemberTests-923615420 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:51:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0ae1eeca-3b83-4289-965a-cf8c9651b047 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7cab7e1f-00e5-4b9c-8346-895681df7534 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:22 devstack sudo[107298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7cab7e1f-00e5-4b9c-8346-895681df7534 1073741824 Nov 03 07:51:22 devstack sudo[107298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-c72f2869-00e2-4b43-9923-5766904400af tempest-ProjectReaderTests-1379712565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:23 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-43e5c3eb-ab7a-441a-9d02-71f30559ca58 tempest-SnapshotDependencyTests-758997837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:51:23 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-43e5c3eb-ab7a-441a-9d02-71f30559ca58 tempest-SnapshotDependencyTests-758997837 None] Flow 'volume_create_manager' (75c61995-c7a0-4491-bc7f-29c4f79c2a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:23 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-43e5c3eb-ab7a-441a-9d02-71f30559ca58 tempest-SnapshotDependencyTests-758997837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbcc29e3-7c6c-4660-9db1-e93393f7c17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:23 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-43e5c3eb-ab7a-441a-9d02-71f30559ca58 tempest-SnapshotDependencyTests-758997837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbcc29e3-7c6c-4660-9db1-e93393f7c17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:51:23Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7864fc9-70ea-4a54-b57b-0cb653bc57d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0eeba35bc37f470ba93fae21b5e23a74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:51:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=796343bd-5a57-4d96-8b50-236a4140771b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:51:23Z,use_quota=True,user_id='f9ad5eb603b8431db45050e979f6e85a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:23 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-43e5c3eb-ab7a-441a-9d02-71f30559ca58 tempest-SnapshotDependencyTests-758997837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56a6f529-39c4-4739-a52a-86c679e61894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:23 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-43e5c3eb-ab7a-441a-9d02-71f30559ca58 tempest-SnapshotDependencyTests-758997837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56a6f529-39c4-4739-a52a-86c679e61894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:23 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-43e5c3eb-ab7a-441a-9d02-71f30559ca58 tempest-SnapshotDependencyTests-758997837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (232ed5fc-05d8-48a4-88fd-b46994b35e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:23 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-43e5c3eb-ab7a-441a-9d02-71f30559ca58 tempest-SnapshotDependencyTests-758997837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (232ed5fc-05d8-48a4-88fd-b46994b35e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c7864fc9-70ea-4a54-b57b-0cb653bc57d4', 'volume_name': 'volume-c7864fc9-70ea-4a54-b57b-0cb653bc57d4', 'volume_size': 1, 'snapshot_id': '796343bd-5a57-4d96-8b50-236a4140771b'}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:23 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-43e5c3eb-ab7a-441a-9d02-71f30559ca58 tempest-SnapshotDependencyTests-758997837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dc90176-e054-454f-81c2-d32234bd1e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:23 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-43e5c3eb-ab7a-441a-9d02-71f30559ca58 tempest-SnapshotDependencyTests-758997837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dc90176-e054-454f-81c2-d32234bd1e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:23 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-43e5c3eb-ab7a-441a-9d02-71f30559ca58 tempest-SnapshotDependencyTests-758997837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49977e91-2b29-457d-8fe8-bf42abb362c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:23 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-43e5c3eb-ab7a-441a-9d02-71f30559ca58 tempest-SnapshotDependencyTests-758997837 None] Volume c7864fc9-70ea-4a54-b57b-0cb653bc57d4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c7864fc9-70ea-4a54-b57b-0cb653bc57d4', 'volume_size': 1, 'snapshot_id': '796343bd-5a57-4d96-8b50-236a4140771b'} Nov 03 07:51:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-43e5c3eb-ab7a-441a-9d02-71f30559ca58 tempest-SnapshotDependencyTests-758997837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:23 devstack sudo[107298]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0ae1eeca-3b83-4289-965a-cf8c9651b047 tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7cab7e1f-00e5-4b9c-8346-895681df7534 1073741824" returned: 0 in 0.584s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0ae1eeca-3b83-4289-965a-cf8c9651b047 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7cab7e1f-00e5-4b9c-8346-895681df7534 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:23 devstack sudo[107304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7cab7e1f-00e5-4b9c-8346-895681df7534 Nov 03 07:51:23 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:23 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0ae1eeca-3b83-4289-965a-cf8c9651b047 tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7cab7e1f-00e5-4b9c-8346-895681df7534" returned: 0 in 0.261s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:23 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-0ae1eeca-3b83-4289-965a-cf8c9651b047 tempest-ProjectMemberTests-923615420 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:51:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0ae1eeca-3b83-4289-965a-cf8c9651b047 tempest-ProjectMemberTests-923615420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-c72f2869-00e2-4b43-9923-5766904400af tempest-ProjectReaderTests-1379712565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.520s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:23 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-c72f2869-00e2-4b43-9923-5766904400af tempest-ProjectReaderTests-1379712565 None] Creating offline snapshot acf9d05b-52ef-4add-8bff-cfc5267b27bf of volume 4836cd4a-f52d-462a-934c-f1de31d243c6 {{(pid=86875) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:51:23 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0ae1eeca-3b83-4289-965a-cf8c9651b047 tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83f0b21a-0046-4a9b-a452-f5f1ca8f19d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cab7e1f-00e5-4b9c-8346-895681df7534', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:23 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0ae1eeca-3b83-4289-965a-cf8c9651b047 tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91e6be8c-8b5d-444d-ad23-1521162437af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:23 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0019669-daf4-483a-b686-111e7830d344]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c72f2869-00e2-4b43-9923-5766904400af tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4836cd4a-f52d-462a-934c-f1de31d243c6 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:23 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-0ae1eeca-3b83-4289-965a-cf8c9651b047 tempest-ProjectMemberTests-923615420 None] Volume volume-7cab7e1f-00e5-4b9c-8346-895681df7534 (7cab7e1f-00e5-4b9c-8346-895681df7534): created successfully Nov 03 07:51:23 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0ae1eeca-3b83-4289-965a-cf8c9651b047 tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91e6be8c-8b5d-444d-ad23-1521162437af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:23 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-0ae1eeca-3b83-4289-965a-cf8c9651b047 tempest-ProjectMemberTests-923615420 None] Flow 'volume_create_manager' (44e67d65-e2c5-4f21-853a-61d7c86574ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:23 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-0ae1eeca-3b83-4289-965a-cf8c9651b047 tempest-ProjectMemberTests-923615420 None] Created volume successfully. Nov 03 07:51:23 devstack sudo[107307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4836cd4a-f52d-462a-934c-f1de31d243c6 Nov 03 07:51:23 devstack sudo[107307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:24 devstack sudo[107307]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c72f2869-00e2-4b43-9923-5766904400af tempest-ProjectReaderTests-1379712565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4836cd4a-f52d-462a-934c-f1de31d243c6" returned: 0 in 0.405s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c72f2869-00e2-4b43-9923-5766904400af tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4836cd4a-f52d-462a-934c-f1de31d243c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4836cd4a-f52d-462a-934c-f1de31d243c6.acf9d05b-52ef-4add-8bff-cfc5267b27bf 1G {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:24 devstack sudo[107312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4836cd4a-f52d-462a-934c-f1de31d243c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4836cd4a-f52d-462a-934c-f1de31d243c6.acf9d05b-52ef-4add-8bff-cfc5267b27bf 1G Nov 03 07:51:24 devstack sudo[107312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:24 devstack sudo[107312]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c72f2869-00e2-4b43-9923-5766904400af tempest-ProjectReaderTests-1379712565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4836cd4a-f52d-462a-934c-f1de31d243c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4836cd4a-f52d-462a-934c-f1de31d243c6.acf9d05b-52ef-4add-8bff-cfc5267b27bf 1G" returned: 0 in 0.451s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c72f2869-00e2-4b43-9923-5766904400af tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4836cd4a-f52d-462a-934c-f1de31d243c6 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4836cd4a-f52d-462a-934c-f1de31d243c6.acf9d05b-52ef-4add-8bff-cfc5267b27bf {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:24 devstack sudo[107317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4836cd4a-f52d-462a-934c-f1de31d243c6 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4836cd4a-f52d-462a-934c-f1de31d243c6.acf9d05b-52ef-4add-8bff-cfc5267b27bf Nov 03 07:51:24 devstack sudo[107317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:24 devstack sudo[107317]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c72f2869-00e2-4b43-9923-5766904400af tempest-ProjectReaderTests-1379712565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4836cd4a-f52d-462a-934c-f1de31d243c6 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4836cd4a-f52d-462a-934c-f1de31d243c6.acf9d05b-52ef-4add-8bff-cfc5267b27bf" returned: 0 in 0.328s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:24 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-c72f2869-00e2-4b43-9923-5766904400af tempest-ProjectReaderTests-1379712565 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4836cd4a-f52d-462a-934c-f1de31d243c6.acf9d05b-52ef-4add-8bff-cfc5267b27bf is being set with open permissions: ugo+rw Nov 03 07:51:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c72f2869-00e2-4b43-9923-5766904400af tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4836cd4a-f52d-462a-934c-f1de31d243c6.acf9d05b-52ef-4add-8bff-cfc5267b27bf {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:24 devstack sudo[107322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4836cd4a-f52d-462a-934c-f1de31d243c6.acf9d05b-52ef-4add-8bff-cfc5267b27bf Nov 03 07:51:24 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b2c2ae2b-0dfc-40b4-91a6-49fa04a984bf tempest-ProjectMemberTests-923615420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:25 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c72f2869-00e2-4b43-9923-5766904400af tempest-ProjectReaderTests-1379712565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4836cd4a-f52d-462a-934c-f1de31d243c6.acf9d05b-52ef-4add-8bff-cfc5267b27bf" returned: 0 in 0.274s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c72f2869-00e2-4b43-9923-5766904400af tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4836cd4a-f52d-462a-934c-f1de31d243c6.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:25 devstack sudo[107325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4836cd4a-f52d-462a-934c-f1de31d243c6.info Nov 03 07:51:25 devstack sudo[107325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:25 devstack sudo[107325]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c72f2869-00e2-4b43-9923-5766904400af tempest-ProjectReaderTests-1379712565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4836cd4a-f52d-462a-934c-f1de31d243c6.info" returned: 0 in 0.266s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:25 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-c72f2869-00e2-4b43-9923-5766904400af tempest-ProjectReaderTests-1379712565 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4836cd4a-f52d-462a-934c-f1de31d243c6.info is being set with open permissions: ugo+rw Nov 03 07:51:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c72f2869-00e2-4b43-9923-5766904400af tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4836cd4a-f52d-462a-934c-f1de31d243c6.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:25 devstack sudo[107328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4836cd4a-f52d-462a-934c-f1de31d243c6.info Nov 03 07:51:25 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:25 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c72f2869-00e2-4b43-9923-5766904400af tempest-ProjectReaderTests-1379712565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4836cd4a-f52d-462a-934c-f1de31d243c6.info" returned: 0 in 0.278s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-c72f2869-00e2-4b43-9923-5766904400af tempest-ProjectReaderTests-1379712565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.122s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-43e5c3eb-ab7a-441a-9d02-71f30559ca58 tempest-SnapshotDependencyTests-758997837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.508s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:25 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-43e5c3eb-ab7a-441a-9d02-71f30559ca58 tempest-SnapshotDependencyTests-758997837 None] Acquiring lock "cinder-quobyte-796343bd-5a57-4d96-8b50-236a4140771b-c7864fc9-70ea-4a54-b57b-0cb653bc57d4" by "_create_volume_from_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:25 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-43e5c3eb-ab7a-441a-9d02-71f30559ca58 tempest-SnapshotDependencyTests-758997837 None] Lock "cinder-quobyte-796343bd-5a57-4d96-8b50-236a4140771b-c7864fc9-70ea-4a54-b57b-0cb653bc57d4" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:25 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-43e5c3eb-ab7a-441a-9d02-71f30559ca58 tempest-SnapshotDependencyTests-758997837 None] Creating volume c7864fc9-70ea-4a54-b57b-0cb653bc57d4 from snapshot 796343bd-5a57-4d96-8b50-236a4140771b {{(pid=86875) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 07:51:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-43e5c3eb-ab7a-441a-9d02-71f30559ca58 tempest-SnapshotDependencyTests-758997837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-43e5c3eb-ab7a-441a-9d02-71f30559ca58 tempest-SnapshotDependencyTests-758997837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:25 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-43e5c3eb-ab7a-441a-9d02-71f30559ca58 tempest-SnapshotDependencyTests-758997837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:25 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-43e5c3eb-ab7a-441a-9d02-71f30559ca58 tempest-SnapshotDependencyTests-758997837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-43e5c3eb-ab7a-441a-9d02-71f30559ca58 tempest-SnapshotDependencyTests-758997837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:25 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-43e5c3eb-ab7a-441a-9d02-71f30559ca58 tempest-SnapshotDependencyTests-758997837 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:51:25 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-43e5c3eb-ab7a-441a-9d02-71f30559ca58 tempest-SnapshotDependencyTests-758997837 None] Acquiring lock "cinder-quobyte-c7864fc9-70ea-4a54-b57b-0cb653bc57d4" by "_copy_volume_from_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:25 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-c72f2869-00e2-4b43-9923-5766904400af tempest-ProjectReaderTests-1379712565 None] Create snapshot completed successfully Nov 03 07:51:25 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-43e5c3eb-ab7a-441a-9d02-71f30559ca58 tempest-SnapshotDependencyTests-758997837 None] Lock "cinder-quobyte-c7864fc9-70ea-4a54-b57b-0cb653bc57d4" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:25 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-43e5c3eb-ab7a-441a-9d02-71f30559ca58 tempest-SnapshotDependencyTests-758997837 None] snapshot: 796343bd-5a57-4d96-8b50-236a4140771b, volume: c7864fc9-70ea-4a54-b57b-0cb653bc57d4, {{(pid=86875) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 07:51:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-43e5c3eb-ab7a-441a-9d02-71f30559ca58 tempest-SnapshotDependencyTests-758997837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-43e5c3eb-ab7a-441a-9d02-71f30559ca58 tempest-SnapshotDependencyTests-758997837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:25 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-43e5c3eb-ab7a-441a-9d02-71f30559ca58 tempest-SnapshotDependencyTests-758997837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:25 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-43e5c3eb-ab7a-441a-9d02-71f30559ca58 tempest-SnapshotDependencyTests-758997837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-43e5c3eb-ab7a-441a-9d02-71f30559ca58 tempest-SnapshotDependencyTests-758997837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:25 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8724c9c-22f1-4196-b883-ca0ba6801434]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-43e5c3eb-ab7a-441a-9d02-71f30559ca58 tempest-SnapshotDependencyTests-758997837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2a07d499-f559-4dd5-a760-d34fd7d99601.796343bd-5a57-4d96-8b50-236a4140771b {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:26 devstack sudo[107331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2a07d499-f559-4dd5-a760-d34fd7d99601.796343bd-5a57-4d96-8b50-236a4140771b Nov 03 07:51:26 devstack sudo[107331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:26 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-6cc0bc62-2169-424a-9e1c-a8ebe77b876a tempest-ProjectReaderTests-1379712565 None] Acquiring lock "cinder-acf9d05b-52ef-4add-8bff-cfc5267b27bf-delete_snapshot" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:26 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-6cc0bc62-2169-424a-9e1c-a8ebe77b876a tempest-ProjectReaderTests-1379712565 None] Lock "cinder-acf9d05b-52ef-4add-8bff-cfc5267b27bf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:26 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-6cc0bc62-2169-424a-9e1c-a8ebe77b876a tempest-ProjectReaderTests-1379712565 None] Acquiring lock "cinder-quobyte-4836cd4a-f52d-462a-934c-f1de31d243c6" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:26 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-6cc0bc62-2169-424a-9e1c-a8ebe77b876a tempest-ProjectReaderTests-1379712565 None] Lock "cinder-quobyte-4836cd4a-f52d-462a-934c-f1de31d243c6" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:26 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-6cc0bc62-2169-424a-9e1c-a8ebe77b876a tempest-ProjectReaderTests-1379712565 None] Acquiring lock "cinder-quobyte-acf9d05b-52ef-4add-8bff-cfc5267b27bf" by "_delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:26 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-6cc0bc62-2169-424a-9e1c-a8ebe77b876a tempest-ProjectReaderTests-1379712565 None] Lock "cinder-quobyte-acf9d05b-52ef-4add-8bff-cfc5267b27bf" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:26 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-6cc0bc62-2169-424a-9e1c-a8ebe77b876a tempest-ProjectReaderTests-1379712565 None] Deleting offline snapshot acf9d05b-52ef-4add-8bff-cfc5267b27bf of volume 4836cd4a-f52d-462a-934c-f1de31d243c6 {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:51:26 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-6cc0bc62-2169-424a-9e1c-a8ebe77b876a tempest-ProjectReaderTests-1379712565 None] snapshot_file for this snap is: volume-4836cd4a-f52d-462a-934c-f1de31d243c6.acf9d05b-52ef-4add-8bff-cfc5267b27bf {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:51:26 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[299c1d3f-08ce-4683-8933-d04a99b43785]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:26 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6cc0bc62-2169-424a-9e1c-a8ebe77b876a tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4836cd4a-f52d-462a-934c-f1de31d243c6.acf9d05b-52ef-4add-8bff-cfc5267b27bf {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:26 devstack sudo[107331]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:26 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-43e5c3eb-ab7a-441a-9d02-71f30559ca58 tempest-SnapshotDependencyTests-758997837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2a07d499-f559-4dd5-a760-d34fd7d99601.796343bd-5a57-4d96-8b50-236a4140771b" returned: 0 in 0.429s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:26 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-43e5c3eb-ab7a-441a-9d02-71f30559ca58 tempest-SnapshotDependencyTests-758997837 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a07d499-f559-4dd5-a760-d34fd7d99601(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:51:26 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[743cb646-e77c-42d4-8a45-bb4fa20d382f]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:26 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-43e5c3eb-ab7a-441a-9d02-71f30559ca58 tempest-SnapshotDependencyTests-758997837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2a07d499-f559-4dd5-a760-d34fd7d99601 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:26 devstack sudo[107336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4836cd4a-f52d-462a-934c-f1de31d243c6.acf9d05b-52ef-4add-8bff-cfc5267b27bf Nov 03 07:51:26 devstack sudo[107336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:26 devstack sudo[107337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2a07d499-f559-4dd5-a760-d34fd7d99601 Nov 03 07:51:26 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:26 devstack sudo[107336]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:26 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6cc0bc62-2169-424a-9e1c-a8ebe77b876a tempest-ProjectReaderTests-1379712565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4836cd4a-f52d-462a-934c-f1de31d243c6.acf9d05b-52ef-4add-8bff-cfc5267b27bf" returned: 0 in 0.393s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:26 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-6cc0bc62-2169-424a-9e1c-a8ebe77b876a tempest-ProjectReaderTests-1379712565 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4836cd4a-f52d-462a-934c-f1de31d243c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:51:26 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a112db-71aa-46a7-be70-c50da443421b]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:26 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6cc0bc62-2169-424a-9e1c-a8ebe77b876a tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4836cd4a-f52d-462a-934c-f1de31d243c6 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:26 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:26 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-43e5c3eb-ab7a-441a-9d02-71f30559ca58 tempest-SnapshotDependencyTests-758997837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2a07d499-f559-4dd5-a760-d34fd7d99601" returned: 0 in 0.405s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:26 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-43e5c3eb-ab7a-441a-9d02-71f30559ca58 tempest-SnapshotDependencyTests-758997837 None] will copy from snapshot at /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2a07d499-f559-4dd5-a760-d34fd7d99601 {{(pid=86875) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 07:51:26 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-43e5c3eb-ab7a-441a-9d02-71f30559ca58 tempest-SnapshotDependencyTests-758997837 None] Creating direct copy from snapshot {{(pid=86875) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 07:51:26 devstack cinder-volume[86875]: DEBUG cinder.utils [None req-43e5c3eb-ab7a-441a-9d02-71f30559ca58 tempest-SnapshotDependencyTests-758997837 None] Path /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c7864fc9-70ea-4a54-b57b-0cb653bc57d4 not found in is_blk_device check {{(pid=86875) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 07:51:26 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-43e5c3eb-ab7a-441a-9d02-71f30559ca58 tempest-SnapshotDependencyTests-758997837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2a07d499-f559-4dd5-a760-d34fd7d99601 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c7864fc9-70ea-4a54-b57b-0cb653bc57d4 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:26 devstack sudo[107348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2a07d499-f559-4dd5-a760-d34fd7d99601 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c7864fc9-70ea-4a54-b57b-0cb653bc57d4 Nov 03 07:51:26 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:26 devstack sudo[107347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4836cd4a-f52d-462a-934c-f1de31d243c6 Nov 03 07:51:26 devstack sudo[107347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:27 devstack sudo[107347]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6cc0bc62-2169-424a-9e1c-a8ebe77b876a tempest-ProjectReaderTests-1379712565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4836cd4a-f52d-462a-934c-f1de31d243c6" returned: 0 in 0.402s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6cc0bc62-2169-424a-9e1c-a8ebe77b876a tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4836cd4a-f52d-462a-934c-f1de31d243c6.acf9d05b-52ef-4add-8bff-cfc5267b27bf {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:27 devstack sudo[107359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4836cd4a-f52d-462a-934c-f1de31d243c6.acf9d05b-52ef-4add-8bff-cfc5267b27bf Nov 03 07:51:27 devstack sudo[107359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:27 devstack sudo[107359]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6cc0bc62-2169-424a-9e1c-a8ebe77b876a tempest-ProjectReaderTests-1379712565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4836cd4a-f52d-462a-934c-f1de31d243c6.acf9d05b-52ef-4add-8bff-cfc5267b27bf" returned: 0 in 0.740s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6cc0bc62-2169-424a-9e1c-a8ebe77b876a tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4836cd4a-f52d-462a-934c-f1de31d243c6.acf9d05b-52ef-4add-8bff-cfc5267b27bf {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:27 devstack sudo[107371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4836cd4a-f52d-462a-934c-f1de31d243c6.acf9d05b-52ef-4add-8bff-cfc5267b27bf Nov 03 07:51:27 devstack sudo[107371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:28 devstack sudo[107371]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6cc0bc62-2169-424a-9e1c-a8ebe77b876a tempest-ProjectReaderTests-1379712565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4836cd4a-f52d-462a-934c-f1de31d243c6.acf9d05b-52ef-4add-8bff-cfc5267b27bf" returned: 0 in 0.389s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:28 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-6cc0bc62-2169-424a-9e1c-a8ebe77b876a tempest-ProjectReaderTests-1379712565 None] Lock "cinder-quobyte-acf9d05b-52ef-4add-8bff-cfc5267b27bf" released by "_delete_snapshot" :: held 2.101s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:28 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-6cc0bc62-2169-424a-9e1c-a8ebe77b876a tempest-ProjectReaderTests-1379712565 None] Lock "cinder-quobyte-4836cd4a-f52d-462a-934c-f1de31d243c6" released by "delete_snapshot" :: held 2.129s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:28 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-6cc0bc62-2169-424a-9e1c-a8ebe77b876a tempest-ProjectReaderTests-1379712565 None] Created reservations ['8bafad35-59c6-4cec-8455-07123db82b05', 'aec40305-d8c9-446c-a276-b6e9c3c8c35d', '4fdd07ba-9428-419a-bdc3-12fc82ac94ee', '0259b1ea-eb16-4a10-8b2e-082767460bf5'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:51:28 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-6cc0bc62-2169-424a-9e1c-a8ebe77b876a tempest-ProjectReaderTests-1379712565 None] Delete snapshot completed successfully. Nov 03 07:51:28 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-6cc0bc62-2169-424a-9e1c-a8ebe77b876a tempest-ProjectReaderTests-1379712565 None] Lock "cinder-acf9d05b-52ef-4add-8bff-cfc5267b27bf-delete_snapshot" released by "delete_snapshot" :: held 2.347s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:29 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-b629e4c1-dcc7-4543-a6d1-45b75efd2a9e tempest-ProjectReaderTests-1379712565 None] Acquiring lock "cinder-4836cd4a-f52d-462a-934c-f1de31d243c6-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:29 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-b629e4c1-dcc7-4543-a6d1-45b75efd2a9e tempest-ProjectReaderTests-1379712565 None] Lock "cinder-4836cd4a-f52d-462a-934c-f1de31d243c6-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:29 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-b629e4c1-dcc7-4543-a6d1-45b75efd2a9e tempest-ProjectReaderTests-1379712565 None] Acquiring lock "cinder-quobyte-4836cd4a-f52d-462a-934c-f1de31d243c6" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:29 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-b629e4c1-dcc7-4543-a6d1-45b75efd2a9e tempest-ProjectReaderTests-1379712565 None] Lock "cinder-quobyte-4836cd4a-f52d-462a-934c-f1de31d243c6" acquired by "delete_volume" :: waited 0.030s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:29 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d38c0c-bb0a-45c7-8574-62c4d16241aa]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:29 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b629e4c1-dcc7-4543-a6d1-45b75efd2a9e tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4836cd4a-f52d-462a-934c-f1de31d243c6 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:30 devstack sudo[107410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4836cd4a-f52d-462a-934c-f1de31d243c6 Nov 03 07:51:30 devstack sudo[107410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:30 devstack sudo[107410]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b629e4c1-dcc7-4543-a6d1-45b75efd2a9e tempest-ProjectReaderTests-1379712565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4836cd4a-f52d-462a-934c-f1de31d243c6" returned: 0 in 0.650s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b629e4c1-dcc7-4543-a6d1-45b75efd2a9e tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4836cd4a-f52d-462a-934c-f1de31d243c6 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:30 devstack sudo[107418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4836cd4a-f52d-462a-934c-f1de31d243c6 Nov 03 07:51:30 devstack sudo[107418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:30 devstack sudo[107418]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b629e4c1-dcc7-4543-a6d1-45b75efd2a9e tempest-ProjectReaderTests-1379712565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-4836cd4a-f52d-462a-934c-f1de31d243c6" returned: 0 in 0.395s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:30 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-b629e4c1-dcc7-4543-a6d1-45b75efd2a9e tempest-ProjectReaderTests-1379712565 None] Lock "cinder-quobyte-4836cd4a-f52d-462a-934c-f1de31d243c6" released by "delete_volume" :: held 1.184s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:31 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-b629e4c1-dcc7-4543-a6d1-45b75efd2a9e tempest-ProjectReaderTests-1379712565 None] Created reservations ['ba523329-96c8-4cda-89c7-4c532b7e85ba', 'c5c11de3-c0c7-4d79-95c4-1952417cd4f9', '401fd4d9-5a46-41b7-bc6f-abcbd7c4aa77', '6293cb79-8433-470a-887d-de950a94bb08'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:51:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b629e4c1-dcc7-4543-a6d1-45b75efd2a9e tempest-ProjectReaderTests-1379712565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b629e4c1-dcc7-4543-a6d1-45b75efd2a9e tempest-ProjectReaderTests-1379712565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:31 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b629e4c1-dcc7-4543-a6d1-45b75efd2a9e tempest-ProjectReaderTests-1379712565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:31 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b629e4c1-dcc7-4543-a6d1-45b75efd2a9e tempest-ProjectReaderTests-1379712565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b629e4c1-dcc7-4543-a6d1-45b75efd2a9e tempest-ProjectReaderTests-1379712565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b629e4c1-dcc7-4543-a6d1-45b75efd2a9e tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:31 devstack sudo[107421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:51:31 devstack sudo[107421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:31 devstack sudo[107421]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b629e4c1-dcc7-4543-a6d1-45b75efd2a9e tempest-ProjectReaderTests-1379712565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.459s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:31 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-b629e4c1-dcc7-4543-a6d1-45b75efd2a9e tempest-ProjectReaderTests-1379712565 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:51:31 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-b629e4c1-dcc7-4543-a6d1-45b75efd2a9e tempest-ProjectReaderTests-1379712565 None] Deleted volume successfully. Nov 03 07:51:31 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-b629e4c1-dcc7-4543-a6d1-45b75efd2a9e tempest-ProjectReaderTests-1379712565 None] Lock "cinder-4836cd4a-f52d-462a-934c-f1de31d243c6-delete_volume" released by "delete_volume" :: held 2.082s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:32 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb68fedc-6601-4420-af6d-57ab27389950 tempest-ProjectReaderTests-1379712565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:51:33 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fb68fedc-6601-4420-af6d-57ab27389950 tempest-ProjectReaderTests-1379712565 None] Flow 'volume_create_manager' (84fb3e2d-d115-423b-8975-9f70e8989b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:33 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fb68fedc-6601-4420-af6d-57ab27389950 tempest-ProjectReaderTests-1379712565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b3a3ca6-f047-4121-abf1-602d689c4efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:33 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fb68fedc-6601-4420-af6d-57ab27389950 tempest-ProjectReaderTests-1379712565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b3a3ca6-f047-4121-abf1-602d689c4efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:51:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2122663682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39e9f20d-9f90-4255-8224-2011d7b72153,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e063beebf62e4f73889c7cf7c63d85ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:51:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:51:33Z,use_quota=True,user_id='51c0eb5e9adb43cf9694fdbca9269bec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:33 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fb68fedc-6601-4420-af6d-57ab27389950 tempest-ProjectReaderTests-1379712565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b63d23b9-ae04-41ca-b429-fafc4ac15741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:33 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fb68fedc-6601-4420-af6d-57ab27389950 tempest-ProjectReaderTests-1379712565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b63d23b9-ae04-41ca-b429-fafc4ac15741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:33 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fb68fedc-6601-4420-af6d-57ab27389950 tempest-ProjectReaderTests-1379712565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (035c15a9-813b-439f-aefe-430412e9aacb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:33 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fb68fedc-6601-4420-af6d-57ab27389950 tempest-ProjectReaderTests-1379712565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (035c15a9-813b-439f-aefe-430412e9aacb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39e9f20d-9f90-4255-8224-2011d7b72153', 'volume_name': 'volume-39e9f20d-9f90-4255-8224-2011d7b72153', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:33 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fb68fedc-6601-4420-af6d-57ab27389950 tempest-ProjectReaderTests-1379712565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eec5be4-5cc6-434b-a4d6-010a1abbb01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:33 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fb68fedc-6601-4420-af6d-57ab27389950 tempest-ProjectReaderTests-1379712565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eec5be4-5cc6-434b-a4d6-010a1abbb01f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:33 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fb68fedc-6601-4420-af6d-57ab27389950 tempest-ProjectReaderTests-1379712565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c531e17e-2abd-4cb8-8b0f-e1a74a3d8dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:33 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-fb68fedc-6601-4420-af6d-57ab27389950 tempest-ProjectReaderTests-1379712565 None] Volume 39e9f20d-9f90-4255-8224-2011d7b72153: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39e9f20d-9f90-4255-8224-2011d7b72153', 'volume_size': 1} Nov 03 07:51:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-fb68fedc-6601-4420-af6d-57ab27389950 tempest-ProjectReaderTests-1379712565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:34 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-43e5c3eb-ab7a-441a-9d02-71f30559ca58 tempest-SnapshotDependencyTests-758997837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2a07d499-f559-4dd5-a760-d34fd7d99601 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c7864fc9-70ea-4a54-b57b-0cb653bc57d4" returned: 0 in 7.503s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:34 devstack cinder-volume[86875]: DEBUG cinder.image.image_utils [None req-43e5c3eb-ab7a-441a-9d02-71f30559ca58 tempest-SnapshotDependencyTests-758997837 None] Image conversion details: src /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2a07d499-f559-4dd5-a760-d34fd7d99601, size 1024.00 MB, duration 7.50 sec, destination /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c7864fc9-70ea-4a54-b57b-0cb653bc57d4 {{(pid=86875) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 07:51:34 devstack cinder-volume[86875]: INFO cinder.image.image_utils [None req-43e5c3eb-ab7a-441a-9d02-71f30559ca58 tempest-SnapshotDependencyTests-758997837 None] Converted 1024.00 MB image at 136.46 MB/s Nov 03 07:51:34 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-43e5c3eb-ab7a-441a-9d02-71f30559ca58 tempest-SnapshotDependencyTests-758997837 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c7864fc9-70ea-4a54-b57b-0cb653bc57d4 is being set with open permissions: ugo+rw Nov 03 07:51:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-43e5c3eb-ab7a-441a-9d02-71f30559ca58 tempest-SnapshotDependencyTests-758997837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c7864fc9-70ea-4a54-b57b-0cb653bc57d4 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:34 devstack sudo[107424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c7864fc9-70ea-4a54-b57b-0cb653bc57d4 Nov 03 07:51:34 devstack sudo[107424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:34 devstack sudo[107424]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-43e5c3eb-ab7a-441a-9d02-71f30559ca58 tempest-SnapshotDependencyTests-758997837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c7864fc9-70ea-4a54-b57b-0cb653bc57d4" returned: 0 in 0.235s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:34 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-43e5c3eb-ab7a-441a-9d02-71f30559ca58 tempest-SnapshotDependencyTests-758997837 None] Lock "cinder-quobyte-c7864fc9-70ea-4a54-b57b-0cb653bc57d4" released by "_copy_volume_from_snapshot" :: held 8.666s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:34 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-43e5c3eb-ab7a-441a-9d02-71f30559ca58 tempest-SnapshotDependencyTests-758997837 None] Lock "cinder-quobyte-796343bd-5a57-4d96-8b50-236a4140771b-c7864fc9-70ea-4a54-b57b-0cb653bc57d4" released by "_create_volume_from_snapshot" :: held 8.739s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-43e5c3eb-ab7a-441a-9d02-71f30559ca58 tempest-SnapshotDependencyTests-758997837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.773s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b2c2ae2b-0dfc-40b4-91a6-49fa04a984bf tempest-ProjectMemberTests-923615420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.613s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:34 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-b2c2ae2b-0dfc-40b4-91a6-49fa04a984bf tempest-ProjectMemberTests-923615420 None] Creating offline snapshot af23c337-708d-4e0f-ba5c-42518b637d21 of volume 7cab7e1f-00e5-4b9c-8346-895681df7534 {{(pid=86875) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:51:34 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-43e5c3eb-ab7a-441a-9d02-71f30559ca58 tempest-SnapshotDependencyTests-758997837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49977e91-2b29-457d-8fe8-bf42abb362c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7864fc9-70ea-4a54-b57b-0cb653bc57d4', 'volume_size': 1, 'snapshot_id': '796343bd-5a57-4d96-8b50-236a4140771b'}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:34 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-43e5c3eb-ab7a-441a-9d02-71f30559ca58 tempest-SnapshotDependencyTests-758997837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9475b09d-af33-488c-a150-47dfef26e4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:34 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f88e174-c388-4905-9041-6ade03d0482e]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b2c2ae2b-0dfc-40b4-91a6-49fa04a984bf tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7cab7e1f-00e5-4b9c-8346-895681df7534 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:34 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-43e5c3eb-ab7a-441a-9d02-71f30559ca58 tempest-SnapshotDependencyTests-758997837 None] Volume volume-c7864fc9-70ea-4a54-b57b-0cb653bc57d4 (c7864fc9-70ea-4a54-b57b-0cb653bc57d4): created successfully Nov 03 07:51:34 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-43e5c3eb-ab7a-441a-9d02-71f30559ca58 tempest-SnapshotDependencyTests-758997837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9475b09d-af33-488c-a150-47dfef26e4a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:34 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-43e5c3eb-ab7a-441a-9d02-71f30559ca58 tempest-SnapshotDependencyTests-758997837 None] Flow 'volume_create_manager' (75c61995-c7a0-4491-bc7f-29c4f79c2a67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:34 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-43e5c3eb-ab7a-441a-9d02-71f30559ca58 tempest-SnapshotDependencyTests-758997837 None] Created volume successfully. Nov 03 07:51:34 devstack sudo[107428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7cab7e1f-00e5-4b9c-8346-895681df7534 Nov 03 07:51:34 devstack sudo[107428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:34 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-e8e57f86-22a6-43b5-ba35-1509f5e9faf9 tempest-SnapshotDependencyTests-758997837 None] Acquiring lock "cinder-796343bd-5a57-4d96-8b50-236a4140771b-delete_snapshot" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:35 devstack sudo[107428]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:35 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-e8e57f86-22a6-43b5-ba35-1509f5e9faf9 tempest-SnapshotDependencyTests-758997837 None] Lock "cinder-796343bd-5a57-4d96-8b50-236a4140771b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:35 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-e8e57f86-22a6-43b5-ba35-1509f5e9faf9 tempest-SnapshotDependencyTests-758997837 None] Acquiring lock "cinder-quobyte-2a07d499-f559-4dd5-a760-d34fd7d99601" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b2c2ae2b-0dfc-40b4-91a6-49fa04a984bf tempest-ProjectMemberTests-923615420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7cab7e1f-00e5-4b9c-8346-895681df7534" returned: 0 in 0.373s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b2c2ae2b-0dfc-40b4-91a6-49fa04a984bf tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7cab7e1f-00e5-4b9c-8346-895681df7534,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7cab7e1f-00e5-4b9c-8346-895681df7534.af23c337-708d-4e0f-ba5c-42518b637d21 1G {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:35 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-e8e57f86-22a6-43b5-ba35-1509f5e9faf9 tempest-SnapshotDependencyTests-758997837 None] Lock "cinder-quobyte-2a07d499-f559-4dd5-a760-d34fd7d99601" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:35 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-e8e57f86-22a6-43b5-ba35-1509f5e9faf9 tempest-SnapshotDependencyTests-758997837 None] Acquiring lock "cinder-quobyte-796343bd-5a57-4d96-8b50-236a4140771b" by "_delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:35 devstack sudo[107433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7cab7e1f-00e5-4b9c-8346-895681df7534,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7cab7e1f-00e5-4b9c-8346-895681df7534.af23c337-708d-4e0f-ba5c-42518b637d21 1G Nov 03 07:51:35 devstack sudo[107433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:35 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-e8e57f86-22a6-43b5-ba35-1509f5e9faf9 tempest-SnapshotDependencyTests-758997837 None] Lock "cinder-quobyte-796343bd-5a57-4d96-8b50-236a4140771b" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:35 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-e8e57f86-22a6-43b5-ba35-1509f5e9faf9 tempest-SnapshotDependencyTests-758997837 None] Deleting offline snapshot 796343bd-5a57-4d96-8b50-236a4140771b of volume 2a07d499-f559-4dd5-a760-d34fd7d99601 {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:51:35 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-e8e57f86-22a6-43b5-ba35-1509f5e9faf9 tempest-SnapshotDependencyTests-758997837 None] snapshot_file for this snap is: volume-2a07d499-f559-4dd5-a760-d34fd7d99601.796343bd-5a57-4d96-8b50-236a4140771b {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:51:35 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[b007ca74-2d00-4fd3-805b-f2d0b76d1433]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e8e57f86-22a6-43b5-ba35-1509f5e9faf9 tempest-SnapshotDependencyTests-758997837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2a07d499-f559-4dd5-a760-d34fd7d99601.796343bd-5a57-4d96-8b50-236a4140771b {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:35 devstack sudo[107435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2a07d499-f559-4dd5-a760-d34fd7d99601.796343bd-5a57-4d96-8b50-236a4140771b Nov 03 07:51:35 devstack sudo[107435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:35 devstack sudo[107433]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b2c2ae2b-0dfc-40b4-91a6-49fa04a984bf tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7cab7e1f-00e5-4b9c-8346-895681df7534,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7cab7e1f-00e5-4b9c-8346-895681df7534.af23c337-708d-4e0f-ba5c-42518b637d21 1G" returned: 0 in 0.382s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b2c2ae2b-0dfc-40b4-91a6-49fa04a984bf tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cab7e1f-00e5-4b9c-8346-895681df7534 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7cab7e1f-00e5-4b9c-8346-895681df7534.af23c337-708d-4e0f-ba5c-42518b637d21 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:35 devstack sudo[107443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cab7e1f-00e5-4b9c-8346-895681df7534 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7cab7e1f-00e5-4b9c-8346-895681df7534.af23c337-708d-4e0f-ba5c-42518b637d21 Nov 03 07:51:35 devstack sudo[107443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:35 devstack sudo[107435]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e8e57f86-22a6-43b5-ba35-1509f5e9faf9 tempest-SnapshotDependencyTests-758997837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2a07d499-f559-4dd5-a760-d34fd7d99601.796343bd-5a57-4d96-8b50-236a4140771b" returned: 0 in 0.373s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:35 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-e8e57f86-22a6-43b5-ba35-1509f5e9faf9 tempest-SnapshotDependencyTests-758997837 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a07d499-f559-4dd5-a760-d34fd7d99601(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:51:35 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[793f65cc-b34c-426d-b649-70657291d789]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e8e57f86-22a6-43b5-ba35-1509f5e9faf9 tempest-SnapshotDependencyTests-758997837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2a07d499-f559-4dd5-a760-d34fd7d99601 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:35 devstack sudo[107445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2a07d499-f559-4dd5-a760-d34fd7d99601 Nov 03 07:51:35 devstack sudo[107445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:35 devstack sudo[107443]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b2c2ae2b-0dfc-40b4-91a6-49fa04a984bf tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cab7e1f-00e5-4b9c-8346-895681df7534 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7cab7e1f-00e5-4b9c-8346-895681df7534.af23c337-708d-4e0f-ba5c-42518b637d21" returned: 0 in 0.282s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:35 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-b2c2ae2b-0dfc-40b4-91a6-49fa04a984bf tempest-ProjectMemberTests-923615420 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7cab7e1f-00e5-4b9c-8346-895681df7534.af23c337-708d-4e0f-ba5c-42518b637d21 is being set with open permissions: ugo+rw Nov 03 07:51:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b2c2ae2b-0dfc-40b4-91a6-49fa04a984bf tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7cab7e1f-00e5-4b9c-8346-895681df7534.af23c337-708d-4e0f-ba5c-42518b637d21 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:35 devstack sudo[107450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7cab7e1f-00e5-4b9c-8346-895681df7534.af23c337-708d-4e0f-ba5c-42518b637d21 Nov 03 07:51:35 devstack sudo[107450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:35 devstack sudo[107450]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b2c2ae2b-0dfc-40b4-91a6-49fa04a984bf tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7cab7e1f-00e5-4b9c-8346-895681df7534.af23c337-708d-4e0f-ba5c-42518b637d21" returned: 0 in 0.269s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b2c2ae2b-0dfc-40b4-91a6-49fa04a984bf tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7cab7e1f-00e5-4b9c-8346-895681df7534.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:36 devstack sudo[107456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7cab7e1f-00e5-4b9c-8346-895681df7534.info Nov 03 07:51:36 devstack sudo[107456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:36 devstack sudo[107445]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:36 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e8e57f86-22a6-43b5-ba35-1509f5e9faf9 tempest-SnapshotDependencyTests-758997837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2a07d499-f559-4dd5-a760-d34fd7d99601" returned: 0 in 0.524s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:36 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e8e57f86-22a6-43b5-ba35-1509f5e9faf9 tempest-SnapshotDependencyTests-758997837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2a07d499-f559-4dd5-a760-d34fd7d99601.796343bd-5a57-4d96-8b50-236a4140771b {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:36 devstack sudo[107458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2a07d499-f559-4dd5-a760-d34fd7d99601.796343bd-5a57-4d96-8b50-236a4140771b Nov 03 07:51:36 devstack sudo[107458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:36 devstack sudo[107456]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:36 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b2c2ae2b-0dfc-40b4-91a6-49fa04a984bf tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7cab7e1f-00e5-4b9c-8346-895681df7534.info" returned: 0 in 0.247s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:36 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-b2c2ae2b-0dfc-40b4-91a6-49fa04a984bf tempest-ProjectMemberTests-923615420 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7cab7e1f-00e5-4b9c-8346-895681df7534.info is being set with open permissions: ugo+rw Nov 03 07:51:36 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b2c2ae2b-0dfc-40b4-91a6-49fa04a984bf tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7cab7e1f-00e5-4b9c-8346-895681df7534.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:36 devstack sudo[107463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7cab7e1f-00e5-4b9c-8346-895681df7534.info Nov 03 07:51:36 devstack sudo[107463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:36 devstack sudo[107458]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:36 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e8e57f86-22a6-43b5-ba35-1509f5e9faf9 tempest-SnapshotDependencyTests-758997837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2a07d499-f559-4dd5-a760-d34fd7d99601.796343bd-5a57-4d96-8b50-236a4140771b" returned: 0 in 0.327s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:36 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e8e57f86-22a6-43b5-ba35-1509f5e9faf9 tempest-SnapshotDependencyTests-758997837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2a07d499-f559-4dd5-a760-d34fd7d99601.796343bd-5a57-4d96-8b50-236a4140771b {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:36 devstack sudo[107466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2a07d499-f559-4dd5-a760-d34fd7d99601.796343bd-5a57-4d96-8b50-236a4140771b Nov 03 07:51:36 devstack sudo[107466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:36 devstack sudo[107463]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:36 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b2c2ae2b-0dfc-40b4-91a6-49fa04a984bf tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7cab7e1f-00e5-4b9c-8346-895681df7534.info" returned: 0 in 0.234s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:36 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b2c2ae2b-0dfc-40b4-91a6-49fa04a984bf tempest-ProjectMemberTests-923615420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.881s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:36 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-fb68fedc-6601-4420-af6d-57ab27389950 tempest-ProjectReaderTests-1379712565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.279s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:36 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-fb68fedc-6601-4420-af6d-57ab27389950 tempest-ProjectReaderTests-1379712565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:51:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2122663682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39e9f20d-9f90-4255-8224-2011d7b72153,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e063beebf62e4f73889c7cf7c63d85ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:51:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:51:33Z,use_quota=True,user_id='51c0eb5e9adb43cf9694fdbca9269bec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:51:36 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-fb68fedc-6601-4420-af6d-57ab27389950 tempest-ProjectReaderTests-1379712565 None] Creating volume 39e9f20d-9f90-4255-8224-2011d7b72153 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:51:36 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-fb68fedc-6601-4420-af6d-57ab27389950 tempest-ProjectReaderTests-1379712565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:36 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-fb68fedc-6601-4420-af6d-57ab27389950 tempest-ProjectReaderTests-1379712565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:36 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-fb68fedc-6601-4420-af6d-57ab27389950 tempest-ProjectReaderTests-1379712565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:36 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-fb68fedc-6601-4420-af6d-57ab27389950 tempest-ProjectReaderTests-1379712565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:36 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-fb68fedc-6601-4420-af6d-57ab27389950 tempest-ProjectReaderTests-1379712565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:36 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-fb68fedc-6601-4420-af6d-57ab27389950 tempest-ProjectReaderTests-1379712565 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:51:36 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-fb68fedc-6601-4420-af6d-57ab27389950 tempest-ProjectReaderTests-1379712565 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:51:36 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fb68fedc-6601-4420-af6d-57ab27389950 tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-39e9f20d-9f90-4255-8224-2011d7b72153 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:36 devstack sudo[107469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-39e9f20d-9f90-4255-8224-2011d7b72153 1073741824 Nov 03 07:51:36 devstack sudo[107469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:36 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-b2c2ae2b-0dfc-40b4-91a6-49fa04a984bf tempest-ProjectMemberTests-923615420 None] Create snapshot completed successfully Nov 03 07:51:36 devstack sudo[107466]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:36 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e8e57f86-22a6-43b5-ba35-1509f5e9faf9 tempest-SnapshotDependencyTests-758997837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2a07d499-f559-4dd5-a760-d34fd7d99601.796343bd-5a57-4d96-8b50-236a4140771b" returned: 0 in 0.244s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:36 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-e8e57f86-22a6-43b5-ba35-1509f5e9faf9 tempest-SnapshotDependencyTests-758997837 None] Lock "cinder-quobyte-796343bd-5a57-4d96-8b50-236a4140771b" released by "_delete_snapshot" :: held 1.573s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:36 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-e8e57f86-22a6-43b5-ba35-1509f5e9faf9 tempest-SnapshotDependencyTests-758997837 None] Lock "cinder-quobyte-2a07d499-f559-4dd5-a760-d34fd7d99601" released by "delete_snapshot" :: held 1.593s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:36 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-e8e57f86-22a6-43b5-ba35-1509f5e9faf9 tempest-SnapshotDependencyTests-758997837 None] Created reservations ['5981b109-d6d3-43c7-92f8-aae4d9e63c53', '0aa72da9-c3f2-43e6-a6f7-2112e2c17db5', '069e2d32-e732-4f2d-bb24-857418f93ba7', 'a0a9f859-447d-4b11-9221-757c1c432920'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:51:36 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-e8e57f86-22a6-43b5-ba35-1509f5e9faf9 tempest-SnapshotDependencyTests-758997837 None] Delete snapshot completed successfully. Nov 03 07:51:36 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-e8e57f86-22a6-43b5-ba35-1509f5e9faf9 tempest-SnapshotDependencyTests-758997837 None] Lock "cinder-796343bd-5a57-4d96-8b50-236a4140771b-delete_snapshot" released by "delete_snapshot" :: held 1.740s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:36 devstack sudo[107469]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:36 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fb68fedc-6601-4420-af6d-57ab27389950 tempest-ProjectReaderTests-1379712565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-39e9f20d-9f90-4255-8224-2011d7b72153 1073741824" returned: 0 in 0.424s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:36 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fb68fedc-6601-4420-af6d-57ab27389950 tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-39e9f20d-9f90-4255-8224-2011d7b72153 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:36 devstack sudo[107477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-39e9f20d-9f90-4255-8224-2011d7b72153 Nov 03 07:51:36 devstack sudo[107477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:37 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-8c7e8842-4688-4df2-89ec-9896046530c3 tempest-SnapshotDependencyTests-758997837 None] Acquiring lock "cinder-2a07d499-f559-4dd5-a760-d34fd7d99601-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:37 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-8c7e8842-4688-4df2-89ec-9896046530c3 tempest-SnapshotDependencyTests-758997837 None] Lock "cinder-2a07d499-f559-4dd5-a760-d34fd7d99601-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:37 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-8c7e8842-4688-4df2-89ec-9896046530c3 tempest-SnapshotDependencyTests-758997837 None] Acquiring lock "cinder-quobyte-2a07d499-f559-4dd5-a760-d34fd7d99601" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:37 devstack sudo[107477]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fb68fedc-6601-4420-af6d-57ab27389950 tempest-ProjectReaderTests-1379712565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-39e9f20d-9f90-4255-8224-2011d7b72153" returned: 0 in 0.252s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:37 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-fb68fedc-6601-4420-af6d-57ab27389950 tempest-ProjectReaderTests-1379712565 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:51:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-fb68fedc-6601-4420-af6d-57ab27389950 tempest-ProjectReaderTests-1379712565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:37 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fb68fedc-6601-4420-af6d-57ab27389950 tempest-ProjectReaderTests-1379712565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c531e17e-2abd-4cb8-8b0f-e1a74a3d8dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39e9f20d-9f90-4255-8224-2011d7b72153', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:37 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fb68fedc-6601-4420-af6d-57ab27389950 tempest-ProjectReaderTests-1379712565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0c862e7-b54e-467f-9a60-97624ecff589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:37 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-8c7e8842-4688-4df2-89ec-9896046530c3 tempest-SnapshotDependencyTests-758997837 None] Lock "cinder-quobyte-2a07d499-f559-4dd5-a760-d34fd7d99601" acquired by "delete_volume" :: waited 0.031s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:37 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-fb68fedc-6601-4420-af6d-57ab27389950 tempest-ProjectReaderTests-1379712565 None] Volume volume-39e9f20d-9f90-4255-8224-2011d7b72153 (39e9f20d-9f90-4255-8224-2011d7b72153): created successfully Nov 03 07:51:37 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fb68fedc-6601-4420-af6d-57ab27389950 tempest-ProjectReaderTests-1379712565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0c862e7-b54e-467f-9a60-97624ecff589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:37 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-fb68fedc-6601-4420-af6d-57ab27389950 tempest-ProjectReaderTests-1379712565 None] Flow 'volume_create_manager' (84fb3e2d-d115-423b-8975-9f70e8989b5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:37 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e66a3e-cb55-4c62-a563-8c190f2b7bc4]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8c7e8842-4688-4df2-89ec-9896046530c3 tempest-SnapshotDependencyTests-758997837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2a07d499-f559-4dd5-a760-d34fd7d99601 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:37 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-fb68fedc-6601-4420-af6d-57ab27389950 tempest-ProjectReaderTests-1379712565 None] Created volume successfully. Nov 03 07:51:37 devstack sudo[107481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2a07d499-f559-4dd5-a760-d34fd7d99601 Nov 03 07:51:37 devstack sudo[107481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:37 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-6f1015aa-d602-4a1c-8cf3-bd3c8ed08341 tempest-ProjectMemberTests-923615420 None] Acquiring lock "cinder-af23c337-708d-4e0f-ba5c-42518b637d21-delete_snapshot" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:37 devstack sudo[107481]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:37 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-6f1015aa-d602-4a1c-8cf3-bd3c8ed08341 tempest-ProjectMemberTests-923615420 None] Lock "cinder-af23c337-708d-4e0f-ba5c-42518b637d21-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:37 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-6f1015aa-d602-4a1c-8cf3-bd3c8ed08341 tempest-ProjectMemberTests-923615420 None] Acquiring lock "cinder-quobyte-7cab7e1f-00e5-4b9c-8346-895681df7534" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8c7e8842-4688-4df2-89ec-9896046530c3 tempest-SnapshotDependencyTests-758997837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2a07d499-f559-4dd5-a760-d34fd7d99601" returned: 0 in 0.359s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8c7e8842-4688-4df2-89ec-9896046530c3 tempest-SnapshotDependencyTests-758997837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2a07d499-f559-4dd5-a760-d34fd7d99601 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:37 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-6f1015aa-d602-4a1c-8cf3-bd3c8ed08341 tempest-ProjectMemberTests-923615420 None] Lock "cinder-quobyte-7cab7e1f-00e5-4b9c-8346-895681df7534" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:37 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-6f1015aa-d602-4a1c-8cf3-bd3c8ed08341 tempest-ProjectMemberTests-923615420 None] Acquiring lock "cinder-quobyte-af23c337-708d-4e0f-ba5c-42518b637d21" by "_delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:37 devstack sudo[107486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2a07d499-f559-4dd5-a760-d34fd7d99601 Nov 03 07:51:37 devstack sudo[107486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:37 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-6f1015aa-d602-4a1c-8cf3-bd3c8ed08341 tempest-ProjectMemberTests-923615420 None] Lock "cinder-quobyte-af23c337-708d-4e0f-ba5c-42518b637d21" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:37 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-6f1015aa-d602-4a1c-8cf3-bd3c8ed08341 tempest-ProjectMemberTests-923615420 None] Deleting offline snapshot af23c337-708d-4e0f-ba5c-42518b637d21 of volume 7cab7e1f-00e5-4b9c-8346-895681df7534 {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:51:37 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-6f1015aa-d602-4a1c-8cf3-bd3c8ed08341 tempest-ProjectMemberTests-923615420 None] snapshot_file for this snap is: volume-7cab7e1f-00e5-4b9c-8346-895681df7534.af23c337-708d-4e0f-ba5c-42518b637d21 {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:51:37 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[481b2a1c-7bf5-47af-a153-9fbe0cab63f1]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6f1015aa-d602-4a1c-8cf3-bd3c8ed08341 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7cab7e1f-00e5-4b9c-8346-895681df7534.af23c337-708d-4e0f-ba5c-42518b637d21 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:37 devstack sudo[107488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7cab7e1f-00e5-4b9c-8346-895681df7534.af23c337-708d-4e0f-ba5c-42518b637d21 Nov 03 07:51:37 devstack sudo[107488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:37 devstack sudo[107486]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:37 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8c7e8842-4688-4df2-89ec-9896046530c3 tempest-SnapshotDependencyTests-758997837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-2a07d499-f559-4dd5-a760-d34fd7d99601" returned: 0 in 0.267s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:37 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-8c7e8842-4688-4df2-89ec-9896046530c3 tempest-SnapshotDependencyTests-758997837 None] Lock "cinder-quobyte-2a07d499-f559-4dd5-a760-d34fd7d99601" released by "delete_volume" :: held 0.702s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:37 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-8c7e8842-4688-4df2-89ec-9896046530c3 tempest-SnapshotDependencyTests-758997837 None] Created reservations ['1d8b6a7c-4bff-49e0-ad6f-55827760d4ed', 'f145650f-eb1e-4b0d-9378-b9228a05e53b', 'fe31b741-0c53-4d02-83ff-9e2cb20145f8', '8313d065-2e9b-413b-9291-5fba770150a1'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:51:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-8c7e8842-4688-4df2-89ec-9896046530c3 tempest-SnapshotDependencyTests-758997837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-8c7e8842-4688-4df2-89ec-9896046530c3 tempest-SnapshotDependencyTests-758997837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:38 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-8c7e8842-4688-4df2-89ec-9896046530c3 tempest-SnapshotDependencyTests-758997837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:38 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-8c7e8842-4688-4df2-89ec-9896046530c3 tempest-SnapshotDependencyTests-758997837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-8c7e8842-4688-4df2-89ec-9896046530c3 tempest-SnapshotDependencyTests-758997837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8c7e8842-4688-4df2-89ec-9896046530c3 tempest-SnapshotDependencyTests-758997837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:38 devstack sudo[107493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:51:38 devstack sudo[107493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:38 devstack sudo[107488]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6f1015aa-d602-4a1c-8cf3-bd3c8ed08341 tempest-ProjectMemberTests-923615420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7cab7e1f-00e5-4b9c-8346-895681df7534.af23c337-708d-4e0f-ba5c-42518b637d21" returned: 0 in 0.418s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:38 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-6f1015aa-d602-4a1c-8cf3-bd3c8ed08341 tempest-ProjectMemberTests-923615420 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7cab7e1f-00e5-4b9c-8346-895681df7534(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:51:38 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a9a54e-1c67-4d17-84b5-04c3227c1c5b]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6f1015aa-d602-4a1c-8cf3-bd3c8ed08341 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7cab7e1f-00e5-4b9c-8346-895681df7534 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0c3e4ba7-a28b-4c40-9e64-f5304c88964a tempest-ProjectReaderTests-1379712565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0c3e4ba7-a28b-4c40-9e64-f5304c88964a tempest-ProjectReaderTests-1379712565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:38 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-0c3e4ba7-a28b-4c40-9e64-f5304c88964a tempest-ProjectReaderTests-1379712565 None] Creating offline snapshot 4077ecd1-8bd9-47c4-a1d3-da1b00b313fe of volume 39e9f20d-9f90-4255-8224-2011d7b72153 {{(pid=86875) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:51:38 devstack sudo[107497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7cab7e1f-00e5-4b9c-8346-895681df7534 Nov 03 07:51:38 devstack sudo[107497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:38 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-3a17c4ab-ea21-416d-8cec-f21e04926792 tempest-SnapshotDependencyTests-758997837 None] Acquiring lock "cinder-c7864fc9-70ea-4a54-b57b-0cb653bc57d4-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:38 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[8230d549-4bec-4c02-8127-96da6e4d0d24]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:38 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-3a17c4ab-ea21-416d-8cec-f21e04926792 tempest-SnapshotDependencyTests-758997837 None] Lock "cinder-c7864fc9-70ea-4a54-b57b-0cb653bc57d4-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0c3e4ba7-a28b-4c40-9e64-f5304c88964a tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-39e9f20d-9f90-4255-8224-2011d7b72153 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:38 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-3a17c4ab-ea21-416d-8cec-f21e04926792 tempest-SnapshotDependencyTests-758997837 None] Acquiring lock "cinder-quobyte-c7864fc9-70ea-4a54-b57b-0cb653bc57d4" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:38 devstack sudo[107493]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8c7e8842-4688-4df2-89ec-9896046530c3 tempest-SnapshotDependencyTests-758997837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.379s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:38 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-8c7e8842-4688-4df2-89ec-9896046530c3 tempest-SnapshotDependencyTests-758997837 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:51:38 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-3a17c4ab-ea21-416d-8cec-f21e04926792 tempest-SnapshotDependencyTests-758997837 None] Lock "cinder-quobyte-c7864fc9-70ea-4a54-b57b-0cb653bc57d4" acquired by "delete_volume" :: waited 0.023s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:38 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-8c7e8842-4688-4df2-89ec-9896046530c3 tempest-SnapshotDependencyTests-758997837 None] Deleted volume successfully. Nov 03 07:51:38 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[72868e4b-7e76-4efb-9324-5d6bd8798cf8]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3a17c4ab-ea21-416d-8cec-f21e04926792 tempest-SnapshotDependencyTests-758997837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c7864fc9-70ea-4a54-b57b-0cb653bc57d4 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:38 devstack sudo[107500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-39e9f20d-9f90-4255-8224-2011d7b72153 Nov 03 07:51:38 devstack sudo[107500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:38 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-8c7e8842-4688-4df2-89ec-9896046530c3 tempest-SnapshotDependencyTests-758997837 None] Lock "cinder-2a07d499-f559-4dd5-a760-d34fd7d99601-delete_volume" released by "delete_volume" :: held 1.347s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:38 devstack sudo[107501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c7864fc9-70ea-4a54-b57b-0cb653bc57d4 Nov 03 07:51:38 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:38 devstack sudo[107497]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6f1015aa-d602-4a1c-8cf3-bd3c8ed08341 tempest-ProjectMemberTests-923615420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7cab7e1f-00e5-4b9c-8346-895681df7534" returned: 0 in 0.441s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6f1015aa-d602-4a1c-8cf3-bd3c8ed08341 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7cab7e1f-00e5-4b9c-8346-895681df7534.af23c337-708d-4e0f-ba5c-42518b637d21 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:38 devstack sudo[107507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7cab7e1f-00e5-4b9c-8346-895681df7534.af23c337-708d-4e0f-ba5c-42518b637d21 Nov 03 07:51:38 devstack sudo[107507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:38 devstack sudo[107500]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0c3e4ba7-a28b-4c40-9e64-f5304c88964a tempest-ProjectReaderTests-1379712565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-39e9f20d-9f90-4255-8224-2011d7b72153" returned: 0 in 0.392s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0c3e4ba7-a28b-4c40-9e64-f5304c88964a tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-39e9f20d-9f90-4255-8224-2011d7b72153,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-39e9f20d-9f90-4255-8224-2011d7b72153.4077ecd1-8bd9-47c4-a1d3-da1b00b313fe 1G {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:38 devstack sudo[107512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-39e9f20d-9f90-4255-8224-2011d7b72153,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-39e9f20d-9f90-4255-8224-2011d7b72153.4077ecd1-8bd9-47c4-a1d3-da1b00b313fe 1G Nov 03 07:51:38 devstack sudo[107512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:38 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3a17c4ab-ea21-416d-8cec-f21e04926792 tempest-SnapshotDependencyTests-758997837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c7864fc9-70ea-4a54-b57b-0cb653bc57d4" returned: 0 in 0.385s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3a17c4ab-ea21-416d-8cec-f21e04926792 tempest-SnapshotDependencyTests-758997837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c7864fc9-70ea-4a54-b57b-0cb653bc57d4 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:38 devstack sudo[107520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c7864fc9-70ea-4a54-b57b-0cb653bc57d4 Nov 03 07:51:38 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:38 devstack sudo[107507]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6f1015aa-d602-4a1c-8cf3-bd3c8ed08341 tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7cab7e1f-00e5-4b9c-8346-895681df7534.af23c337-708d-4e0f-ba5c-42518b637d21" returned: 0 in 0.344s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:38 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6f1015aa-d602-4a1c-8cf3-bd3c8ed08341 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7cab7e1f-00e5-4b9c-8346-895681df7534.af23c337-708d-4e0f-ba5c-42518b637d21 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:38 devstack sudo[107522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7cab7e1f-00e5-4b9c-8346-895681df7534.af23c337-708d-4e0f-ba5c-42518b637d21 Nov 03 07:51:39 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:39 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3a17c4ab-ea21-416d-8cec-f21e04926792 tempest-SnapshotDependencyTests-758997837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-c7864fc9-70ea-4a54-b57b-0cb653bc57d4" returned: 0 in 0.273s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:39 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-3a17c4ab-ea21-416d-8cec-f21e04926792 tempest-SnapshotDependencyTests-758997837 None] Lock "cinder-quobyte-c7864fc9-70ea-4a54-b57b-0cb653bc57d4" released by "delete_volume" :: held 0.709s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:39 devstack sudo[107512]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0c3e4ba7-a28b-4c40-9e64-f5304c88964a tempest-ProjectReaderTests-1379712565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-39e9f20d-9f90-4255-8224-2011d7b72153,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-39e9f20d-9f90-4255-8224-2011d7b72153.4077ecd1-8bd9-47c4-a1d3-da1b00b313fe 1G" returned: 0 in 0.400s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0c3e4ba7-a28b-4c40-9e64-f5304c88964a tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39e9f20d-9f90-4255-8224-2011d7b72153 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-39e9f20d-9f90-4255-8224-2011d7b72153.4077ecd1-8bd9-47c4-a1d3-da1b00b313fe {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:39 devstack sudo[107528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39e9f20d-9f90-4255-8224-2011d7b72153 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-39e9f20d-9f90-4255-8224-2011d7b72153.4077ecd1-8bd9-47c4-a1d3-da1b00b313fe Nov 03 07:51:39 devstack sudo[107528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:39 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6f1015aa-d602-4a1c-8cf3-bd3c8ed08341 tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7cab7e1f-00e5-4b9c-8346-895681df7534.af23c337-708d-4e0f-ba5c-42518b637d21" returned: 0 in 0.256s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:39 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-3a17c4ab-ea21-416d-8cec-f21e04926792 tempest-SnapshotDependencyTests-758997837 None] Created reservations ['5621010b-9b23-4756-9a21-fb5f7844f17f', '42ad3060-864c-4569-847e-0983ddb4f7dc', '3f83f056-b75e-48d5-9668-b2047756eece', '509a5fde-76bc-4238-bd89-3c69fb97891c'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:51:39 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-6f1015aa-d602-4a1c-8cf3-bd3c8ed08341 tempest-ProjectMemberTests-923615420 None] Lock "cinder-quobyte-af23c337-708d-4e0f-ba5c-42518b637d21" released by "_delete_snapshot" :: held 1.585s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:39 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-6f1015aa-d602-4a1c-8cf3-bd3c8ed08341 tempest-ProjectMemberTests-923615420 None] Lock "cinder-quobyte-7cab7e1f-00e5-4b9c-8346-895681df7534" released by "delete_snapshot" :: held 1.619s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3a17c4ab-ea21-416d-8cec-f21e04926792 tempest-SnapshotDependencyTests-758997837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3a17c4ab-ea21-416d-8cec-f21e04926792 tempest-SnapshotDependencyTests-758997837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:39 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-3a17c4ab-ea21-416d-8cec-f21e04926792 tempest-SnapshotDependencyTests-758997837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:39 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-3a17c4ab-ea21-416d-8cec-f21e04926792 tempest-SnapshotDependencyTests-758997837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3a17c4ab-ea21-416d-8cec-f21e04926792 tempest-SnapshotDependencyTests-758997837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3a17c4ab-ea21-416d-8cec-f21e04926792 tempest-SnapshotDependencyTests-758997837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:39 devstack sudo[107531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:51:39 devstack sudo[107531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:39 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-6f1015aa-d602-4a1c-8cf3-bd3c8ed08341 tempest-ProjectMemberTests-923615420 None] Created reservations ['8c4414b2-9a70-437a-a277-684b19ba7867', '53946cdd-7af3-4292-b276-d93e3292d091', '451080af-1780-43d3-bc57-bf32ed85114b', '3080bacf-749d-4a39-8229-49190558a650'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:51:39 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-6f1015aa-d602-4a1c-8cf3-bd3c8ed08341 tempest-ProjectMemberTests-923615420 None] Delete snapshot completed successfully. Nov 03 07:51:39 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-6f1015aa-d602-4a1c-8cf3-bd3c8ed08341 tempest-ProjectMemberTests-923615420 None] Lock "cinder-af23c337-708d-4e0f-ba5c-42518b637d21-delete_snapshot" released by "delete_snapshot" :: held 1.828s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:39 devstack sudo[107528]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0c3e4ba7-a28b-4c40-9e64-f5304c88964a tempest-ProjectReaderTests-1379712565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39e9f20d-9f90-4255-8224-2011d7b72153 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-39e9f20d-9f90-4255-8224-2011d7b72153.4077ecd1-8bd9-47c4-a1d3-da1b00b313fe" returned: 0 in 0.351s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:39 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-0c3e4ba7-a28b-4c40-9e64-f5304c88964a tempest-ProjectReaderTests-1379712565 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-39e9f20d-9f90-4255-8224-2011d7b72153.4077ecd1-8bd9-47c4-a1d3-da1b00b313fe is being set with open permissions: ugo+rw Nov 03 07:51:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0c3e4ba7-a28b-4c40-9e64-f5304c88964a tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-39e9f20d-9f90-4255-8224-2011d7b72153.4077ecd1-8bd9-47c4-a1d3-da1b00b313fe {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:39 devstack sudo[107536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-39e9f20d-9f90-4255-8224-2011d7b72153.4077ecd1-8bd9-47c4-a1d3-da1b00b313fe Nov 03 07:51:39 devstack sudo[107536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:39 devstack sudo[107531]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3a17c4ab-ea21-416d-8cec-f21e04926792 tempest-SnapshotDependencyTests-758997837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.275s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:39 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-3a17c4ab-ea21-416d-8cec-f21e04926792 tempest-SnapshotDependencyTests-758997837 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:51:39 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-3a17c4ab-ea21-416d-8cec-f21e04926792 tempest-SnapshotDependencyTests-758997837 None] Deleted volume successfully. Nov 03 07:51:39 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-3a17c4ab-ea21-416d-8cec-f21e04926792 tempest-SnapshotDependencyTests-758997837 None] Lock "cinder-c7864fc9-70ea-4a54-b57b-0cb653bc57d4-delete_volume" released by "delete_volume" :: held 1.294s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:39 devstack sudo[107536]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0c3e4ba7-a28b-4c40-9e64-f5304c88964a tempest-ProjectReaderTests-1379712565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-39e9f20d-9f90-4255-8224-2011d7b72153.4077ecd1-8bd9-47c4-a1d3-da1b00b313fe" returned: 0 in 0.260s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0c3e4ba7-a28b-4c40-9e64-f5304c88964a tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-39e9f20d-9f90-4255-8224-2011d7b72153.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:39 devstack sudo[107540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-39e9f20d-9f90-4255-8224-2011d7b72153.info Nov 03 07:51:39 devstack sudo[107540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:39 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-be1818fe-6d3a-40a1-bb13-6e0b93fe3bab tempest-ProjectMemberTests-923615420 None] Acquiring lock "cinder-7cab7e1f-00e5-4b9c-8346-895681df7534-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:39 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-be1818fe-6d3a-40a1-bb13-6e0b93fe3bab tempest-ProjectMemberTests-923615420 None] Lock "cinder-7cab7e1f-00e5-4b9c-8346-895681df7534-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:39 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-be1818fe-6d3a-40a1-bb13-6e0b93fe3bab tempest-ProjectMemberTests-923615420 None] Acquiring lock "cinder-quobyte-7cab7e1f-00e5-4b9c-8346-895681df7534" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:39 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-be1818fe-6d3a-40a1-bb13-6e0b93fe3bab tempest-ProjectMemberTests-923615420 None] Lock "cinder-quobyte-7cab7e1f-00e5-4b9c-8346-895681df7534" acquired by "delete_volume" :: waited 0.015s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:39 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1cc2e1-c2d1-404b-9958-ecbab4878e66]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:39 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-be1818fe-6d3a-40a1-bb13-6e0b93fe3bab tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7cab7e1f-00e5-4b9c-8346-895681df7534 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:40 devstack sudo[107540]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0c3e4ba7-a28b-4c40-9e64-f5304c88964a tempest-ProjectReaderTests-1379712565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-39e9f20d-9f90-4255-8224-2011d7b72153.info" returned: 0 in 0.301s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:40 devstack sudo[107542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7cab7e1f-00e5-4b9c-8346-895681df7534 Nov 03 07:51:40 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:40 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-0c3e4ba7-a28b-4c40-9e64-f5304c88964a tempest-ProjectReaderTests-1379712565 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-39e9f20d-9f90-4255-8224-2011d7b72153.info is being set with open permissions: ugo+rw Nov 03 07:51:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0c3e4ba7-a28b-4c40-9e64-f5304c88964a tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-39e9f20d-9f90-4255-8224-2011d7b72153.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:40 devstack sudo[107545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-39e9f20d-9f90-4255-8224-2011d7b72153.info Nov 03 07:51:40 devstack sudo[107545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:40 devstack sudo[107545]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:40 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-0c3e4ba7-a28b-4c40-9e64-f5304c88964a tempest-ProjectReaderTests-1379712565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-39e9f20d-9f90-4255-8224-2011d7b72153.info" returned: 0 in 0.324s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-0c3e4ba7-a28b-4c40-9e64-f5304c88964a tempest-ProjectReaderTests-1379712565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.159s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-be1818fe-6d3a-40a1-bb13-6e0b93fe3bab tempest-ProjectMemberTests-923615420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7cab7e1f-00e5-4b9c-8346-895681df7534" returned: 0 in 0.474s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-be1818fe-6d3a-40a1-bb13-6e0b93fe3bab tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7cab7e1f-00e5-4b9c-8346-895681df7534 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:40 devstack sudo[107551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7cab7e1f-00e5-4b9c-8346-895681df7534 Nov 03 07:51:40 devstack sudo[107551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:40 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-0c3e4ba7-a28b-4c40-9e64-f5304c88964a tempest-ProjectReaderTests-1379712565 None] Create snapshot completed successfully Nov 03 07:51:40 devstack sudo[107551]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-be1818fe-6d3a-40a1-bb13-6e0b93fe3bab tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-7cab7e1f-00e5-4b9c-8346-895681df7534" returned: 0 in 0.255s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:40 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-be1818fe-6d3a-40a1-bb13-6e0b93fe3bab tempest-ProjectMemberTests-923615420 None] Lock "cinder-quobyte-7cab7e1f-00e5-4b9c-8346-895681df7534" released by "delete_volume" :: held 0.800s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:40 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-be1818fe-6d3a-40a1-bb13-6e0b93fe3bab tempest-ProjectMemberTests-923615420 None] Created reservations ['acddf9c3-a99f-40a5-9b1f-07402e75182c', '42a9f34e-0b01-4376-8c2f-83eaf1de5057', 'e4ad631d-9abf-48ba-bf89-be557031f447', '2a331dc2-1c68-4085-a262-5b646989f676'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:51:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-be1818fe-6d3a-40a1-bb13-6e0b93fe3bab tempest-ProjectMemberTests-923615420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-be1818fe-6d3a-40a1-bb13-6e0b93fe3bab tempest-ProjectMemberTests-923615420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:40 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-be1818fe-6d3a-40a1-bb13-6e0b93fe3bab tempest-ProjectMemberTests-923615420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:40 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-be1818fe-6d3a-40a1-bb13-6e0b93fe3bab tempest-ProjectMemberTests-923615420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-be1818fe-6d3a-40a1-bb13-6e0b93fe3bab tempest-ProjectMemberTests-923615420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:40 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-be1818fe-6d3a-40a1-bb13-6e0b93fe3bab tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:40 devstack sudo[107554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:51:40 devstack sudo[107554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:41 devstack sudo[107554]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-be1818fe-6d3a-40a1-bb13-6e0b93fe3bab tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.302s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:41 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-be1818fe-6d3a-40a1-bb13-6e0b93fe3bab tempest-ProjectMemberTests-923615420 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:51:41 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-be1818fe-6d3a-40a1-bb13-6e0b93fe3bab tempest-ProjectMemberTests-923615420 None] Deleted volume successfully. Nov 03 07:51:41 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-be1818fe-6d3a-40a1-bb13-6e0b93fe3bab tempest-ProjectMemberTests-923615420 None] Lock "cinder-7cab7e1f-00e5-4b9c-8346-895681df7534-delete_volume" released by "delete_volume" :: held 1.334s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:41 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a75673ee-5a8f-4e4e-a704-f245a5d78870 tempest-ProjectReaderTests-1379712565 None] Acquiring lock "cinder-4077ecd1-8bd9-47c4-a1d3-da1b00b313fe-delete_snapshot" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:41 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a75673ee-5a8f-4e4e-a704-f245a5d78870 tempest-ProjectReaderTests-1379712565 None] Lock "cinder-4077ecd1-8bd9-47c4-a1d3-da1b00b313fe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:41 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a75673ee-5a8f-4e4e-a704-f245a5d78870 tempest-ProjectReaderTests-1379712565 None] Acquiring lock "cinder-quobyte-39e9f20d-9f90-4255-8224-2011d7b72153" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:41 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a75673ee-5a8f-4e4e-a704-f245a5d78870 tempest-ProjectReaderTests-1379712565 None] Lock "cinder-quobyte-39e9f20d-9f90-4255-8224-2011d7b72153" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:41 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a75673ee-5a8f-4e4e-a704-f245a5d78870 tempest-ProjectReaderTests-1379712565 None] Acquiring lock "cinder-quobyte-4077ecd1-8bd9-47c4-a1d3-da1b00b313fe" by "_delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:41 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a75673ee-5a8f-4e4e-a704-f245a5d78870 tempest-ProjectReaderTests-1379712565 None] Lock "cinder-quobyte-4077ecd1-8bd9-47c4-a1d3-da1b00b313fe" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:41 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-a75673ee-5a8f-4e4e-a704-f245a5d78870 tempest-ProjectReaderTests-1379712565 None] Deleting offline snapshot 4077ecd1-8bd9-47c4-a1d3-da1b00b313fe of volume 39e9f20d-9f90-4255-8224-2011d7b72153 {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:51:41 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-a75673ee-5a8f-4e4e-a704-f245a5d78870 tempest-ProjectReaderTests-1379712565 None] snapshot_file for this snap is: volume-39e9f20d-9f90-4255-8224-2011d7b72153.4077ecd1-8bd9-47c4-a1d3-da1b00b313fe {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:51:41 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0dc51c2-95fb-4f5d-972d-542836317691]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a75673ee-5a8f-4e4e-a704-f245a5d78870 tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-39e9f20d-9f90-4255-8224-2011d7b72153.4077ecd1-8bd9-47c4-a1d3-da1b00b313fe {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:41 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-a064dd90-a62f-41f3-8145-72234af4ca50 tempest-ProjectMemberTests-923615420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:51:41 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a064dd90-a62f-41f3-8145-72234af4ca50 tempest-ProjectMemberTests-923615420 None] Flow 'volume_create_manager' (eb87bb96-a75e-4261-a51e-2dd835359e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:41 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a064dd90-a62f-41f3-8145-72234af4ca50 tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7faf0c7-82f3-4980-8ec1-33fb0dcb1f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:41 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a064dd90-a62f-41f3-8145-72234af4ca50 tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7faf0c7-82f3-4980-8ec1-33fb0dcb1f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:51:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-499602709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed2c0b7d26474c8aaafc23b6762bdc56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:51:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:51:42Z,use_quota=True,user_id='7d2824260e354882bea7f7a6989d9f16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:41 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a064dd90-a62f-41f3-8145-72234af4ca50 tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b160402f-5bbe-4b24-ad19-ff8c4d0426c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:41 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a064dd90-a62f-41f3-8145-72234af4ca50 tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b160402f-5bbe-4b24-ad19-ff8c4d0426c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:41 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a064dd90-a62f-41f3-8145-72234af4ca50 tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cdd5df7-d366-403d-9112-9e6279634bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:41 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a064dd90-a62f-41f3-8145-72234af4ca50 tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cdd5df7-d366-403d-9112-9e6279634bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa', 'volume_name': 'volume-a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:41 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a064dd90-a62f-41f3-8145-72234af4ca50 tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4beb00e9-ea67-4d38-8c0e-b67b84ac926c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:41 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a064dd90-a62f-41f3-8145-72234af4ca50 tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4beb00e9-ea67-4d38-8c0e-b67b84ac926c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:41 devstack sudo[107558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-39e9f20d-9f90-4255-8224-2011d7b72153.4077ecd1-8bd9-47c4-a1d3-da1b00b313fe Nov 03 07:51:41 devstack sudo[107558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:41 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a064dd90-a62f-41f3-8145-72234af4ca50 tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d942a5b-81f4-4ba5-bc7d-c2c74eb50c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:41 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-a064dd90-a62f-41f3-8145-72234af4ca50 tempest-ProjectMemberTests-923615420 None] Volume a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa', 'volume_size': 1} Nov 03 07:51:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a064dd90-a62f-41f3-8145-72234af4ca50 tempest-ProjectMemberTests-923615420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a064dd90-a62f-41f3-8145-72234af4ca50 tempest-ProjectMemberTests-923615420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:41 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a064dd90-a62f-41f3-8145-72234af4ca50 tempest-ProjectMemberTests-923615420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:51:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-499602709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed2c0b7d26474c8aaafc23b6762bdc56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:51:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:51:42Z,use_quota=True,user_id='7d2824260e354882bea7f7a6989d9f16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:51:41 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-a064dd90-a62f-41f3-8145-72234af4ca50 tempest-ProjectMemberTests-923615420 None] Creating volume a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:51:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a064dd90-a62f-41f3-8145-72234af4ca50 tempest-ProjectMemberTests-923615420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a064dd90-a62f-41f3-8145-72234af4ca50 tempest-ProjectMemberTests-923615420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:41 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a064dd90-a62f-41f3-8145-72234af4ca50 tempest-ProjectMemberTests-923615420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:41 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a064dd90-a62f-41f3-8145-72234af4ca50 tempest-ProjectMemberTests-923615420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a064dd90-a62f-41f3-8145-72234af4ca50 tempest-ProjectMemberTests-923615420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:41 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a064dd90-a62f-41f3-8145-72234af4ca50 tempest-ProjectMemberTests-923615420 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:51:41 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-a064dd90-a62f-41f3-8145-72234af4ca50 tempest-ProjectMemberTests-923615420 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:51:41 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a064dd90-a62f-41f3-8145-72234af4ca50 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:41 devstack sudo[107560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa 1073741824 Nov 03 07:51:41 devstack sudo[107560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:42 devstack sudo[107558]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a75673ee-5a8f-4e4e-a704-f245a5d78870 tempest-ProjectReaderTests-1379712565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-39e9f20d-9f90-4255-8224-2011d7b72153.4077ecd1-8bd9-47c4-a1d3-da1b00b313fe" returned: 0 in 0.405s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:42 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-a75673ee-5a8f-4e4e-a704-f245a5d78870 tempest-ProjectReaderTests-1379712565 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39e9f20d-9f90-4255-8224-2011d7b72153(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:51:42 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[887e214b-f180-4089-bf45-0f6dec001389]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a75673ee-5a8f-4e4e-a704-f245a5d78870 tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-39e9f20d-9f90-4255-8224-2011d7b72153 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:42 devstack sudo[107568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-39e9f20d-9f90-4255-8224-2011d7b72153 Nov 03 07:51:42 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:42 devstack sudo[107560]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a064dd90-a62f-41f3-8145-72234af4ca50 tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa 1073741824" returned: 0 in 0.524s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a064dd90-a62f-41f3-8145-72234af4ca50 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:42 devstack sudo[107571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa Nov 03 07:51:42 devstack sudo[107571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:42 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a75673ee-5a8f-4e4e-a704-f245a5d78870 tempest-ProjectReaderTests-1379712565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-39e9f20d-9f90-4255-8224-2011d7b72153" returned: 0 in 0.413s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a75673ee-5a8f-4e4e-a704-f245a5d78870 tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-39e9f20d-9f90-4255-8224-2011d7b72153.4077ecd1-8bd9-47c4-a1d3-da1b00b313fe {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:42 devstack sudo[107576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-39e9f20d-9f90-4255-8224-2011d7b72153.4077ecd1-8bd9-47c4-a1d3-da1b00b313fe Nov 03 07:51:42 devstack sudo[107576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:42 devstack sudo[107571]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a064dd90-a62f-41f3-8145-72234af4ca50 tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa" returned: 0 in 0.252s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:42 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a064dd90-a62f-41f3-8145-72234af4ca50 tempest-ProjectMemberTests-923615420 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:51:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a064dd90-a62f-41f3-8145-72234af4ca50 tempest-ProjectMemberTests-923615420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:42 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a064dd90-a62f-41f3-8145-72234af4ca50 tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d942a5b-81f4-4ba5-bc7d-c2c74eb50c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:42 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a064dd90-a62f-41f3-8145-72234af4ca50 tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cf6fdb5-09ab-4670-b81b-86a059cde2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:42 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-a064dd90-a62f-41f3-8145-72234af4ca50 tempest-ProjectMemberTests-923615420 None] Volume volume-a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa (a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa): created successfully Nov 03 07:51:42 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a064dd90-a62f-41f3-8145-72234af4ca50 tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cf6fdb5-09ab-4670-b81b-86a059cde2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:42 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a064dd90-a62f-41f3-8145-72234af4ca50 tempest-ProjectMemberTests-923615420 None] Flow 'volume_create_manager' (eb87bb96-a75e-4261-a51e-2dd835359e26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:42 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-a064dd90-a62f-41f3-8145-72234af4ca50 tempest-ProjectMemberTests-923615420 None] Created volume successfully. Nov 03 07:51:42 devstack sudo[107576]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a75673ee-5a8f-4e4e-a704-f245a5d78870 tempest-ProjectReaderTests-1379712565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-39e9f20d-9f90-4255-8224-2011d7b72153.4077ecd1-8bd9-47c4-a1d3-da1b00b313fe" returned: 0 in 0.343s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:42 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a75673ee-5a8f-4e4e-a704-f245a5d78870 tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-39e9f20d-9f90-4255-8224-2011d7b72153.4077ecd1-8bd9-47c4-a1d3-da1b00b313fe {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:42 devstack sudo[107583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-39e9f20d-9f90-4255-8224-2011d7b72153.4077ecd1-8bd9-47c4-a1d3-da1b00b313fe Nov 03 07:51:42 devstack sudo[107583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:43 devstack sudo[107583]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:43 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a75673ee-5a8f-4e4e-a704-f245a5d78870 tempest-ProjectReaderTests-1379712565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-39e9f20d-9f90-4255-8224-2011d7b72153.4077ecd1-8bd9-47c4-a1d3-da1b00b313fe" returned: 0 in 0.242s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:43 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a75673ee-5a8f-4e4e-a704-f245a5d78870 tempest-ProjectReaderTests-1379712565 None] Lock "cinder-quobyte-4077ecd1-8bd9-47c4-a1d3-da1b00b313fe" released by "_delete_snapshot" :: held 1.531s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:43 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a75673ee-5a8f-4e4e-a704-f245a5d78870 tempest-ProjectReaderTests-1379712565 None] Lock "cinder-quobyte-39e9f20d-9f90-4255-8224-2011d7b72153" released by "delete_snapshot" :: held 1.556s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:43 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-a75673ee-5a8f-4e4e-a704-f245a5d78870 tempest-ProjectReaderTests-1379712565 None] Created reservations ['3089705e-8176-44f6-afc3-e16d25f1a247', '30752d5d-de35-4b4c-a0ac-f53ab7bb70aa', 'fd26a5ed-f305-464b-bc06-890c1b16741d', 'db4f5fa9-da7a-416a-b740-cb466dcbc4d6'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:51:43 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-a75673ee-5a8f-4e4e-a704-f245a5d78870 tempest-ProjectReaderTests-1379712565 None] Delete snapshot completed successfully. Nov 03 07:51:43 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a75673ee-5a8f-4e4e-a704-f245a5d78870 tempest-ProjectReaderTests-1379712565 None] Lock "cinder-4077ecd1-8bd9-47c4-a1d3-da1b00b313fe-delete_snapshot" released by "delete_snapshot" :: held 1.765s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:43 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-cfacd3f0-9028-49e8-a9a8-b23c39193c91 tempest-ProjectReaderTests-1379712565 None] Acquiring lock "cinder-39e9f20d-9f90-4255-8224-2011d7b72153-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:43 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-cfacd3f0-9028-49e8-a9a8-b23c39193c91 tempest-ProjectReaderTests-1379712565 None] Lock "cinder-39e9f20d-9f90-4255-8224-2011d7b72153-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:43 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-cfacd3f0-9028-49e8-a9a8-b23c39193c91 tempest-ProjectReaderTests-1379712565 None] Acquiring lock "cinder-quobyte-39e9f20d-9f90-4255-8224-2011d7b72153" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:43 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-cfacd3f0-9028-49e8-a9a8-b23c39193c91 tempest-ProjectReaderTests-1379712565 None] Lock "cinder-quobyte-39e9f20d-9f90-4255-8224-2011d7b72153" acquired by "delete_volume" :: waited 0.021s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:43 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[33888664-cbfc-4fe3-b1ef-0178d37ff4cb]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:43 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-cfacd3f0-9028-49e8-a9a8-b23c39193c91 tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-39e9f20d-9f90-4255-8224-2011d7b72153 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:43 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-05e7556a-287e-40e3-95da-1c40f5055894 tempest-ProjectMemberTests-923615420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:43 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-05e7556a-287e-40e3-95da-1c40f5055894 tempest-ProjectMemberTests-923615420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:43 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-05e7556a-287e-40e3-95da-1c40f5055894 tempest-ProjectMemberTests-923615420 None] Creating offline snapshot 865680ea-8d03-4e53-b3cf-320f8d92eba5 of volume a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa {{(pid=86875) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:51:44 devstack sudo[107587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-39e9f20d-9f90-4255-8224-2011d7b72153 Nov 03 07:51:44 devstack sudo[107587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:44 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[436ac7ab-069a-47f9-8ddd-b0ea0f52cc1f]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-05e7556a-287e-40e3-95da-1c40f5055894 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:44 devstack sudo[107589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa Nov 03 07:51:44 devstack sudo[107589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:44 devstack sudo[107587]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-cfacd3f0-9028-49e8-a9a8-b23c39193c91 tempest-ProjectReaderTests-1379712565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-39e9f20d-9f90-4255-8224-2011d7b72153" returned: 0 in 0.471s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-cfacd3f0-9028-49e8-a9a8-b23c39193c91 tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-39e9f20d-9f90-4255-8224-2011d7b72153 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:44 devstack sudo[107596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-39e9f20d-9f90-4255-8224-2011d7b72153 Nov 03 07:51:44 devstack sudo[107596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:44 devstack sudo[107589]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-05e7556a-287e-40e3-95da-1c40f5055894 tempest-ProjectMemberTests-923615420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa" returned: 0 in 0.476s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-05e7556a-287e-40e3-95da-1c40f5055894 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa.865680ea-8d03-4e53-b3cf-320f8d92eba5 1G {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:44 devstack sudo[107601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa.865680ea-8d03-4e53-b3cf-320f8d92eba5 1G Nov 03 07:51:44 devstack sudo[107601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:44 devstack sudo[107596]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-cfacd3f0-9028-49e8-a9a8-b23c39193c91 tempest-ProjectReaderTests-1379712565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-39e9f20d-9f90-4255-8224-2011d7b72153" returned: 0 in 0.273s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:44 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-cfacd3f0-9028-49e8-a9a8-b23c39193c91 tempest-ProjectReaderTests-1379712565 None] Lock "cinder-quobyte-39e9f20d-9f90-4255-8224-2011d7b72153" released by "delete_volume" :: held 0.845s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:44 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-cfacd3f0-9028-49e8-a9a8-b23c39193c91 tempest-ProjectReaderTests-1379712565 None] Created reservations ['65b5ec4f-a1d3-479e-b2db-73260eb222b2', '4f04a741-2315-49a5-af4f-4456ca224f66', '5f74b38f-0224-41a3-877c-223f8979d136', 'fe5ea022-b967-4fc3-aabc-2fa8101bdf96'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:51:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-cfacd3f0-9028-49e8-a9a8-b23c39193c91 tempest-ProjectReaderTests-1379712565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-cfacd3f0-9028-49e8-a9a8-b23c39193c91 tempest-ProjectReaderTests-1379712565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:44 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-cfacd3f0-9028-49e8-a9a8-b23c39193c91 tempest-ProjectReaderTests-1379712565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:44 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-cfacd3f0-9028-49e8-a9a8-b23c39193c91 tempest-ProjectReaderTests-1379712565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-cfacd3f0-9028-49e8-a9a8-b23c39193c91 tempest-ProjectReaderTests-1379712565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-cfacd3f0-9028-49e8-a9a8-b23c39193c91 tempest-ProjectReaderTests-1379712565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:44 devstack sudo[107607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:51:44 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:44 devstack sudo[107601]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-05e7556a-287e-40e3-95da-1c40f5055894 tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa.865680ea-8d03-4e53-b3cf-320f8d92eba5 1G" returned: 0 in 0.506s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:44 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-05e7556a-287e-40e3-95da-1c40f5055894 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa.865680ea-8d03-4e53-b3cf-320f8d92eba5 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:45 devstack sudo[107610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa.865680ea-8d03-4e53-b3cf-320f8d92eba5 Nov 03 07:51:45 devstack sudo[107610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:45 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-cfacd3f0-9028-49e8-a9a8-b23c39193c91 tempest-ProjectReaderTests-1379712565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.301s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:45 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-cfacd3f0-9028-49e8-a9a8-b23c39193c91 tempest-ProjectReaderTests-1379712565 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:51:45 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-cfacd3f0-9028-49e8-a9a8-b23c39193c91 tempest-ProjectReaderTests-1379712565 None] Deleted volume successfully. Nov 03 07:51:45 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-cfacd3f0-9028-49e8-a9a8-b23c39193c91 tempest-ProjectReaderTests-1379712565 None] Lock "cinder-39e9f20d-9f90-4255-8224-2011d7b72153-delete_volume" released by "delete_volume" :: held 1.399s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:45 devstack sudo[107610]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-05e7556a-287e-40e3-95da-1c40f5055894 tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa.865680ea-8d03-4e53-b3cf-320f8d92eba5" returned: 0 in 0.404s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:45 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-05e7556a-287e-40e3-95da-1c40f5055894 tempest-ProjectMemberTests-923615420 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa.865680ea-8d03-4e53-b3cf-320f8d92eba5 is being set with open permissions: ugo+rw Nov 03 07:51:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-05e7556a-287e-40e3-95da-1c40f5055894 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa.865680ea-8d03-4e53-b3cf-320f8d92eba5 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:45 devstack sudo[107617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa.865680ea-8d03-4e53-b3cf-320f8d92eba5 Nov 03 07:51:45 devstack sudo[107617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:45 devstack sudo[107617]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-05e7556a-287e-40e3-95da-1c40f5055894 tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa.865680ea-8d03-4e53-b3cf-320f8d92eba5" returned: 0 in 0.281s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:45 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-05e7556a-287e-40e3-95da-1c40f5055894 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:45 devstack sudo[107620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa.info Nov 03 07:51:45 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:46 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-05e7556a-287e-40e3-95da-1c40f5055894 tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa.info" returned: 0 in 0.321s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:46 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-05e7556a-287e-40e3-95da-1c40f5055894 tempest-ProjectMemberTests-923615420 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa.info is being set with open permissions: ugo+rw Nov 03 07:51:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-05e7556a-287e-40e3-95da-1c40f5055894 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:46 devstack sudo[107624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa.info Nov 03 07:51:46 devstack sudo[107624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:46 devstack sudo[107624]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-05e7556a-287e-40e3-95da-1c40f5055894 tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa.info" returned: 0 in 0.280s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:46 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-05e7556a-287e-40e3-95da-1c40f5055894 tempest-ProjectMemberTests-923615420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.382s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:46 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-05e7556a-287e-40e3-95da-1c40f5055894 tempest-ProjectMemberTests-923615420 None] Create snapshot completed successfully Nov 03 07:51:47 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-227957a2-b157-4d37-bd17-6c729c812ff7 tempest-ProjectMemberTests-923615420 None] Acquiring lock "cinder-865680ea-8d03-4e53-b3cf-320f8d92eba5-delete_snapshot" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:47 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-227957a2-b157-4d37-bd17-6c729c812ff7 tempest-ProjectMemberTests-923615420 None] Lock "cinder-865680ea-8d03-4e53-b3cf-320f8d92eba5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:47 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-227957a2-b157-4d37-bd17-6c729c812ff7 tempest-ProjectMemberTests-923615420 None] Acquiring lock "cinder-quobyte-a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:47 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-227957a2-b157-4d37-bd17-6c729c812ff7 tempest-ProjectMemberTests-923615420 None] Lock "cinder-quobyte-a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:47 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-227957a2-b157-4d37-bd17-6c729c812ff7 tempest-ProjectMemberTests-923615420 None] Acquiring lock "cinder-quobyte-865680ea-8d03-4e53-b3cf-320f8d92eba5" by "_delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:47 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-227957a2-b157-4d37-bd17-6c729c812ff7 tempest-ProjectMemberTests-923615420 None] Lock "cinder-quobyte-865680ea-8d03-4e53-b3cf-320f8d92eba5" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:47 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-227957a2-b157-4d37-bd17-6c729c812ff7 tempest-ProjectMemberTests-923615420 None] Deleting offline snapshot 865680ea-8d03-4e53-b3cf-320f8d92eba5 of volume a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:51:47 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-227957a2-b157-4d37-bd17-6c729c812ff7 tempest-ProjectMemberTests-923615420 None] snapshot_file for this snap is: volume-a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa.865680ea-8d03-4e53-b3cf-320f8d92eba5 {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:51:47 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[df933b40-aa46-412d-8327-62939e2c0418]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:47 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-227957a2-b157-4d37-bd17-6c729c812ff7 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa.865680ea-8d03-4e53-b3cf-320f8d92eba5 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:47 devstack sudo[107627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa.865680ea-8d03-4e53-b3cf-320f8d92eba5 Nov 03 07:51:47 devstack sudo[107627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:47 devstack sudo[107627]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:47 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-227957a2-b157-4d37-bd17-6c729c812ff7 tempest-ProjectMemberTests-923615420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa.865680ea-8d03-4e53-b3cf-320f8d92eba5" returned: 0 in 0.403s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:47 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-227957a2-b157-4d37-bd17-6c729c812ff7 tempest-ProjectMemberTests-923615420 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:51:47 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbeef49-3e6c-4689-aec4-c2f9ffd3f3e5]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:47 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-227957a2-b157-4d37-bd17-6c729c812ff7 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:47 devstack sudo[107632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa Nov 03 07:51:47 devstack sudo[107632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:48 devstack sudo[107632]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-227957a2-b157-4d37-bd17-6c729c812ff7 tempest-ProjectMemberTests-923615420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa" returned: 0 in 0.423s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-227957a2-b157-4d37-bd17-6c729c812ff7 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa.865680ea-8d03-4e53-b3cf-320f8d92eba5 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:48 devstack sudo[107638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa.865680ea-8d03-4e53-b3cf-320f8d92eba5 Nov 03 07:51:48 devstack sudo[107638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:48 devstack sudo[107638]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-227957a2-b157-4d37-bd17-6c729c812ff7 tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa.865680ea-8d03-4e53-b3cf-320f8d92eba5" returned: 0 in 0.425s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-227957a2-b157-4d37-bd17-6c729c812ff7 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa.865680ea-8d03-4e53-b3cf-320f8d92eba5 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:48 devstack sudo[107643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa.865680ea-8d03-4e53-b3cf-320f8d92eba5 Nov 03 07:51:48 devstack sudo[107643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:48 devstack sudo[107643]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:48 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-227957a2-b157-4d37-bd17-6c729c812ff7 tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa.865680ea-8d03-4e53-b3cf-320f8d92eba5" returned: 0 in 0.355s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:49 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-227957a2-b157-4d37-bd17-6c729c812ff7 tempest-ProjectMemberTests-923615420 None] Lock "cinder-quobyte-865680ea-8d03-4e53-b3cf-320f8d92eba5" released by "_delete_snapshot" :: held 1.758s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:49 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-227957a2-b157-4d37-bd17-6c729c812ff7 tempest-ProjectMemberTests-923615420 None] Lock "cinder-quobyte-a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa" released by "delete_snapshot" :: held 1.787s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:49 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-227957a2-b157-4d37-bd17-6c729c812ff7 tempest-ProjectMemberTests-923615420 None] Created reservations ['8a8428a5-d6b6-4fd7-9627-b45ea350685c', '12215e10-72f8-4047-bec2-c9424d89a831', '0c09d4b8-f043-4f6b-8321-b76037450998', '49c125b1-fbdd-4115-b60f-342e3460d72f'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:51:49 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-227957a2-b157-4d37-bd17-6c729c812ff7 tempest-ProjectMemberTests-923615420 None] Delete snapshot completed successfully. Nov 03 07:51:49 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-227957a2-b157-4d37-bd17-6c729c812ff7 tempest-ProjectMemberTests-923615420 None] Lock "cinder-865680ea-8d03-4e53-b3cf-320f8d92eba5-delete_snapshot" released by "delete_snapshot" :: held 1.973s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:49 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-8155deb1-4ee9-498e-bde8-d1c03b62ade6 tempest-ProjectReaderTests-1647148893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:51:49 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-8155deb1-4ee9-498e-bde8-d1c03b62ade6 tempest-ProjectReaderTests-1647148893 None] Flow 'volume_create_manager' (46dcc93d-8993-4305-afc6-3e58e072c540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:49 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-8155deb1-4ee9-498e-bde8-d1c03b62ade6 tempest-ProjectReaderTests-1647148893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c6c187c-867f-4694-a955-eaf10cf4a5a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:49 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-8155deb1-4ee9-498e-bde8-d1c03b62ade6 tempest-ProjectReaderTests-1647148893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c6c187c-867f-4694-a955-eaf10cf4a5a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:51:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1840279640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=640a275c-a0d6-40ec-af2f-5fe8f9bb6e8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5c3f380906d4629b3d5460f394b4b3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:51:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:51:49Z,use_quota=True,user_id='d4ccbb249b6a41089b426e7a0f18cfc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:49 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-8155deb1-4ee9-498e-bde8-d1c03b62ade6 tempest-ProjectReaderTests-1647148893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32951804-2c48-4fb2-ac7b-36026287473b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:49 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-8155deb1-4ee9-498e-bde8-d1c03b62ade6 tempest-ProjectReaderTests-1647148893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32951804-2c48-4fb2-ac7b-36026287473b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:49 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-8155deb1-4ee9-498e-bde8-d1c03b62ade6 tempest-ProjectReaderTests-1647148893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca86fa5e-b5c9-454f-8b22-0739c2065248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:49 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-8155deb1-4ee9-498e-bde8-d1c03b62ade6 tempest-ProjectReaderTests-1647148893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca86fa5e-b5c9-454f-8b22-0739c2065248) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '640a275c-a0d6-40ec-af2f-5fe8f9bb6e8d', 'volume_name': 'volume-640a275c-a0d6-40ec-af2f-5fe8f9bb6e8d', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:49 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-8155deb1-4ee9-498e-bde8-d1c03b62ade6 tempest-ProjectReaderTests-1647148893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea985fa7-b90f-4b92-b0af-29b5b8be7c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:49 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-8155deb1-4ee9-498e-bde8-d1c03b62ade6 tempest-ProjectReaderTests-1647148893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea985fa7-b90f-4b92-b0af-29b5b8be7c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:49 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-8155deb1-4ee9-498e-bde8-d1c03b62ade6 tempest-ProjectReaderTests-1647148893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (058e5d22-4b09-4fcf-a0c5-78fe11fe4257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:49 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-8155deb1-4ee9-498e-bde8-d1c03b62ade6 tempest-ProjectReaderTests-1647148893 None] Volume 640a275c-a0d6-40ec-af2f-5fe8f9bb6e8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-640a275c-a0d6-40ec-af2f-5fe8f9bb6e8d', 'volume_size': 1} Nov 03 07:51:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-8155deb1-4ee9-498e-bde8-d1c03b62ade6 tempest-ProjectReaderTests-1647148893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-8155deb1-4ee9-498e-bde8-d1c03b62ade6 tempest-ProjectReaderTests-1647148893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:49 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-8155deb1-4ee9-498e-bde8-d1c03b62ade6 tempest-ProjectReaderTests-1647148893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:51:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1840279640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=640a275c-a0d6-40ec-af2f-5fe8f9bb6e8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5c3f380906d4629b3d5460f394b4b3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:51:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:51:49Z,use_quota=True,user_id='d4ccbb249b6a41089b426e7a0f18cfc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:51:49 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-8155deb1-4ee9-498e-bde8-d1c03b62ade6 tempest-ProjectReaderTests-1647148893 None] Creating volume 640a275c-a0d6-40ec-af2f-5fe8f9bb6e8d {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:51:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-8155deb1-4ee9-498e-bde8-d1c03b62ade6 tempest-ProjectReaderTests-1647148893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-8155deb1-4ee9-498e-bde8-d1c03b62ade6 tempest-ProjectReaderTests-1647148893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:49 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-8155deb1-4ee9-498e-bde8-d1c03b62ade6 tempest-ProjectReaderTests-1647148893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:49 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-8155deb1-4ee9-498e-bde8-d1c03b62ade6 tempest-ProjectReaderTests-1647148893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-8155deb1-4ee9-498e-bde8-d1c03b62ade6 tempest-ProjectReaderTests-1647148893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:49 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-8155deb1-4ee9-498e-bde8-d1c03b62ade6 tempest-ProjectReaderTests-1647148893 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:51:49 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-8155deb1-4ee9-498e-bde8-d1c03b62ade6 tempest-ProjectReaderTests-1647148893 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:51:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8155deb1-4ee9-498e-bde8-d1c03b62ade6 tempest-ProjectReaderTests-1647148893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-640a275c-a0d6-40ec-af2f-5fe8f9bb6e8d 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:49 devstack sudo[107646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-640a275c-a0d6-40ec-af2f-5fe8f9bb6e8d 1073741824 Nov 03 07:51:49 devstack sudo[107646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:49 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a5a2657c-b64b-496f-993b-a103b03b8dca tempest-ProjectMemberTests-923615420 None] Acquiring lock "cinder-a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:49 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a5a2657c-b64b-496f-993b-a103b03b8dca tempest-ProjectMemberTests-923615420 None] Lock "cinder-a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:49 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a5a2657c-b64b-496f-993b-a103b03b8dca tempest-ProjectMemberTests-923615420 None] Acquiring lock "cinder-quobyte-a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:49 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a5a2657c-b64b-496f-993b-a103b03b8dca tempest-ProjectMemberTests-923615420 None] Lock "cinder-quobyte-a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa" acquired by "delete_volume" :: waited 0.020s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:49 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[b659dfac-5874-4147-9768-35d121e87ace]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a5a2657c-b64b-496f-993b-a103b03b8dca tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:49 devstack sudo[107648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa Nov 03 07:51:49 devstack sudo[107648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:49 devstack sudo[107646]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8155deb1-4ee9-498e-bde8-d1c03b62ade6 tempest-ProjectReaderTests-1647148893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-640a275c-a0d6-40ec-af2f-5fe8f9bb6e8d 1073741824" returned: 0 in 0.574s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:49 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8155deb1-4ee9-498e-bde8-d1c03b62ade6 tempest-ProjectReaderTests-1647148893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-640a275c-a0d6-40ec-af2f-5fe8f9bb6e8d {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:49 devstack sudo[107655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-640a275c-a0d6-40ec-af2f-5fe8f9bb6e8d Nov 03 07:51:49 devstack sudo[107655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:50 devstack sudo[107648]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a5a2657c-b64b-496f-993b-a103b03b8dca tempest-ProjectMemberTests-923615420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa" returned: 0 in 0.503s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a5a2657c-b64b-496f-993b-a103b03b8dca tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:50 devstack sudo[107660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa Nov 03 07:51:50 devstack sudo[107660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:50 devstack sudo[107655]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-8155deb1-4ee9-498e-bde8-d1c03b62ade6 tempest-ProjectReaderTests-1647148893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-640a275c-a0d6-40ec-af2f-5fe8f9bb6e8d" returned: 0 in 0.297s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:50 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-8155deb1-4ee9-498e-bde8-d1c03b62ade6 tempest-ProjectReaderTests-1647148893 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:51:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-8155deb1-4ee9-498e-bde8-d1c03b62ade6 tempest-ProjectReaderTests-1647148893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:50 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-8155deb1-4ee9-498e-bde8-d1c03b62ade6 tempest-ProjectReaderTests-1647148893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (058e5d22-4b09-4fcf-a0c5-78fe11fe4257) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-640a275c-a0d6-40ec-af2f-5fe8f9bb6e8d', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:50 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-8155deb1-4ee9-498e-bde8-d1c03b62ade6 tempest-ProjectReaderTests-1647148893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edc7208e-2014-4e53-93b3-5e76f324d513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:50 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-8155deb1-4ee9-498e-bde8-d1c03b62ade6 tempest-ProjectReaderTests-1647148893 None] Volume volume-640a275c-a0d6-40ec-af2f-5fe8f9bb6e8d (640a275c-a0d6-40ec-af2f-5fe8f9bb6e8d): created successfully Nov 03 07:51:50 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-8155deb1-4ee9-498e-bde8-d1c03b62ade6 tempest-ProjectReaderTests-1647148893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edc7208e-2014-4e53-93b3-5e76f324d513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:50 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-8155deb1-4ee9-498e-bde8-d1c03b62ade6 tempest-ProjectReaderTests-1647148893 None] Flow 'volume_create_manager' (46dcc93d-8993-4305-afc6-3e58e072c540) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:50 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-8155deb1-4ee9-498e-bde8-d1c03b62ade6 tempest-ProjectReaderTests-1647148893 None] Created volume successfully. Nov 03 07:51:50 devstack sudo[107660]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a5a2657c-b64b-496f-993b-a103b03b8dca tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa" returned: 0 in 0.288s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:50 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a5a2657c-b64b-496f-993b-a103b03b8dca tempest-ProjectMemberTests-923615420 None] Lock "cinder-quobyte-a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa" released by "delete_volume" :: held 0.875s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:50 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-a5a2657c-b64b-496f-993b-a103b03b8dca tempest-ProjectMemberTests-923615420 None] Created reservations ['943719b6-918b-41dc-a774-82bce68c6597', 'a497a3be-46cb-4803-b16d-6b60b14b211a', '5c756c34-6c42-4909-b95f-82d4f1b6320c', '20601730-eeb6-44aa-b363-e019e48e26da'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:51:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a5a2657c-b64b-496f-993b-a103b03b8dca tempest-ProjectMemberTests-923615420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a5a2657c-b64b-496f-993b-a103b03b8dca tempest-ProjectMemberTests-923615420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:50 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a5a2657c-b64b-496f-993b-a103b03b8dca tempest-ProjectMemberTests-923615420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:50 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a5a2657c-b64b-496f-993b-a103b03b8dca tempest-ProjectMemberTests-923615420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a5a2657c-b64b-496f-993b-a103b03b8dca tempest-ProjectMemberTests-923615420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a5a2657c-b64b-496f-993b-a103b03b8dca tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:50 devstack sudo[107664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:51:50 devstack sudo[107664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:50 devstack sudo[107664]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:50 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a5a2657c-b64b-496f-993b-a103b03b8dca tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.283s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:50 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-a5a2657c-b64b-496f-993b-a103b03b8dca tempest-ProjectMemberTests-923615420 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:51:50 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-a5a2657c-b64b-496f-993b-a103b03b8dca tempest-ProjectMemberTests-923615420 None] Deleted volume successfully. Nov 03 07:51:50 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-a5a2657c-b64b-496f-993b-a103b03b8dca tempest-ProjectMemberTests-923615420 None] Lock "cinder-a3654d5a-59a0-4dd5-b3c5-e115cebcf0fa-delete_volume" released by "delete_volume" :: held 1.376s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:51 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-805dd8ac-467e-4694-8aac-561ccfb1b115 tempest-ProjectMemberTests-923615420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:51:51 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-805dd8ac-467e-4694-8aac-561ccfb1b115 tempest-ProjectMemberTests-923615420 None] Flow 'volume_create_manager' (66fbd8cc-b97a-48dd-a5df-d4c734b8af93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:51 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-805dd8ac-467e-4694-8aac-561ccfb1b115 tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2135098-8a29-4106-a407-9ece92798267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:51 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-805dd8ac-467e-4694-8aac-561ccfb1b115 tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2135098-8a29-4106-a407-9ece92798267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:51:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1002414882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c33c869-f4b5-4d03-be84-688d92a8c073,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed2c0b7d26474c8aaafc23b6762bdc56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:51:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:51:51Z,use_quota=True,user_id='7d2824260e354882bea7f7a6989d9f16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:51 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-805dd8ac-467e-4694-8aac-561ccfb1b115 tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84785068-4663-4225-bd46-a609ba8727ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:51 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-805dd8ac-467e-4694-8aac-561ccfb1b115 tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84785068-4663-4225-bd46-a609ba8727ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:51 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-805dd8ac-467e-4694-8aac-561ccfb1b115 tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb062591-7bac-4b0e-93ad-75aa9f6808ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:51 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-805dd8ac-467e-4694-8aac-561ccfb1b115 tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb062591-7bac-4b0e-93ad-75aa9f6808ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c33c869-f4b5-4d03-be84-688d92a8c073', 'volume_name': 'volume-9c33c869-f4b5-4d03-be84-688d92a8c073', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:51 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-805dd8ac-467e-4694-8aac-561ccfb1b115 tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8912a3bf-e931-4c6c-bfb4-5785797a5ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:51 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-805dd8ac-467e-4694-8aac-561ccfb1b115 tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8912a3bf-e931-4c6c-bfb4-5785797a5ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:51 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-805dd8ac-467e-4694-8aac-561ccfb1b115 tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b1508c9-671f-4745-ade4-77d04559aca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:51 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-805dd8ac-467e-4694-8aac-561ccfb1b115 tempest-ProjectMemberTests-923615420 None] Volume 9c33c869-f4b5-4d03-be84-688d92a8c073: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c33c869-f4b5-4d03-be84-688d92a8c073', 'volume_size': 1} Nov 03 07:51:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-805dd8ac-467e-4694-8aac-561ccfb1b115 tempest-ProjectMemberTests-923615420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-805dd8ac-467e-4694-8aac-561ccfb1b115 tempest-ProjectMemberTests-923615420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:51 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-805dd8ac-467e-4694-8aac-561ccfb1b115 tempest-ProjectMemberTests-923615420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:51:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1002414882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c33c869-f4b5-4d03-be84-688d92a8c073,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed2c0b7d26474c8aaafc23b6762bdc56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:51:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:51:51Z,use_quota=True,user_id='7d2824260e354882bea7f7a6989d9f16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:51:51 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-805dd8ac-467e-4694-8aac-561ccfb1b115 tempest-ProjectMemberTests-923615420 None] Creating volume 9c33c869-f4b5-4d03-be84-688d92a8c073 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:51:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-805dd8ac-467e-4694-8aac-561ccfb1b115 tempest-ProjectMemberTests-923615420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-805dd8ac-467e-4694-8aac-561ccfb1b115 tempest-ProjectMemberTests-923615420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:51 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-805dd8ac-467e-4694-8aac-561ccfb1b115 tempest-ProjectMemberTests-923615420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:51 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-805dd8ac-467e-4694-8aac-561ccfb1b115 tempest-ProjectMemberTests-923615420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-805dd8ac-467e-4694-8aac-561ccfb1b115 tempest-ProjectMemberTests-923615420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:51 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-805dd8ac-467e-4694-8aac-561ccfb1b115 tempest-ProjectMemberTests-923615420 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:51:51 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-805dd8ac-467e-4694-8aac-561ccfb1b115 tempest-ProjectMemberTests-923615420 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:51:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-805dd8ac-467e-4694-8aac-561ccfb1b115 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9c33c869-f4b5-4d03-be84-688d92a8c073 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:51 devstack sudo[107667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9c33c869-f4b5-4d03-be84-688d92a8c073 1073741824 Nov 03 07:51:51 devstack sudo[107667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:51 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ca03da12-2928-47ac-bc7f-2708922fb344 tempest-ProjectReaderTests-1647148893 None] Acquiring lock "cinder-640a275c-a0d6-40ec-af2f-5fe8f9bb6e8d-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:51 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ca03da12-2928-47ac-bc7f-2708922fb344 tempest-ProjectReaderTests-1647148893 None] Lock "cinder-640a275c-a0d6-40ec-af2f-5fe8f9bb6e8d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:51 devstack sudo[107667]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-805dd8ac-467e-4694-8aac-561ccfb1b115 tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9c33c869-f4b5-4d03-be84-688d92a8c073 1073741824" returned: 0 in 0.573s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:51 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ca03da12-2928-47ac-bc7f-2708922fb344 tempest-ProjectReaderTests-1647148893 None] Acquiring lock "cinder-quobyte-640a275c-a0d6-40ec-af2f-5fe8f9bb6e8d" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:51 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ca03da12-2928-47ac-bc7f-2708922fb344 tempest-ProjectReaderTests-1647148893 None] Lock "cinder-quobyte-640a275c-a0d6-40ec-af2f-5fe8f9bb6e8d" acquired by "delete_volume" :: waited 0.021s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:51 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3948e72-0443-4d38-9c85-313afdd31120]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ca03da12-2928-47ac-bc7f-2708922fb344 tempest-ProjectReaderTests-1647148893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-640a275c-a0d6-40ec-af2f-5fe8f9bb6e8d {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:51 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-805dd8ac-467e-4694-8aac-561ccfb1b115 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9c33c869-f4b5-4d03-be84-688d92a8c073 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:51 devstack sudo[107674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9c33c869-f4b5-4d03-be84-688d92a8c073 Nov 03 07:51:51 devstack sudo[107674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:51 devstack sudo[107673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-640a275c-a0d6-40ec-af2f-5fe8f9bb6e8d Nov 03 07:51:51 devstack sudo[107673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:52 devstack sudo[107674]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-805dd8ac-467e-4694-8aac-561ccfb1b115 tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9c33c869-f4b5-4d03-be84-688d92a8c073" returned: 0 in 0.288s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:52 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-805dd8ac-467e-4694-8aac-561ccfb1b115 tempest-ProjectMemberTests-923615420 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:51:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-805dd8ac-467e-4694-8aac-561ccfb1b115 tempest-ProjectMemberTests-923615420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:52 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-805dd8ac-467e-4694-8aac-561ccfb1b115 tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b1508c9-671f-4745-ade4-77d04559aca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c33c869-f4b5-4d03-be84-688d92a8c073', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:52 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-805dd8ac-467e-4694-8aac-561ccfb1b115 tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4db273be-5851-4b16-9245-641e8517b12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:52 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-805dd8ac-467e-4694-8aac-561ccfb1b115 tempest-ProjectMemberTests-923615420 None] Volume volume-9c33c869-f4b5-4d03-be84-688d92a8c073 (9c33c869-f4b5-4d03-be84-688d92a8c073): created successfully Nov 03 07:51:52 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-805dd8ac-467e-4694-8aac-561ccfb1b115 tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4db273be-5851-4b16-9245-641e8517b12c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:52 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-805dd8ac-467e-4694-8aac-561ccfb1b115 tempest-ProjectMemberTests-923615420 None] Flow 'volume_create_manager' (66fbd8cc-b97a-48dd-a5df-d4c734b8af93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:52 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-805dd8ac-467e-4694-8aac-561ccfb1b115 tempest-ProjectMemberTests-923615420 None] Created volume successfully. Nov 03 07:51:52 devstack sudo[107673]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ca03da12-2928-47ac-bc7f-2708922fb344 tempest-ProjectReaderTests-1647148893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-640a275c-a0d6-40ec-af2f-5fe8f9bb6e8d" returned: 0 in 0.380s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ca03da12-2928-47ac-bc7f-2708922fb344 tempest-ProjectReaderTests-1647148893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-640a275c-a0d6-40ec-af2f-5fe8f9bb6e8d {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:52 devstack sudo[107681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-640a275c-a0d6-40ec-af2f-5fe8f9bb6e8d Nov 03 07:51:52 devstack sudo[107681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:52 devstack sudo[107681]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ca03da12-2928-47ac-bc7f-2708922fb344 tempest-ProjectReaderTests-1647148893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-640a275c-a0d6-40ec-af2f-5fe8f9bb6e8d" returned: 0 in 0.245s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:52 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ca03da12-2928-47ac-bc7f-2708922fb344 tempest-ProjectReaderTests-1647148893 None] Lock "cinder-quobyte-640a275c-a0d6-40ec-af2f-5fe8f9bb6e8d" released by "delete_volume" :: held 0.670s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:52 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-ca03da12-2928-47ac-bc7f-2708922fb344 tempest-ProjectReaderTests-1647148893 None] Created reservations ['f4d0dc5a-1e70-4c33-9a45-dc976acc5e83', '4e817fa9-68ff-463a-9227-6413baa917e4', '439450d9-161a-4ff5-aeac-16643caa8f05', '9116acd0-b6ce-40d1-8dde-49ca2e05f835'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:51:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-ca03da12-2928-47ac-bc7f-2708922fb344 tempest-ProjectReaderTests-1647148893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-ca03da12-2928-47ac-bc7f-2708922fb344 tempest-ProjectReaderTests-1647148893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:52 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-ca03da12-2928-47ac-bc7f-2708922fb344 tempest-ProjectReaderTests-1647148893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:52 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-ca03da12-2928-47ac-bc7f-2708922fb344 tempest-ProjectReaderTests-1647148893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-ca03da12-2928-47ac-bc7f-2708922fb344 tempest-ProjectReaderTests-1647148893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ca03da12-2928-47ac-bc7f-2708922fb344 tempest-ProjectReaderTests-1647148893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:52 devstack sudo[107684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:51:52 devstack sudo[107684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:52 devstack sudo[107684]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:52 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ca03da12-2928-47ac-bc7f-2708922fb344 tempest-ProjectReaderTests-1647148893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.244s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:52 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-ca03da12-2928-47ac-bc7f-2708922fb344 tempest-ProjectReaderTests-1647148893 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:51:52 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-ca03da12-2928-47ac-bc7f-2708922fb344 tempest-ProjectReaderTests-1647148893 None] Deleted volume successfully. Nov 03 07:51:52 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ca03da12-2928-47ac-bc7f-2708922fb344 tempest-ProjectReaderTests-1647148893 None] Lock "cinder-640a275c-a0d6-40ec-af2f-5fe8f9bb6e8d-delete_volume" released by "delete_volume" :: held 1.136s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:53 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6dab5b6-82f5-4b35-8d82-5ebaa1d49016 tempest-ProjectReaderTests-1647148893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:51:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a6dab5b6-82f5-4b35-8d82-5ebaa1d49016 tempest-ProjectReaderTests-1647148893 None] Flow 'volume_create_manager' (97775f79-5100-479e-b474-25f2dc6f72bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a6dab5b6-82f5-4b35-8d82-5ebaa1d49016 tempest-ProjectReaderTests-1647148893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8994532f-81e9-4978-9343-55c12fc23f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a6dab5b6-82f5-4b35-8d82-5ebaa1d49016 tempest-ProjectReaderTests-1647148893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8994532f-81e9-4978-9343-55c12fc23f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1928726766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cddb3a88-21a5-4d63-86ea-d3c0f847ec4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5c3f380906d4629b3d5460f394b4b3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:51:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:51:53Z,use_quota=True,user_id='d4ccbb249b6a41089b426e7a0f18cfc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a6dab5b6-82f5-4b35-8d82-5ebaa1d49016 tempest-ProjectReaderTests-1647148893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5c1d09d-9473-476d-8fdd-1b9f25edc3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a6dab5b6-82f5-4b35-8d82-5ebaa1d49016 tempest-ProjectReaderTests-1647148893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5c1d09d-9473-476d-8fdd-1b9f25edc3aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a6dab5b6-82f5-4b35-8d82-5ebaa1d49016 tempest-ProjectReaderTests-1647148893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79044670-3878-48f6-9e33-43a5932dde54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a6dab5b6-82f5-4b35-8d82-5ebaa1d49016 tempest-ProjectReaderTests-1647148893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79044670-3878-48f6-9e33-43a5932dde54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cddb3a88-21a5-4d63-86ea-d3c0f847ec4a', 'volume_name': 'volume-cddb3a88-21a5-4d63-86ea-d3c0f847ec4a', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a6dab5b6-82f5-4b35-8d82-5ebaa1d49016 tempest-ProjectReaderTests-1647148893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a01f48e9-5a46-4827-9a1b-f115b62d782f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a6dab5b6-82f5-4b35-8d82-5ebaa1d49016 tempest-ProjectReaderTests-1647148893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a01f48e9-5a46-4827-9a1b-f115b62d782f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:53 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a6dab5b6-82f5-4b35-8d82-5ebaa1d49016 tempest-ProjectReaderTests-1647148893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (930fd226-5283-4604-b2a4-aca846da5093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:53 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-a6dab5b6-82f5-4b35-8d82-5ebaa1d49016 tempest-ProjectReaderTests-1647148893 None] Volume cddb3a88-21a5-4d63-86ea-d3c0f847ec4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cddb3a88-21a5-4d63-86ea-d3c0f847ec4a', 'volume_size': 1} Nov 03 07:51:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a6dab5b6-82f5-4b35-8d82-5ebaa1d49016 tempest-ProjectReaderTests-1647148893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a6dab5b6-82f5-4b35-8d82-5ebaa1d49016 tempest-ProjectReaderTests-1647148893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:53 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a6dab5b6-82f5-4b35-8d82-5ebaa1d49016 tempest-ProjectReaderTests-1647148893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1928726766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cddb3a88-21a5-4d63-86ea-d3c0f847ec4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5c3f380906d4629b3d5460f394b4b3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:51:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:51:53Z,use_quota=True,user_id='d4ccbb249b6a41089b426e7a0f18cfc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:51:53 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-a6dab5b6-82f5-4b35-8d82-5ebaa1d49016 tempest-ProjectReaderTests-1647148893 None] Creating volume cddb3a88-21a5-4d63-86ea-d3c0f847ec4a {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:51:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a6dab5b6-82f5-4b35-8d82-5ebaa1d49016 tempest-ProjectReaderTests-1647148893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a6dab5b6-82f5-4b35-8d82-5ebaa1d49016 tempest-ProjectReaderTests-1647148893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:53 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a6dab5b6-82f5-4b35-8d82-5ebaa1d49016 tempest-ProjectReaderTests-1647148893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:53 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a6dab5b6-82f5-4b35-8d82-5ebaa1d49016 tempest-ProjectReaderTests-1647148893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a6dab5b6-82f5-4b35-8d82-5ebaa1d49016 tempest-ProjectReaderTests-1647148893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:53 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a6dab5b6-82f5-4b35-8d82-5ebaa1d49016 tempest-ProjectReaderTests-1647148893 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:51:53 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-a6dab5b6-82f5-4b35-8d82-5ebaa1d49016 tempest-ProjectReaderTests-1647148893 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:51:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a6dab5b6-82f5-4b35-8d82-5ebaa1d49016 tempest-ProjectReaderTests-1647148893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cddb3a88-21a5-4d63-86ea-d3c0f847ec4a 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:53 devstack sudo[107687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cddb3a88-21a5-4d63-86ea-d3c0f847ec4a 1073741824 Nov 03 07:51:53 devstack sudo[107687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-2de78c03-b484-442d-aad5-bbc04c960c35 tempest-ProjectMemberTests-923615420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:53 devstack sudo[107687]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a6dab5b6-82f5-4b35-8d82-5ebaa1d49016 tempest-ProjectReaderTests-1647148893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cddb3a88-21a5-4d63-86ea-d3c0f847ec4a 1073741824" returned: 0 in 0.407s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:53 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a6dab5b6-82f5-4b35-8d82-5ebaa1d49016 tempest-ProjectReaderTests-1647148893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cddb3a88-21a5-4d63-86ea-d3c0f847ec4a {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:53 devstack sudo[107692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cddb3a88-21a5-4d63-86ea-d3c0f847ec4a Nov 03 07:51:53 devstack sudo[107692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:54 devstack sudo[107692]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-a6dab5b6-82f5-4b35-8d82-5ebaa1d49016 tempest-ProjectReaderTests-1647148893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cddb3a88-21a5-4d63-86ea-d3c0f847ec4a" returned: 0 in 0.233s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:54 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-a6dab5b6-82f5-4b35-8d82-5ebaa1d49016 tempest-ProjectReaderTests-1647148893 None] <== create_volume: return (677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:51:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-a6dab5b6-82f5-4b35-8d82-5ebaa1d49016 tempest-ProjectReaderTests-1647148893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.679s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-2de78c03-b484-442d-aad5-bbc04c960c35 tempest-ProjectMemberTests-923615420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.636s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:54 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a6dab5b6-82f5-4b35-8d82-5ebaa1d49016 tempest-ProjectReaderTests-1647148893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (930fd226-5283-4604-b2a4-aca846da5093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cddb3a88-21a5-4d63-86ea-d3c0f847ec4a', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:54 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a6dab5b6-82f5-4b35-8d82-5ebaa1d49016 tempest-ProjectReaderTests-1647148893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6249abab-30a8-446d-a697-80401ee3d732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:51:54 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-2de78c03-b484-442d-aad5-bbc04c960c35 tempest-ProjectMemberTests-923615420 None] Creating offline snapshot 4ecdb536-b7f1-46b5-9e90-4f6e8da1dbb3 of volume 9c33c869-f4b5-4d03-be84-688d92a8c073 {{(pid=86875) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:51:54 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-a6dab5b6-82f5-4b35-8d82-5ebaa1d49016 tempest-ProjectReaderTests-1647148893 None] Volume volume-cddb3a88-21a5-4d63-86ea-d3c0f847ec4a (cddb3a88-21a5-4d63-86ea-d3c0f847ec4a): created successfully Nov 03 07:51:54 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a6dab5b6-82f5-4b35-8d82-5ebaa1d49016 tempest-ProjectReaderTests-1647148893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6249abab-30a8-446d-a697-80401ee3d732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:51:54 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-a6dab5b6-82f5-4b35-8d82-5ebaa1d49016 tempest-ProjectReaderTests-1647148893 None] Flow 'volume_create_manager' (97775f79-5100-479e-b474-25f2dc6f72bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:51:54 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b66685-49cb-46a3-9850-5b99654fb80b]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2de78c03-b484-442d-aad5-bbc04c960c35 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9c33c869-f4b5-4d03-be84-688d92a8c073 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:54 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-a6dab5b6-82f5-4b35-8d82-5ebaa1d49016 tempest-ProjectReaderTests-1647148893 None] Created volume successfully. Nov 03 07:51:54 devstack sudo[107695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9c33c869-f4b5-4d03-be84-688d92a8c073 Nov 03 07:51:54 devstack sudo[107695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:54 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-7436bd7e-cdb5-481f-9da2-057f991de129 tempest-ProjectReaderTests-1647148893 None] Acquiring lock "cinder-cddb3a88-21a5-4d63-86ea-d3c0f847ec4a-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:54 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-7436bd7e-cdb5-481f-9da2-057f991de129 tempest-ProjectReaderTests-1647148893 None] Lock "cinder-cddb3a88-21a5-4d63-86ea-d3c0f847ec4a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:54 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-7436bd7e-cdb5-481f-9da2-057f991de129 tempest-ProjectReaderTests-1647148893 None] Acquiring lock "cinder-quobyte-cddb3a88-21a5-4d63-86ea-d3c0f847ec4a" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:54 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-7436bd7e-cdb5-481f-9da2-057f991de129 tempest-ProjectReaderTests-1647148893 None] Lock "cinder-quobyte-cddb3a88-21a5-4d63-86ea-d3c0f847ec4a" acquired by "delete_volume" :: waited 0.016s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:54 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be1a1d1-070f-4aed-860b-82a11762bd2d]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7436bd7e-cdb5-481f-9da2-057f991de129 tempest-ProjectReaderTests-1647148893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cddb3a88-21a5-4d63-86ea-d3c0f847ec4a {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:54 devstack sudo[107695]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2de78c03-b484-442d-aad5-bbc04c960c35 tempest-ProjectMemberTests-923615420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9c33c869-f4b5-4d03-be84-688d92a8c073" returned: 0 in 0.398s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2de78c03-b484-442d-aad5-bbc04c960c35 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9c33c869-f4b5-4d03-be84-688d92a8c073,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9c33c869-f4b5-4d03-be84-688d92a8c073.4ecdb536-b7f1-46b5-9e90-4f6e8da1dbb3 1G {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:54 devstack sudo[107701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9c33c869-f4b5-4d03-be84-688d92a8c073,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9c33c869-f4b5-4d03-be84-688d92a8c073.4ecdb536-b7f1-46b5-9e90-4f6e8da1dbb3 1G Nov 03 07:51:54 devstack sudo[107701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:54 devstack sudo[107699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cddb3a88-21a5-4d63-86ea-d3c0f847ec4a Nov 03 07:51:54 devstack sudo[107699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:54 devstack sudo[107699]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7436bd7e-cdb5-481f-9da2-057f991de129 tempest-ProjectReaderTests-1647148893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cddb3a88-21a5-4d63-86ea-d3c0f847ec4a" returned: 0 in 0.359s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7436bd7e-cdb5-481f-9da2-057f991de129 tempest-ProjectReaderTests-1647148893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cddb3a88-21a5-4d63-86ea-d3c0f847ec4a {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:54 devstack sudo[107710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cddb3a88-21a5-4d63-86ea-d3c0f847ec4a Nov 03 07:51:54 devstack sudo[107710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:54 devstack sudo[107701]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2de78c03-b484-442d-aad5-bbc04c960c35 tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9c33c869-f4b5-4d03-be84-688d92a8c073,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9c33c869-f4b5-4d03-be84-688d92a8c073.4ecdb536-b7f1-46b5-9e90-4f6e8da1dbb3 1G" returned: 0 in 0.434s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:54 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2de78c03-b484-442d-aad5-bbc04c960c35 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c33c869-f4b5-4d03-be84-688d92a8c073 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9c33c869-f4b5-4d03-be84-688d92a8c073.4ecdb536-b7f1-46b5-9e90-4f6e8da1dbb3 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:54 devstack sudo[107712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c33c869-f4b5-4d03-be84-688d92a8c073 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9c33c869-f4b5-4d03-be84-688d92a8c073.4ecdb536-b7f1-46b5-9e90-4f6e8da1dbb3 Nov 03 07:51:54 devstack sudo[107712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:55 devstack sudo[107710]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7436bd7e-cdb5-481f-9da2-057f991de129 tempest-ProjectReaderTests-1647148893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-cddb3a88-21a5-4d63-86ea-d3c0f847ec4a" returned: 0 in 0.262s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:55 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-7436bd7e-cdb5-481f-9da2-057f991de129 tempest-ProjectReaderTests-1647148893 None] Lock "cinder-quobyte-cddb3a88-21a5-4d63-86ea-d3c0f847ec4a" released by "delete_volume" :: held 0.677s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:55 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-7436bd7e-cdb5-481f-9da2-057f991de129 tempest-ProjectReaderTests-1647148893 None] Created reservations ['5e10203d-8853-44b8-a30d-41586d8d8853', 'bbf85f2e-39f8-44b3-b79b-adffd3775c55', '26db0689-8d89-4edf-b9a6-27a3b1469950', '6e03c2c4-872a-4a06-b4ca-1b51bcf6b161'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:51:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7436bd7e-cdb5-481f-9da2-057f991de129 tempest-ProjectReaderTests-1647148893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7436bd7e-cdb5-481f-9da2-057f991de129 tempest-ProjectReaderTests-1647148893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:55 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-7436bd7e-cdb5-481f-9da2-057f991de129 tempest-ProjectReaderTests-1647148893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:55 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-7436bd7e-cdb5-481f-9da2-057f991de129 tempest-ProjectReaderTests-1647148893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-7436bd7e-cdb5-481f-9da2-057f991de129 tempest-ProjectReaderTests-1647148893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7436bd7e-cdb5-481f-9da2-057f991de129 tempest-ProjectReaderTests-1647148893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:55 devstack sudo[107718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:51:55 devstack sudo[107718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:55 devstack sudo[107712]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2de78c03-b484-442d-aad5-bbc04c960c35 tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c33c869-f4b5-4d03-be84-688d92a8c073 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9c33c869-f4b5-4d03-be84-688d92a8c073.4ecdb536-b7f1-46b5-9e90-4f6e8da1dbb3" returned: 0 in 0.313s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:55 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-2de78c03-b484-442d-aad5-bbc04c960c35 tempest-ProjectMemberTests-923615420 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9c33c869-f4b5-4d03-be84-688d92a8c073.4ecdb536-b7f1-46b5-9e90-4f6e8da1dbb3 is being set with open permissions: ugo+rw Nov 03 07:51:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2de78c03-b484-442d-aad5-bbc04c960c35 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9c33c869-f4b5-4d03-be84-688d92a8c073.4ecdb536-b7f1-46b5-9e90-4f6e8da1dbb3 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:55 devstack sudo[107720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9c33c869-f4b5-4d03-be84-688d92a8c073.4ecdb536-b7f1-46b5-9e90-4f6e8da1dbb3 Nov 03 07:51:55 devstack sudo[107720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:55 devstack sudo[107718]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-7436bd7e-cdb5-481f-9da2-057f991de129 tempest-ProjectReaderTests-1647148893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.259s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:55 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-7436bd7e-cdb5-481f-9da2-057f991de129 tempest-ProjectReaderTests-1647148893 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:51:55 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-7436bd7e-cdb5-481f-9da2-057f991de129 tempest-ProjectReaderTests-1647148893 None] Deleted volume successfully. Nov 03 07:51:55 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-7436bd7e-cdb5-481f-9da2-057f991de129 tempest-ProjectReaderTests-1647148893 None] Lock "cinder-cddb3a88-21a5-4d63-86ea-d3c0f847ec4a-delete_volume" released by "delete_volume" :: held 1.140s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:55 devstack sudo[107720]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2de78c03-b484-442d-aad5-bbc04c960c35 tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9c33c869-f4b5-4d03-be84-688d92a8c073.4ecdb536-b7f1-46b5-9e90-4f6e8da1dbb3" returned: 0 in 0.251s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2de78c03-b484-442d-aad5-bbc04c960c35 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9c33c869-f4b5-4d03-be84-688d92a8c073.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:55 devstack sudo[107724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9c33c869-f4b5-4d03-be84-688d92a8c073.info Nov 03 07:51:55 devstack sudo[107724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:55 devstack sudo[107724]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2de78c03-b484-442d-aad5-bbc04c960c35 tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9c33c869-f4b5-4d03-be84-688d92a8c073.info" returned: 0 in 0.251s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:55 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-2de78c03-b484-442d-aad5-bbc04c960c35 tempest-ProjectMemberTests-923615420 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9c33c869-f4b5-4d03-be84-688d92a8c073.info is being set with open permissions: ugo+rw Nov 03 07:51:55 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2de78c03-b484-442d-aad5-bbc04c960c35 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9c33c869-f4b5-4d03-be84-688d92a8c073.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:55 devstack sudo[107727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9c33c869-f4b5-4d03-be84-688d92a8c073.info Nov 03 07:51:55 devstack sudo[107727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:56 devstack sudo[107727]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-2de78c03-b484-442d-aad5-bbc04c960c35 tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9c33c869-f4b5-4d03-be84-688d92a8c073.info" returned: 0 in 0.264s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-2de78c03-b484-442d-aad5-bbc04c960c35 tempest-ProjectMemberTests-923615420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.014s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:56 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-2de78c03-b484-442d-aad5-bbc04c960c35 tempest-ProjectMemberTests-923615420 None] Create snapshot completed successfully Nov 03 07:51:56 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-75911650-9632-4402-9cfc-c0be2ddae16e tempest-ProjectMemberTests-923615420 None] Acquiring lock "cinder-4ecdb536-b7f1-46b5-9e90-4f6e8da1dbb3-delete_snapshot" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:56 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-75911650-9632-4402-9cfc-c0be2ddae16e tempest-ProjectMemberTests-923615420 None] Lock "cinder-4ecdb536-b7f1-46b5-9e90-4f6e8da1dbb3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:56 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-75911650-9632-4402-9cfc-c0be2ddae16e tempest-ProjectMemberTests-923615420 None] Acquiring lock "cinder-quobyte-9c33c869-f4b5-4d03-be84-688d92a8c073" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:56 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-75911650-9632-4402-9cfc-c0be2ddae16e tempest-ProjectMemberTests-923615420 None] Lock "cinder-quobyte-9c33c869-f4b5-4d03-be84-688d92a8c073" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:56 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-75911650-9632-4402-9cfc-c0be2ddae16e tempest-ProjectMemberTests-923615420 None] Acquiring lock "cinder-quobyte-4ecdb536-b7f1-46b5-9e90-4f6e8da1dbb3" by "_delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:56 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-75911650-9632-4402-9cfc-c0be2ddae16e tempest-ProjectMemberTests-923615420 None] Lock "cinder-quobyte-4ecdb536-b7f1-46b5-9e90-4f6e8da1dbb3" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:56 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-75911650-9632-4402-9cfc-c0be2ddae16e tempest-ProjectMemberTests-923615420 None] Deleting offline snapshot 4ecdb536-b7f1-46b5-9e90-4f6e8da1dbb3 of volume 9c33c869-f4b5-4d03-be84-688d92a8c073 {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:51:56 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-75911650-9632-4402-9cfc-c0be2ddae16e tempest-ProjectMemberTests-923615420 None] snapshot_file for this snap is: volume-9c33c869-f4b5-4d03-be84-688d92a8c073.4ecdb536-b7f1-46b5-9e90-4f6e8da1dbb3 {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:51:56 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c2ceb2-f444-416b-bf7b-53531b1c3d4b]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:56 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-75911650-9632-4402-9cfc-c0be2ddae16e tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9c33c869-f4b5-4d03-be84-688d92a8c073.4ecdb536-b7f1-46b5-9e90-4f6e8da1dbb3 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:56 devstack sudo[107730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9c33c869-f4b5-4d03-be84-688d92a8c073.4ecdb536-b7f1-46b5-9e90-4f6e8da1dbb3 Nov 03 07:51:56 devstack sudo[107730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:57 devstack sudo[107730]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-75911650-9632-4402-9cfc-c0be2ddae16e tempest-ProjectMemberTests-923615420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9c33c869-f4b5-4d03-be84-688d92a8c073.4ecdb536-b7f1-46b5-9e90-4f6e8da1dbb3" returned: 0 in 0.416s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:57 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-75911650-9632-4402-9cfc-c0be2ddae16e tempest-ProjectMemberTests-923615420 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c33c869-f4b5-4d03-be84-688d92a8c073(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:51:57 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d2c9de-67ef-447d-9897-8daac03d94e8]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-75911650-9632-4402-9cfc-c0be2ddae16e tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9c33c869-f4b5-4d03-be84-688d92a8c073 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:57 devstack sudo[107735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9c33c869-f4b5-4d03-be84-688d92a8c073 Nov 03 07:51:57 devstack sudo[107735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:57 devstack sudo[107735]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-75911650-9632-4402-9cfc-c0be2ddae16e tempest-ProjectMemberTests-923615420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9c33c869-f4b5-4d03-be84-688d92a8c073" returned: 0 in 0.365s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-75911650-9632-4402-9cfc-c0be2ddae16e tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9c33c869-f4b5-4d03-be84-688d92a8c073.4ecdb536-b7f1-46b5-9e90-4f6e8da1dbb3 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:57 devstack sudo[107740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9c33c869-f4b5-4d03-be84-688d92a8c073.4ecdb536-b7f1-46b5-9e90-4f6e8da1dbb3 Nov 03 07:51:57 devstack sudo[107740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:57 devstack sudo[107740]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-75911650-9632-4402-9cfc-c0be2ddae16e tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9c33c869-f4b5-4d03-be84-688d92a8c073.4ecdb536-b7f1-46b5-9e90-4f6e8da1dbb3" returned: 0 in 0.331s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-75911650-9632-4402-9cfc-c0be2ddae16e tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9c33c869-f4b5-4d03-be84-688d92a8c073.4ecdb536-b7f1-46b5-9e90-4f6e8da1dbb3 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:57 devstack sudo[107745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9c33c869-f4b5-4d03-be84-688d92a8c073.4ecdb536-b7f1-46b5-9e90-4f6e8da1dbb3 Nov 03 07:51:57 devstack sudo[107745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:57 devstack sudo[107745]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:57 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-75911650-9632-4402-9cfc-c0be2ddae16e tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9c33c869-f4b5-4d03-be84-688d92a8c073.4ecdb536-b7f1-46b5-9e90-4f6e8da1dbb3" returned: 0 in 0.249s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:58 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-75911650-9632-4402-9cfc-c0be2ddae16e tempest-ProjectMemberTests-923615420 None] Lock "cinder-quobyte-4ecdb536-b7f1-46b5-9e90-4f6e8da1dbb3" released by "_delete_snapshot" :: held 1.467s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:58 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-75911650-9632-4402-9cfc-c0be2ddae16e tempest-ProjectMemberTests-923615420 None] Lock "cinder-quobyte-9c33c869-f4b5-4d03-be84-688d92a8c073" released by "delete_snapshot" :: held 1.492s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:58 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-75911650-9632-4402-9cfc-c0be2ddae16e tempest-ProjectMemberTests-923615420 None] Created reservations ['c9f863b6-f146-4633-8f26-3a8b734ecf03', '8030a89c-d1f6-428b-840b-2a4234659b7e', '8504b867-ebc4-498c-9cb3-f1fc1d5a6ead', 'c8d2d404-0c53-4823-85ab-037bb733fb7d'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:51:58 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-75911650-9632-4402-9cfc-c0be2ddae16e tempest-ProjectMemberTests-923615420 None] Delete snapshot completed successfully. Nov 03 07:51:58 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-75911650-9632-4402-9cfc-c0be2ddae16e tempest-ProjectMemberTests-923615420 None] Lock "cinder-4ecdb536-b7f1-46b5-9e90-4f6e8da1dbb3-delete_snapshot" released by "delete_snapshot" :: held 1.633s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:58 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-22965681-ad7b-448a-afdc-97c86c38992e tempest-ProjectMemberTests-923615420 None] Acquiring lock "cinder-9c33c869-f4b5-4d03-be84-688d92a8c073-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:58 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-22965681-ad7b-448a-afdc-97c86c38992e tempest-ProjectMemberTests-923615420 None] Lock "cinder-9c33c869-f4b5-4d03-be84-688d92a8c073-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:58 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-22965681-ad7b-448a-afdc-97c86c38992e tempest-ProjectMemberTests-923615420 None] Acquiring lock "cinder-quobyte-9c33c869-f4b5-4d03-be84-688d92a8c073" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:51:58 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-22965681-ad7b-448a-afdc-97c86c38992e tempest-ProjectMemberTests-923615420 None] Lock "cinder-quobyte-9c33c869-f4b5-4d03-be84-688d92a8c073" acquired by "delete_volume" :: waited 0.020s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:51:58 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3fbea78-ea09-4b25-8026-af7a92a62764]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:51:58 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-22965681-ad7b-448a-afdc-97c86c38992e tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9c33c869-f4b5-4d03-be84-688d92a8c073 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:58 devstack sudo[107749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9c33c869-f4b5-4d03-be84-688d92a8c073 Nov 03 07:51:58 devstack sudo[107749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:59 devstack sudo[107749]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-22965681-ad7b-448a-afdc-97c86c38992e tempest-ProjectMemberTests-923615420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9c33c869-f4b5-4d03-be84-688d92a8c073" returned: 0 in 0.383s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-22965681-ad7b-448a-afdc-97c86c38992e tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9c33c869-f4b5-4d03-be84-688d92a8c073 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:59 devstack sudo[107754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9c33c869-f4b5-4d03-be84-688d92a8c073 Nov 03 07:51:59 devstack sudo[107754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:59 devstack sudo[107754]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-22965681-ad7b-448a-afdc-97c86c38992e tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-9c33c869-f4b5-4d03-be84-688d92a8c073" returned: 0 in 0.263s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:59 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-22965681-ad7b-448a-afdc-97c86c38992e tempest-ProjectMemberTests-923615420 None] Lock "cinder-quobyte-9c33c869-f4b5-4d03-be84-688d92a8c073" released by "delete_volume" :: held 0.714s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:51:59 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-22965681-ad7b-448a-afdc-97c86c38992e tempest-ProjectMemberTests-923615420 None] Created reservations ['053ec308-bd1a-4009-8fbd-a4a0b3ef3d2f', '8f0aa6c2-9b59-4216-9a60-5461d72d7231', '87a6e726-76b3-4aa3-9d73-7b8d1a206235', 'e641683c-a57c-4f08-b4e2-f78657f1c9cf'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:51:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-22965681-ad7b-448a-afdc-97c86c38992e tempest-ProjectMemberTests-923615420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:51:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-22965681-ad7b-448a-afdc-97c86c38992e tempest-ProjectMemberTests-923615420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:51:59 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-22965681-ad7b-448a-afdc-97c86c38992e tempest-ProjectMemberTests-923615420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:51:59 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-22965681-ad7b-448a-afdc-97c86c38992e tempest-ProjectMemberTests-923615420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:51:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-22965681-ad7b-448a-afdc-97c86c38992e tempest-ProjectMemberTests-923615420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:51:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-22965681-ad7b-448a-afdc-97c86c38992e tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:51:59 devstack sudo[107757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:51:59 devstack sudo[107757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:51:59 devstack sudo[107757]: pam_unix(sudo:session): session closed for user root Nov 03 07:51:59 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-22965681-ad7b-448a-afdc-97c86c38992e tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.259s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:51:59 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-22965681-ad7b-448a-afdc-97c86c38992e tempest-ProjectMemberTests-923615420 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:51:59 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-22965681-ad7b-448a-afdc-97c86c38992e tempest-ProjectMemberTests-923615420 None] Deleted volume successfully. Nov 03 07:51:59 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-22965681-ad7b-448a-afdc-97c86c38992e tempest-ProjectMemberTests-923615420 None] Lock "cinder-9c33c869-f4b5-4d03-be84-688d92a8c073-delete_volume" released by "delete_volume" :: held 1.250s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:00 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2cb5308-aa3c-4c1b-88cc-a573c81707df tempest-ProjectMemberTests-923615420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:52:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e2cb5308-aa3c-4c1b-88cc-a573c81707df tempest-ProjectMemberTests-923615420 None] Flow 'volume_create_manager' (b5ab2a8c-105f-4dec-9b63-76a3e69b5a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:52:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e2cb5308-aa3c-4c1b-88cc-a573c81707df tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bb0559c-6fdc-49bb-aac8-e215136dc7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e2cb5308-aa3c-4c1b-88cc-a573c81707df tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bb0559c-6fdc-49bb-aac8-e215136dc7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:52:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-426463147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=959eb0ce-19ff-450a-8cc5-1548fe4d4d05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed2c0b7d26474c8aaafc23b6762bdc56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:52:00Z,use_quota=True,user_id='7d2824260e354882bea7f7a6989d9f16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e2cb5308-aa3c-4c1b-88cc-a573c81707df tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e2c05cd-fd29-4773-ba08-bb43a6b343e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e2cb5308-aa3c-4c1b-88cc-a573c81707df tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e2c05cd-fd29-4773-ba08-bb43a6b343e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e2cb5308-aa3c-4c1b-88cc-a573c81707df tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bfc345c-dbae-4f8e-b292-727b48d656b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e2cb5308-aa3c-4c1b-88cc-a573c81707df tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bfc345c-dbae-4f8e-b292-727b48d656b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '959eb0ce-19ff-450a-8cc5-1548fe4d4d05', 'volume_name': 'volume-959eb0ce-19ff-450a-8cc5-1548fe4d4d05', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e2cb5308-aa3c-4c1b-88cc-a573c81707df tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8c80302-16ec-4d0f-8fdb-724f2ef9e051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e2cb5308-aa3c-4c1b-88cc-a573c81707df tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8c80302-16ec-4d0f-8fdb-724f2ef9e051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:00 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e2cb5308-aa3c-4c1b-88cc-a573c81707df tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f17682a-f9cf-4bfb-9a7b-f8d4a456c68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:00 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-e2cb5308-aa3c-4c1b-88cc-a573c81707df tempest-ProjectMemberTests-923615420 None] Volume 959eb0ce-19ff-450a-8cc5-1548fe4d4d05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-959eb0ce-19ff-450a-8cc5-1548fe4d4d05', 'volume_size': 1} Nov 03 07:52:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e2cb5308-aa3c-4c1b-88cc-a573c81707df tempest-ProjectMemberTests-923615420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:52:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e2cb5308-aa3c-4c1b-88cc-a573c81707df tempest-ProjectMemberTests-923615420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:52:00 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-e2cb5308-aa3c-4c1b-88cc-a573c81707df tempest-ProjectMemberTests-923615420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:52:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-426463147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=959eb0ce-19ff-450a-8cc5-1548fe4d4d05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed2c0b7d26474c8aaafc23b6762bdc56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:52:00Z,use_quota=True,user_id='7d2824260e354882bea7f7a6989d9f16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:52:00 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-e2cb5308-aa3c-4c1b-88cc-a573c81707df tempest-ProjectMemberTests-923615420 None] Creating volume 959eb0ce-19ff-450a-8cc5-1548fe4d4d05 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:52:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e2cb5308-aa3c-4c1b-88cc-a573c81707df tempest-ProjectMemberTests-923615420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:52:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e2cb5308-aa3c-4c1b-88cc-a573c81707df tempest-ProjectMemberTests-923615420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:52:00 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-e2cb5308-aa3c-4c1b-88cc-a573c81707df tempest-ProjectMemberTests-923615420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:52:00 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-e2cb5308-aa3c-4c1b-88cc-a573c81707df tempest-ProjectMemberTests-923615420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:52:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e2cb5308-aa3c-4c1b-88cc-a573c81707df tempest-ProjectMemberTests-923615420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:52:00 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-e2cb5308-aa3c-4c1b-88cc-a573c81707df tempest-ProjectMemberTests-923615420 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:52:00 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-e2cb5308-aa3c-4c1b-88cc-a573c81707df tempest-ProjectMemberTests-923615420 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:52:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e2cb5308-aa3c-4c1b-88cc-a573c81707df tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-959eb0ce-19ff-450a-8cc5-1548fe4d4d05 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:00 devstack sudo[107760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-959eb0ce-19ff-450a-8cc5-1548fe4d4d05 1073741824 Nov 03 07:52:00 devstack sudo[107760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:00 devstack sudo[107760]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e2cb5308-aa3c-4c1b-88cc-a573c81707df tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-959eb0ce-19ff-450a-8cc5-1548fe4d4d05 1073741824" returned: 0 in 0.479s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:00 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e2cb5308-aa3c-4c1b-88cc-a573c81707df tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-959eb0ce-19ff-450a-8cc5-1548fe4d4d05 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:00 devstack sudo[107766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-959eb0ce-19ff-450a-8cc5-1548fe4d4d05 Nov 03 07:52:00 devstack sudo[107766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:01 devstack sudo[107766]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e2cb5308-aa3c-4c1b-88cc-a573c81707df tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-959eb0ce-19ff-450a-8cc5-1548fe4d4d05" returned: 0 in 0.258s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:01 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-e2cb5308-aa3c-4c1b-88cc-a573c81707df tempest-ProjectMemberTests-923615420 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:52:01 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e2cb5308-aa3c-4c1b-88cc-a573c81707df tempest-ProjectMemberTests-923615420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:52:01 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e2cb5308-aa3c-4c1b-88cc-a573c81707df tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f17682a-f9cf-4bfb-9a7b-f8d4a456c68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-959eb0ce-19ff-450a-8cc5-1548fe4d4d05', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:01 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e2cb5308-aa3c-4c1b-88cc-a573c81707df tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f50de6f-9292-4adf-8cf2-cb6488d2d0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:01 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-e2cb5308-aa3c-4c1b-88cc-a573c81707df tempest-ProjectMemberTests-923615420 None] Volume volume-959eb0ce-19ff-450a-8cc5-1548fe4d4d05 (959eb0ce-19ff-450a-8cc5-1548fe4d4d05): created successfully Nov 03 07:52:01 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e2cb5308-aa3c-4c1b-88cc-a573c81707df tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f50de6f-9292-4adf-8cf2-cb6488d2d0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:01 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-e2cb5308-aa3c-4c1b-88cc-a573c81707df tempest-ProjectMemberTests-923615420 None] Flow 'volume_create_manager' (b5ab2a8c-105f-4dec-9b63-76a3e69b5a32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:52:01 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-e2cb5308-aa3c-4c1b-88cc-a573c81707df tempest-ProjectMemberTests-923615420 None] Created volume successfully. Nov 03 07:52:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-5de01479-218e-47de-b812-95fe9ba2a4ed tempest-ProjectMemberTests-923615420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:52:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-5de01479-218e-47de-b812-95fe9ba2a4ed tempest-ProjectMemberTests-923615420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:52:02 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-5de01479-218e-47de-b812-95fe9ba2a4ed tempest-ProjectMemberTests-923615420 None] Creating offline snapshot 3ca13ef2-88a5-41e7-bede-6ee1c4cbd725 of volume 959eb0ce-19ff-450a-8cc5-1548fe4d4d05 {{(pid=86875) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:52:02 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b40a8af-3d5a-47ea-8ed8-0690e35cc8bc]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:52:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5de01479-218e-47de-b812-95fe9ba2a4ed tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-959eb0ce-19ff-450a-8cc5-1548fe4d4d05 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:02 devstack sudo[107769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-959eb0ce-19ff-450a-8cc5-1548fe4d4d05 Nov 03 07:52:02 devstack sudo[107769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:02 devstack sudo[107769]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5de01479-218e-47de-b812-95fe9ba2a4ed tempest-ProjectMemberTests-923615420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-959eb0ce-19ff-450a-8cc5-1548fe4d4d05" returned: 0 in 0.343s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:02 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5de01479-218e-47de-b812-95fe9ba2a4ed tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-959eb0ce-19ff-450a-8cc5-1548fe4d4d05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-959eb0ce-19ff-450a-8cc5-1548fe4d4d05.3ca13ef2-88a5-41e7-bede-6ee1c4cbd725 1G {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:02 devstack sudo[107775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-959eb0ce-19ff-450a-8cc5-1548fe4d4d05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-959eb0ce-19ff-450a-8cc5-1548fe4d4d05.3ca13ef2-88a5-41e7-bede-6ee1c4cbd725 1G Nov 03 07:52:02 devstack sudo[107775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:03 devstack sudo[107775]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5de01479-218e-47de-b812-95fe9ba2a4ed tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-959eb0ce-19ff-450a-8cc5-1548fe4d4d05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-959eb0ce-19ff-450a-8cc5-1548fe4d4d05.3ca13ef2-88a5-41e7-bede-6ee1c4cbd725 1G" returned: 0 in 0.380s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5de01479-218e-47de-b812-95fe9ba2a4ed tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-959eb0ce-19ff-450a-8cc5-1548fe4d4d05 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-959eb0ce-19ff-450a-8cc5-1548fe4d4d05.3ca13ef2-88a5-41e7-bede-6ee1c4cbd725 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:03 devstack sudo[107780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-959eb0ce-19ff-450a-8cc5-1548fe4d4d05 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-959eb0ce-19ff-450a-8cc5-1548fe4d4d05.3ca13ef2-88a5-41e7-bede-6ee1c4cbd725 Nov 03 07:52:03 devstack sudo[107780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:03 devstack sudo[107780]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5de01479-218e-47de-b812-95fe9ba2a4ed tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-959eb0ce-19ff-450a-8cc5-1548fe4d4d05 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-959eb0ce-19ff-450a-8cc5-1548fe4d4d05.3ca13ef2-88a5-41e7-bede-6ee1c4cbd725" returned: 0 in 0.273s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:03 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-5de01479-218e-47de-b812-95fe9ba2a4ed tempest-ProjectMemberTests-923615420 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-959eb0ce-19ff-450a-8cc5-1548fe4d4d05.3ca13ef2-88a5-41e7-bede-6ee1c4cbd725 is being set with open permissions: ugo+rw Nov 03 07:52:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5de01479-218e-47de-b812-95fe9ba2a4ed tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-959eb0ce-19ff-450a-8cc5-1548fe4d4d05.3ca13ef2-88a5-41e7-bede-6ee1c4cbd725 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:03 devstack sudo[107785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-959eb0ce-19ff-450a-8cc5-1548fe4d4d05.3ca13ef2-88a5-41e7-bede-6ee1c4cbd725 Nov 03 07:52:03 devstack sudo[107785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:03 devstack cinder-volume[86875]: DEBUG oslo_service.periodic_task [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86875) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:52:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:52:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:52:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:52:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:52:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:52:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:03 devstack sudo[107787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:52:03 devstack sudo[107787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:03 devstack sudo[107785]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5de01479-218e-47de-b812-95fe9ba2a4ed tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-959eb0ce-19ff-450a-8cc5-1548fe4d4d05.3ca13ef2-88a5-41e7-bede-6ee1c4cbd725" returned: 0 in 0.254s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:03 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:UPDATE=264,cinder:SELECT=194,cinder:INSERT=68,cinder:DELETE=22 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:52:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5de01479-218e-47de-b812-95fe9ba2a4ed tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-959eb0ce-19ff-450a-8cc5-1548fe4d4d05.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:03 devstack sudo[107787]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.246s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:03 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:52:03 devstack sudo[107791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-959eb0ce-19ff-450a-8cc5-1548fe4d4d05.info Nov 03 07:52:03 devstack cinder-volume[86875]: DEBUG oslo_service.periodic_task [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running periodic task VolumeManager._thread_info {{(pid=86875) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:52:03 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] thread count: 29 {{(pid=86875) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:52:03 devstack sudo[107791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:03 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] thread info: [<_MainThread(MainThread, started 125626325639296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86875) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 07:52:04 devstack sudo[107791]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5de01479-218e-47de-b812-95fe9ba2a4ed tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-959eb0ce-19ff-450a-8cc5-1548fe4d4d05.info" returned: 0 in 0.244s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:04 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-5de01479-218e-47de-b812-95fe9ba2a4ed tempest-ProjectMemberTests-923615420 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-959eb0ce-19ff-450a-8cc5-1548fe4d4d05.info is being set with open permissions: ugo+rw Nov 03 07:52:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5de01479-218e-47de-b812-95fe9ba2a4ed tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-959eb0ce-19ff-450a-8cc5-1548fe4d4d05.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:04 devstack sudo[107794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-959eb0ce-19ff-450a-8cc5-1548fe4d4d05.info Nov 03 07:52:04 devstack sudo[107794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:04 devstack sudo[107794]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5de01479-218e-47de-b812-95fe9ba2a4ed tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-959eb0ce-19ff-450a-8cc5-1548fe4d4d05.info" returned: 0 in 0.238s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-5de01479-218e-47de-b812-95fe9ba2a4ed tempest-ProjectMemberTests-923615420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.832s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:52:04 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:SELECT=191,cinder:UPDATE=263,cinder:INSERT=69,cinder:DELETE=22 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:52:04 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-5de01479-218e-47de-b812-95fe9ba2a4ed tempest-ProjectMemberTests-923615420 None] Create snapshot completed successfully Nov 03 07:52:04 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d2aa5f0a-8f41-458a-ba44-47ae59466c34 tempest-ProjectMemberTests-923615420 None] Acquiring lock "cinder-3ca13ef2-88a5-41e7-bede-6ee1c4cbd725-delete_snapshot" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:04 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d2aa5f0a-8f41-458a-ba44-47ae59466c34 tempest-ProjectMemberTests-923615420 None] Lock "cinder-3ca13ef2-88a5-41e7-bede-6ee1c4cbd725-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:04 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d2aa5f0a-8f41-458a-ba44-47ae59466c34 tempest-ProjectMemberTests-923615420 None] Acquiring lock "cinder-quobyte-959eb0ce-19ff-450a-8cc5-1548fe4d4d05" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:04 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d2aa5f0a-8f41-458a-ba44-47ae59466c34 tempest-ProjectMemberTests-923615420 None] Lock "cinder-quobyte-959eb0ce-19ff-450a-8cc5-1548fe4d4d05" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:04 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d2aa5f0a-8f41-458a-ba44-47ae59466c34 tempest-ProjectMemberTests-923615420 None] Acquiring lock "cinder-quobyte-3ca13ef2-88a5-41e7-bede-6ee1c4cbd725" by "_delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:04 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d2aa5f0a-8f41-458a-ba44-47ae59466c34 tempest-ProjectMemberTests-923615420 None] Lock "cinder-quobyte-3ca13ef2-88a5-41e7-bede-6ee1c4cbd725" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:04 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-d2aa5f0a-8f41-458a-ba44-47ae59466c34 tempest-ProjectMemberTests-923615420 None] Deleting offline snapshot 3ca13ef2-88a5-41e7-bede-6ee1c4cbd725 of volume 959eb0ce-19ff-450a-8cc5-1548fe4d4d05 {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:52:04 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-d2aa5f0a-8f41-458a-ba44-47ae59466c34 tempest-ProjectMemberTests-923615420 None] snapshot_file for this snap is: volume-959eb0ce-19ff-450a-8cc5-1548fe4d4d05.3ca13ef2-88a5-41e7-bede-6ee1c4cbd725 {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:52:04 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[94be4e86-c3b8-45de-ac54-f2d161d65fc1]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:52:04 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d2aa5f0a-8f41-458a-ba44-47ae59466c34 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-959eb0ce-19ff-450a-8cc5-1548fe4d4d05.3ca13ef2-88a5-41e7-bede-6ee1c4cbd725 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:04 devstack sudo[107797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-959eb0ce-19ff-450a-8cc5-1548fe4d4d05.3ca13ef2-88a5-41e7-bede-6ee1c4cbd725 Nov 03 07:52:04 devstack sudo[107797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:05 devstack sudo[107797]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d2aa5f0a-8f41-458a-ba44-47ae59466c34 tempest-ProjectMemberTests-923615420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-959eb0ce-19ff-450a-8cc5-1548fe4d4d05.3ca13ef2-88a5-41e7-bede-6ee1c4cbd725" returned: 0 in 0.349s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:05 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-d2aa5f0a-8f41-458a-ba44-47ae59466c34 tempest-ProjectMemberTests-923615420 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-959eb0ce-19ff-450a-8cc5-1548fe4d4d05(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:52:05 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cae1b08-0b60-4f93-a340-3a8068b53ecc]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:52:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d2aa5f0a-8f41-458a-ba44-47ae59466c34 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-959eb0ce-19ff-450a-8cc5-1548fe4d4d05 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:05 devstack sudo[107802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-959eb0ce-19ff-450a-8cc5-1548fe4d4d05 Nov 03 07:52:05 devstack sudo[107802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:05 devstack sudo[107802]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d2aa5f0a-8f41-458a-ba44-47ae59466c34 tempest-ProjectMemberTests-923615420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-959eb0ce-19ff-450a-8cc5-1548fe4d4d05" returned: 0 in 0.363s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d2aa5f0a-8f41-458a-ba44-47ae59466c34 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-959eb0ce-19ff-450a-8cc5-1548fe4d4d05.3ca13ef2-88a5-41e7-bede-6ee1c4cbd725 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:05 devstack sudo[107807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-959eb0ce-19ff-450a-8cc5-1548fe4d4d05.3ca13ef2-88a5-41e7-bede-6ee1c4cbd725 Nov 03 07:52:05 devstack sudo[107807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:05 devstack sudo[107807]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d2aa5f0a-8f41-458a-ba44-47ae59466c34 tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-959eb0ce-19ff-450a-8cc5-1548fe4d4d05.3ca13ef2-88a5-41e7-bede-6ee1c4cbd725" returned: 0 in 0.316s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:05 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d2aa5f0a-8f41-458a-ba44-47ae59466c34 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-959eb0ce-19ff-450a-8cc5-1548fe4d4d05.3ca13ef2-88a5-41e7-bede-6ee1c4cbd725 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:05 devstack sudo[107813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-959eb0ce-19ff-450a-8cc5-1548fe4d4d05.3ca13ef2-88a5-41e7-bede-6ee1c4cbd725 Nov 03 07:52:05 devstack sudo[107813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:06 devstack sudo[107813]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d2aa5f0a-8f41-458a-ba44-47ae59466c34 tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-959eb0ce-19ff-450a-8cc5-1548fe4d4d05.3ca13ef2-88a5-41e7-bede-6ee1c4cbd725" returned: 0 in 0.235s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:06 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d2aa5f0a-8f41-458a-ba44-47ae59466c34 tempest-ProjectMemberTests-923615420 None] Lock "cinder-quobyte-3ca13ef2-88a5-41e7-bede-6ee1c4cbd725" released by "_delete_snapshot" :: held 1.358s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:06 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d2aa5f0a-8f41-458a-ba44-47ae59466c34 tempest-ProjectMemberTests-923615420 None] Lock "cinder-quobyte-959eb0ce-19ff-450a-8cc5-1548fe4d4d05" released by "delete_snapshot" :: held 1.377s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:06 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-d2aa5f0a-8f41-458a-ba44-47ae59466c34 tempest-ProjectMemberTests-923615420 None] Created reservations ['88ba90b0-af58-4303-bdc0-eb5ea6b50ac3', '2b250e12-aa97-4612-83d6-2527c48cec8a', 'f787b41f-5b0e-4a23-9592-d9816298fca5', '14a08752-6717-4533-a42c-4f5bbe3d9b27'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:52:06 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-d2aa5f0a-8f41-458a-ba44-47ae59466c34 tempest-ProjectMemberTests-923615420 None] Delete snapshot completed successfully. Nov 03 07:52:06 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-d2aa5f0a-8f41-458a-ba44-47ae59466c34 tempest-ProjectMemberTests-923615420 None] Lock "cinder-3ca13ef2-88a5-41e7-bede-6ee1c4cbd725-delete_snapshot" released by "delete_snapshot" :: held 1.496s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:06 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-6e57ca73-cd77-4447-a345-07c55d1c3242 tempest-ProjectMemberTests-923615420 None] Acquiring lock "cinder-959eb0ce-19ff-450a-8cc5-1548fe4d4d05-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:06 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-6e57ca73-cd77-4447-a345-07c55d1c3242 tempest-ProjectMemberTests-923615420 None] Lock "cinder-959eb0ce-19ff-450a-8cc5-1548fe4d4d05-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:06 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-6e57ca73-cd77-4447-a345-07c55d1c3242 tempest-ProjectMemberTests-923615420 None] Acquiring lock "cinder-quobyte-959eb0ce-19ff-450a-8cc5-1548fe4d4d05" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:06 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-6e57ca73-cd77-4447-a345-07c55d1c3242 tempest-ProjectMemberTests-923615420 None] Lock "cinder-quobyte-959eb0ce-19ff-450a-8cc5-1548fe4d4d05" acquired by "delete_volume" :: waited 0.014s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:06 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56a9de3-d734-45a6-a635-0de1cb43ac34]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:52:06 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6e57ca73-cd77-4447-a345-07c55d1c3242 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-959eb0ce-19ff-450a-8cc5-1548fe4d4d05 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:07 devstack sudo[107816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-959eb0ce-19ff-450a-8cc5-1548fe4d4d05 Nov 03 07:52:07 devstack sudo[107816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:07 devstack sudo[107816]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6e57ca73-cd77-4447-a345-07c55d1c3242 tempest-ProjectMemberTests-923615420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-959eb0ce-19ff-450a-8cc5-1548fe4d4d05" returned: 0 in 0.361s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6e57ca73-cd77-4447-a345-07c55d1c3242 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-959eb0ce-19ff-450a-8cc5-1548fe4d4d05 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:07 devstack sudo[107821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-959eb0ce-19ff-450a-8cc5-1548fe4d4d05 Nov 03 07:52:07 devstack sudo[107821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:07 devstack sudo[107821]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6e57ca73-cd77-4447-a345-07c55d1c3242 tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-959eb0ce-19ff-450a-8cc5-1548fe4d4d05" returned: 0 in 0.236s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:07 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-6e57ca73-cd77-4447-a345-07c55d1c3242 tempest-ProjectMemberTests-923615420 None] Lock "cinder-quobyte-959eb0ce-19ff-450a-8cc5-1548fe4d4d05" released by "delete_volume" :: held 0.653s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:07 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-6e57ca73-cd77-4447-a345-07c55d1c3242 tempest-ProjectMemberTests-923615420 None] Created reservations ['cb9c183f-0d99-453b-b96e-c08b0929ec25', 'c7cd72bc-7114-4286-8b44-a183b7fc9609', '756a53c4-7075-4392-98e5-28353c127442', '155a0d40-dde2-476e-8f1e-7a24816bb424'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:52:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-6e57ca73-cd77-4447-a345-07c55d1c3242 tempest-ProjectMemberTests-923615420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:52:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-6e57ca73-cd77-4447-a345-07c55d1c3242 tempest-ProjectMemberTests-923615420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:52:07 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-6e57ca73-cd77-4447-a345-07c55d1c3242 tempest-ProjectMemberTests-923615420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:52:07 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-6e57ca73-cd77-4447-a345-07c55d1c3242 tempest-ProjectMemberTests-923615420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:52:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-6e57ca73-cd77-4447-a345-07c55d1c3242 tempest-ProjectMemberTests-923615420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:52:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6e57ca73-cd77-4447-a345-07c55d1c3242 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:07 devstack sudo[107824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:52:07 devstack sudo[107824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:07 devstack sudo[107824]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:07 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6e57ca73-cd77-4447-a345-07c55d1c3242 tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.236s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:07 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-6e57ca73-cd77-4447-a345-07c55d1c3242 tempest-ProjectMemberTests-923615420 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:52:07 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-6e57ca73-cd77-4447-a345-07c55d1c3242 tempest-ProjectMemberTests-923615420 None] Deleted volume successfully. Nov 03 07:52:07 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-6e57ca73-cd77-4447-a345-07c55d1c3242 tempest-ProjectMemberTests-923615420 None] Lock "cinder-959eb0ce-19ff-450a-8cc5-1548fe4d4d05-delete_volume" released by "delete_volume" :: held 1.097s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:08 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5585408-543d-402e-ad76-5c16b0d112fc tempest-ProjectMemberTests-923615420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:52:08 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c5585408-543d-402e-ad76-5c16b0d112fc tempest-ProjectMemberTests-923615420 None] Flow 'volume_create_manager' (dcd796d4-0745-4997-9c16-afad06bca6f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:52:08 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c5585408-543d-402e-ad76-5c16b0d112fc tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f2ad47b-3fe1-421a-856a-7c6389bc3a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:08 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c5585408-543d-402e-ad76-5c16b0d112fc tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f2ad47b-3fe1-421a-856a-7c6389bc3a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:52:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1165880528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d28dbf1-1107-4275-b80d-216395fbd761,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed2c0b7d26474c8aaafc23b6762bdc56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:52:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:52:08Z,use_quota=True,user_id='7d2824260e354882bea7f7a6989d9f16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:08 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c5585408-543d-402e-ad76-5c16b0d112fc tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e3b58b3-bf6b-4f7a-8634-ea3c6e5931e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:08 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c5585408-543d-402e-ad76-5c16b0d112fc tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e3b58b3-bf6b-4f7a-8634-ea3c6e5931e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:08 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c5585408-543d-402e-ad76-5c16b0d112fc tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eefa4cab-2d17-4197-b5b2-53ae5a6134d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:08 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c5585408-543d-402e-ad76-5c16b0d112fc tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eefa4cab-2d17-4197-b5b2-53ae5a6134d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d28dbf1-1107-4275-b80d-216395fbd761', 'volume_name': 'volume-8d28dbf1-1107-4275-b80d-216395fbd761', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:08 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c5585408-543d-402e-ad76-5c16b0d112fc tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b68cb03-708d-46b7-bc8c-6b1634bed338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:08 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c5585408-543d-402e-ad76-5c16b0d112fc tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b68cb03-708d-46b7-bc8c-6b1634bed338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:08 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c5585408-543d-402e-ad76-5c16b0d112fc tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91423ad1-1a9a-4f9e-b946-8db0e50b3a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:08 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-c5585408-543d-402e-ad76-5c16b0d112fc tempest-ProjectMemberTests-923615420 None] Volume 8d28dbf1-1107-4275-b80d-216395fbd761: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d28dbf1-1107-4275-b80d-216395fbd761', 'volume_size': 1} Nov 03 07:52:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-c5585408-543d-402e-ad76-5c16b0d112fc tempest-ProjectMemberTests-923615420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:52:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-c5585408-543d-402e-ad76-5c16b0d112fc tempest-ProjectMemberTests-923615420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:52:08 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-c5585408-543d-402e-ad76-5c16b0d112fc tempest-ProjectMemberTests-923615420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:52:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1165880528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d28dbf1-1107-4275-b80d-216395fbd761,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed2c0b7d26474c8aaafc23b6762bdc56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:52:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:52:08Z,use_quota=True,user_id='7d2824260e354882bea7f7a6989d9f16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:52:08 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-c5585408-543d-402e-ad76-5c16b0d112fc tempest-ProjectMemberTests-923615420 None] Creating volume 8d28dbf1-1107-4275-b80d-216395fbd761 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:52:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-c5585408-543d-402e-ad76-5c16b0d112fc tempest-ProjectMemberTests-923615420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:52:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-c5585408-543d-402e-ad76-5c16b0d112fc tempest-ProjectMemberTests-923615420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:52:08 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-c5585408-543d-402e-ad76-5c16b0d112fc tempest-ProjectMemberTests-923615420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:52:08 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-c5585408-543d-402e-ad76-5c16b0d112fc tempest-ProjectMemberTests-923615420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:52:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-c5585408-543d-402e-ad76-5c16b0d112fc tempest-ProjectMemberTests-923615420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:52:08 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-c5585408-543d-402e-ad76-5c16b0d112fc tempest-ProjectMemberTests-923615420 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:52:08 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-c5585408-543d-402e-ad76-5c16b0d112fc tempest-ProjectMemberTests-923615420 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:52:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c5585408-543d-402e-ad76-5c16b0d112fc tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d28dbf1-1107-4275-b80d-216395fbd761 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:08 devstack sudo[107828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d28dbf1-1107-4275-b80d-216395fbd761 1073741824 Nov 03 07:52:08 devstack sudo[107828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:08 devstack sudo[107828]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c5585408-543d-402e-ad76-5c16b0d112fc tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d28dbf1-1107-4275-b80d-216395fbd761 1073741824" returned: 0 in 0.400s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:08 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c5585408-543d-402e-ad76-5c16b0d112fc tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d28dbf1-1107-4275-b80d-216395fbd761 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:08 devstack sudo[107833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d28dbf1-1107-4275-b80d-216395fbd761 Nov 03 07:52:08 devstack sudo[107833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:09 devstack sudo[107833]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-c5585408-543d-402e-ad76-5c16b0d112fc tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d28dbf1-1107-4275-b80d-216395fbd761" returned: 0 in 0.233s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:09 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-c5585408-543d-402e-ad76-5c16b0d112fc tempest-ProjectMemberTests-923615420 None] <== create_volume: return (671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:52:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-c5585408-543d-402e-ad76-5c16b0d112fc tempest-ProjectMemberTests-923615420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.674s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:52:09 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c5585408-543d-402e-ad76-5c16b0d112fc tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91423ad1-1a9a-4f9e-b946-8db0e50b3a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d28dbf1-1107-4275-b80d-216395fbd761', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:09 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c5585408-543d-402e-ad76-5c16b0d112fc tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ab879ce-7cfc-4b6a-8255-0a6ce90833d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:09 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-c5585408-543d-402e-ad76-5c16b0d112fc tempest-ProjectMemberTests-923615420 None] Volume volume-8d28dbf1-1107-4275-b80d-216395fbd761 (8d28dbf1-1107-4275-b80d-216395fbd761): created successfully Nov 03 07:52:09 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c5585408-543d-402e-ad76-5c16b0d112fc tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ab879ce-7cfc-4b6a-8255-0a6ce90833d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:09 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-c5585408-543d-402e-ad76-5c16b0d112fc tempest-ProjectMemberTests-923615420 None] Flow 'volume_create_manager' (dcd796d4-0745-4997-9c16-afad06bca6f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:52:09 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-c5585408-543d-402e-ad76-5c16b0d112fc tempest-ProjectMemberTests-923615420 None] Created volume successfully. Nov 03 07:52:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-fb00857b-6a41-47ea-9948-95c0f64c9c09 tempest-ProjectMemberTests-923615420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:52:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-fb00857b-6a41-47ea-9948-95c0f64c9c09 tempest-ProjectMemberTests-923615420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:52:09 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-fb00857b-6a41-47ea-9948-95c0f64c9c09 tempest-ProjectMemberTests-923615420 None] Creating offline snapshot eabf9ed0-2666-4c7d-a7a1-f11e6f54c674 of volume 8d28dbf1-1107-4275-b80d-216395fbd761 {{(pid=86875) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:52:09 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc38ff4-e3e8-4f58-8caa-4fea6ba31482]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:52:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fb00857b-6a41-47ea-9948-95c0f64c9c09 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d28dbf1-1107-4275-b80d-216395fbd761 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:09 devstack sudo[107836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d28dbf1-1107-4275-b80d-216395fbd761 Nov 03 07:52:09 devstack sudo[107836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:09 devstack sudo[107836]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fb00857b-6a41-47ea-9948-95c0f64c9c09 tempest-ProjectMemberTests-923615420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d28dbf1-1107-4275-b80d-216395fbd761" returned: 0 in 0.369s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:09 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fb00857b-6a41-47ea-9948-95c0f64c9c09 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d28dbf1-1107-4275-b80d-216395fbd761,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d28dbf1-1107-4275-b80d-216395fbd761.eabf9ed0-2666-4c7d-a7a1-f11e6f54c674 1G {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:09 devstack sudo[107841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d28dbf1-1107-4275-b80d-216395fbd761,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d28dbf1-1107-4275-b80d-216395fbd761.eabf9ed0-2666-4c7d-a7a1-f11e6f54c674 1G Nov 03 07:52:09 devstack sudo[107841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:10 devstack sudo[107841]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fb00857b-6a41-47ea-9948-95c0f64c9c09 tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d28dbf1-1107-4275-b80d-216395fbd761,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d28dbf1-1107-4275-b80d-216395fbd761.eabf9ed0-2666-4c7d-a7a1-f11e6f54c674 1G" returned: 0 in 0.398s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fb00857b-6a41-47ea-9948-95c0f64c9c09 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d28dbf1-1107-4275-b80d-216395fbd761 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d28dbf1-1107-4275-b80d-216395fbd761.eabf9ed0-2666-4c7d-a7a1-f11e6f54c674 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:10 devstack sudo[107846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d28dbf1-1107-4275-b80d-216395fbd761 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d28dbf1-1107-4275-b80d-216395fbd761.eabf9ed0-2666-4c7d-a7a1-f11e6f54c674 Nov 03 07:52:10 devstack sudo[107846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:10 devstack sudo[107846]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fb00857b-6a41-47ea-9948-95c0f64c9c09 tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d28dbf1-1107-4275-b80d-216395fbd761 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d28dbf1-1107-4275-b80d-216395fbd761.eabf9ed0-2666-4c7d-a7a1-f11e6f54c674" returned: 0 in 0.281s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:10 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-fb00857b-6a41-47ea-9948-95c0f64c9c09 tempest-ProjectMemberTests-923615420 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d28dbf1-1107-4275-b80d-216395fbd761.eabf9ed0-2666-4c7d-a7a1-f11e6f54c674 is being set with open permissions: ugo+rw Nov 03 07:52:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fb00857b-6a41-47ea-9948-95c0f64c9c09 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d28dbf1-1107-4275-b80d-216395fbd761.eabf9ed0-2666-4c7d-a7a1-f11e6f54c674 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:10 devstack sudo[107851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d28dbf1-1107-4275-b80d-216395fbd761.eabf9ed0-2666-4c7d-a7a1-f11e6f54c674 Nov 03 07:52:10 devstack sudo[107851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:10 devstack sudo[107851]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fb00857b-6a41-47ea-9948-95c0f64c9c09 tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d28dbf1-1107-4275-b80d-216395fbd761.eabf9ed0-2666-4c7d-a7a1-f11e6f54c674" returned: 0 in 0.238s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:10 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fb00857b-6a41-47ea-9948-95c0f64c9c09 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d28dbf1-1107-4275-b80d-216395fbd761.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:10 devstack sudo[107854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d28dbf1-1107-4275-b80d-216395fbd761.info Nov 03 07:52:10 devstack sudo[107854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:11 devstack sudo[107854]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fb00857b-6a41-47ea-9948-95c0f64c9c09 tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d28dbf1-1107-4275-b80d-216395fbd761.info" returned: 0 in 0.240s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:11 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-fb00857b-6a41-47ea-9948-95c0f64c9c09 tempest-ProjectMemberTests-923615420 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d28dbf1-1107-4275-b80d-216395fbd761.info is being set with open permissions: ugo+rw Nov 03 07:52:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fb00857b-6a41-47ea-9948-95c0f64c9c09 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d28dbf1-1107-4275-b80d-216395fbd761.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:11 devstack sudo[107857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d28dbf1-1107-4275-b80d-216395fbd761.info Nov 03 07:52:11 devstack sudo[107857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:11 devstack sudo[107857]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-fb00857b-6a41-47ea-9948-95c0f64c9c09 tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d28dbf1-1107-4275-b80d-216395fbd761.info" returned: 0 in 0.225s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-fb00857b-6a41-47ea-9948-95c0f64c9c09 tempest-ProjectMemberTests-923615420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.830s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:52:11 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-fb00857b-6a41-47ea-9948-95c0f64c9c09 tempest-ProjectMemberTests-923615420 None] Create snapshot completed successfully Nov 03 07:52:11 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ea930412-83a7-4446-abc9-cb4872792f03 tempest-ProjectMemberTests-923615420 None] Acquiring lock "cinder-eabf9ed0-2666-4c7d-a7a1-f11e6f54c674-delete_snapshot" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:11 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ea930412-83a7-4446-abc9-cb4872792f03 tempest-ProjectMemberTests-923615420 None] Lock "cinder-eabf9ed0-2666-4c7d-a7a1-f11e6f54c674-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:11 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ea930412-83a7-4446-abc9-cb4872792f03 tempest-ProjectMemberTests-923615420 None] Acquiring lock "cinder-quobyte-8d28dbf1-1107-4275-b80d-216395fbd761" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:11 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ea930412-83a7-4446-abc9-cb4872792f03 tempest-ProjectMemberTests-923615420 None] Lock "cinder-quobyte-8d28dbf1-1107-4275-b80d-216395fbd761" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:11 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ea930412-83a7-4446-abc9-cb4872792f03 tempest-ProjectMemberTests-923615420 None] Acquiring lock "cinder-quobyte-eabf9ed0-2666-4c7d-a7a1-f11e6f54c674" by "_delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:11 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ea930412-83a7-4446-abc9-cb4872792f03 tempest-ProjectMemberTests-923615420 None] Lock "cinder-quobyte-eabf9ed0-2666-4c7d-a7a1-f11e6f54c674" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:11 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-ea930412-83a7-4446-abc9-cb4872792f03 tempest-ProjectMemberTests-923615420 None] Deleting offline snapshot eabf9ed0-2666-4c7d-a7a1-f11e6f54c674 of volume 8d28dbf1-1107-4275-b80d-216395fbd761 {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:52:11 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-ea930412-83a7-4446-abc9-cb4872792f03 tempest-ProjectMemberTests-923615420 None] snapshot_file for this snap is: volume-8d28dbf1-1107-4275-b80d-216395fbd761.eabf9ed0-2666-4c7d-a7a1-f11e6f54c674 {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:52:11 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[823c4055-34ea-4ecd-b047-24557091fc9b]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:52:11 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ea930412-83a7-4446-abc9-cb4872792f03 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d28dbf1-1107-4275-b80d-216395fbd761.eabf9ed0-2666-4c7d-a7a1-f11e6f54c674 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:11 devstack sudo[107860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d28dbf1-1107-4275-b80d-216395fbd761.eabf9ed0-2666-4c7d-a7a1-f11e6f54c674 Nov 03 07:52:11 devstack sudo[107860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:12 devstack sudo[107860]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:12 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ea930412-83a7-4446-abc9-cb4872792f03 tempest-ProjectMemberTests-923615420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d28dbf1-1107-4275-b80d-216395fbd761.eabf9ed0-2666-4c7d-a7a1-f11e6f54c674" returned: 0 in 0.379s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:12 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-ea930412-83a7-4446-abc9-cb4872792f03 tempest-ProjectMemberTests-923615420 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d28dbf1-1107-4275-b80d-216395fbd761(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:52:12 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[848246f5-639a-4dc8-a81a-339cad38d3dc]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:52:12 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ea930412-83a7-4446-abc9-cb4872792f03 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d28dbf1-1107-4275-b80d-216395fbd761 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:12 devstack sudo[107865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d28dbf1-1107-4275-b80d-216395fbd761 Nov 03 07:52:12 devstack sudo[107865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:12 devstack sudo[107865]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:12 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ea930412-83a7-4446-abc9-cb4872792f03 tempest-ProjectMemberTests-923615420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d28dbf1-1107-4275-b80d-216395fbd761" returned: 0 in 0.341s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:12 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ea930412-83a7-4446-abc9-cb4872792f03 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d28dbf1-1107-4275-b80d-216395fbd761.eabf9ed0-2666-4c7d-a7a1-f11e6f54c674 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:12 devstack sudo[107870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d28dbf1-1107-4275-b80d-216395fbd761.eabf9ed0-2666-4c7d-a7a1-f11e6f54c674 Nov 03 07:52:12 devstack sudo[107870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:12 devstack sudo[107870]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:12 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ea930412-83a7-4446-abc9-cb4872792f03 tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d28dbf1-1107-4275-b80d-216395fbd761.eabf9ed0-2666-4c7d-a7a1-f11e6f54c674" returned: 0 in 0.318s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:12 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ea930412-83a7-4446-abc9-cb4872792f03 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d28dbf1-1107-4275-b80d-216395fbd761.eabf9ed0-2666-4c7d-a7a1-f11e6f54c674 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:12 devstack sudo[107875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d28dbf1-1107-4275-b80d-216395fbd761.eabf9ed0-2666-4c7d-a7a1-f11e6f54c674 Nov 03 07:52:12 devstack sudo[107875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:13 devstack sudo[107875]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-ea930412-83a7-4446-abc9-cb4872792f03 tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d28dbf1-1107-4275-b80d-216395fbd761.eabf9ed0-2666-4c7d-a7a1-f11e6f54c674" returned: 0 in 0.235s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:13 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ea930412-83a7-4446-abc9-cb4872792f03 tempest-ProjectMemberTests-923615420 None] Lock "cinder-quobyte-eabf9ed0-2666-4c7d-a7a1-f11e6f54c674" released by "_delete_snapshot" :: held 1.366s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:13 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ea930412-83a7-4446-abc9-cb4872792f03 tempest-ProjectMemberTests-923615420 None] Lock "cinder-quobyte-8d28dbf1-1107-4275-b80d-216395fbd761" released by "delete_snapshot" :: held 1.389s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:13 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-ea930412-83a7-4446-abc9-cb4872792f03 tempest-ProjectMemberTests-923615420 None] Created reservations ['e23a59e1-9a5a-49f1-b198-adfd3adfa9b7', '6b0f4c6f-c834-449d-b516-29ddd6a65fd9', '213fd294-be03-487f-ba55-a9d426f525b7', '6abba6fc-ab2d-403f-89cb-05adeb9a63e0'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:52:13 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-ea930412-83a7-4446-abc9-cb4872792f03 tempest-ProjectMemberTests-923615420 None] Delete snapshot completed successfully. Nov 03 07:52:13 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-ea930412-83a7-4446-abc9-cb4872792f03 tempest-ProjectMemberTests-923615420 None] Lock "cinder-eabf9ed0-2666-4c7d-a7a1-f11e6f54c674-delete_snapshot" released by "delete_snapshot" :: held 1.516s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:13 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-498607f4-2263-4b65-99e6-45bf1e8ad364 tempest-ProjectMemberTests-923615420 None] Acquiring lock "cinder-8d28dbf1-1107-4275-b80d-216395fbd761-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:13 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-498607f4-2263-4b65-99e6-45bf1e8ad364 tempest-ProjectMemberTests-923615420 None] Lock "cinder-8d28dbf1-1107-4275-b80d-216395fbd761-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:13 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-498607f4-2263-4b65-99e6-45bf1e8ad364 tempest-ProjectMemberTests-923615420 None] Acquiring lock "cinder-quobyte-8d28dbf1-1107-4275-b80d-216395fbd761" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:13 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-498607f4-2263-4b65-99e6-45bf1e8ad364 tempest-ProjectMemberTests-923615420 None] Lock "cinder-quobyte-8d28dbf1-1107-4275-b80d-216395fbd761" acquired by "delete_volume" :: waited 0.016s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:13 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54c7e5e-0da8-46f4-9ce4-aca9999f5d5f]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:52:13 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-498607f4-2263-4b65-99e6-45bf1e8ad364 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d28dbf1-1107-4275-b80d-216395fbd761 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:14 devstack sudo[107878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d28dbf1-1107-4275-b80d-216395fbd761 Nov 03 07:52:14 devstack sudo[107878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:14 devstack sudo[107878]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:14 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-498607f4-2263-4b65-99e6-45bf1e8ad364 tempest-ProjectMemberTests-923615420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d28dbf1-1107-4275-b80d-216395fbd761" returned: 0 in 0.340s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:14 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-498607f4-2263-4b65-99e6-45bf1e8ad364 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d28dbf1-1107-4275-b80d-216395fbd761 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:14 devstack sudo[107883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d28dbf1-1107-4275-b80d-216395fbd761 Nov 03 07:52:14 devstack sudo[107883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:14 devstack sudo[107883]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:14 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-498607f4-2263-4b65-99e6-45bf1e8ad364 tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-8d28dbf1-1107-4275-b80d-216395fbd761" returned: 0 in 0.227s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:14 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-498607f4-2263-4b65-99e6-45bf1e8ad364 tempest-ProjectMemberTests-923615420 None] Lock "cinder-quobyte-8d28dbf1-1107-4275-b80d-216395fbd761" released by "delete_volume" :: held 0.629s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:14 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-498607f4-2263-4b65-99e6-45bf1e8ad364 tempest-ProjectMemberTests-923615420 None] Created reservations ['4e6d6830-16af-419e-af5d-114d8640ba1d', '14b9f055-4913-4670-b3a4-ef9535a6c384', '7627484a-d4d1-4a0f-b17b-c4f8620fa7b9', '73f9e343-7601-4fb0-b527-a7912152b461'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:52:14 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-498607f4-2263-4b65-99e6-45bf1e8ad364 tempest-ProjectMemberTests-923615420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:52:14 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-498607f4-2263-4b65-99e6-45bf1e8ad364 tempest-ProjectMemberTests-923615420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:52:14 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-498607f4-2263-4b65-99e6-45bf1e8ad364 tempest-ProjectMemberTests-923615420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:52:14 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-498607f4-2263-4b65-99e6-45bf1e8ad364 tempest-ProjectMemberTests-923615420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:52:14 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-498607f4-2263-4b65-99e6-45bf1e8ad364 tempest-ProjectMemberTests-923615420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:52:14 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-498607f4-2263-4b65-99e6-45bf1e8ad364 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:14 devstack sudo[107886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:52:14 devstack sudo[107886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:14 devstack sudo[107886]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:14 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-498607f4-2263-4b65-99e6-45bf1e8ad364 tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.232s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:14 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-498607f4-2263-4b65-99e6-45bf1e8ad364 tempest-ProjectMemberTests-923615420 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:52:14 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-498607f4-2263-4b65-99e6-45bf1e8ad364 tempest-ProjectMemberTests-923615420 None] Deleted volume successfully. Nov 03 07:52:14 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-498607f4-2263-4b65-99e6-45bf1e8ad364 tempest-ProjectMemberTests-923615420 None] Lock "cinder-8d28dbf1-1107-4275-b80d-216395fbd761-delete_volume" released by "delete_volume" :: held 1.054s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:15 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2e8f8dd-664a-41cd-a32f-95183a0c1674 tempest-ProjectMemberTests-923615420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:52:15 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d2e8f8dd-664a-41cd-a32f-95183a0c1674 tempest-ProjectMemberTests-923615420 None] Flow 'volume_create_manager' (a893ef81-1f0d-473e-868c-9c500bf9819a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:52:15 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d2e8f8dd-664a-41cd-a32f-95183a0c1674 tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8915748-4ef6-48c1-be11-d29bc837d0ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:15 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d2e8f8dd-664a-41cd-a32f-95183a0c1674 tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8915748-4ef6-48c1-be11-d29bc837d0ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:52:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1025483895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8eccc5d-5606-49f5-83bd-8c9d266cbd85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed2c0b7d26474c8aaafc23b6762bdc56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:52:15Z,use_quota=True,user_id='7d2824260e354882bea7f7a6989d9f16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:15 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d2e8f8dd-664a-41cd-a32f-95183a0c1674 tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a931332b-40c8-4222-8658-befe9daab52b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:15 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d2e8f8dd-664a-41cd-a32f-95183a0c1674 tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a931332b-40c8-4222-8658-befe9daab52b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:15 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d2e8f8dd-664a-41cd-a32f-95183a0c1674 tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (427cbe7c-d4b9-4026-9201-d5d91843806c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:15 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d2e8f8dd-664a-41cd-a32f-95183a0c1674 tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (427cbe7c-d4b9-4026-9201-d5d91843806c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8eccc5d-5606-49f5-83bd-8c9d266cbd85', 'volume_name': 'volume-d8eccc5d-5606-49f5-83bd-8c9d266cbd85', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:15 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d2e8f8dd-664a-41cd-a32f-95183a0c1674 tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d226dac-2383-4777-a19c-d4833b11a7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:15 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d2e8f8dd-664a-41cd-a32f-95183a0c1674 tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d226dac-2383-4777-a19c-d4833b11a7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:15 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d2e8f8dd-664a-41cd-a32f-95183a0c1674 tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c240822b-6582-441c-b08d-2f0025cc1c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:15 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-d2e8f8dd-664a-41cd-a32f-95183a0c1674 tempest-ProjectMemberTests-923615420 None] Volume d8eccc5d-5606-49f5-83bd-8c9d266cbd85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8eccc5d-5606-49f5-83bd-8c9d266cbd85', 'volume_size': 1} Nov 03 07:52:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-d2e8f8dd-664a-41cd-a32f-95183a0c1674 tempest-ProjectMemberTests-923615420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:52:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-d2e8f8dd-664a-41cd-a32f-95183a0c1674 tempest-ProjectMemberTests-923615420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:52:15 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-d2e8f8dd-664a-41cd-a32f-95183a0c1674 tempest-ProjectMemberTests-923615420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:52:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1025483895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8eccc5d-5606-49f5-83bd-8c9d266cbd85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed2c0b7d26474c8aaafc23b6762bdc56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:52:15Z,use_quota=True,user_id='7d2824260e354882bea7f7a6989d9f16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:52:15 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-d2e8f8dd-664a-41cd-a32f-95183a0c1674 tempest-ProjectMemberTests-923615420 None] Creating volume d8eccc5d-5606-49f5-83bd-8c9d266cbd85 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:52:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-d2e8f8dd-664a-41cd-a32f-95183a0c1674 tempest-ProjectMemberTests-923615420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:52:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-d2e8f8dd-664a-41cd-a32f-95183a0c1674 tempest-ProjectMemberTests-923615420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:52:15 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-d2e8f8dd-664a-41cd-a32f-95183a0c1674 tempest-ProjectMemberTests-923615420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:52:15 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-d2e8f8dd-664a-41cd-a32f-95183a0c1674 tempest-ProjectMemberTests-923615420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:52:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-d2e8f8dd-664a-41cd-a32f-95183a0c1674 tempest-ProjectMemberTests-923615420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:52:15 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-d2e8f8dd-664a-41cd-a32f-95183a0c1674 tempest-ProjectMemberTests-923615420 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:52:15 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-d2e8f8dd-664a-41cd-a32f-95183a0c1674 tempest-ProjectMemberTests-923615420 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:52:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d2e8f8dd-664a-41cd-a32f-95183a0c1674 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d8eccc5d-5606-49f5-83bd-8c9d266cbd85 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:15 devstack sudo[107889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d8eccc5d-5606-49f5-83bd-8c9d266cbd85 1073741824 Nov 03 07:52:15 devstack sudo[107889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:15 devstack sudo[107889]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d2e8f8dd-664a-41cd-a32f-95183a0c1674 tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d8eccc5d-5606-49f5-83bd-8c9d266cbd85 1073741824" returned: 0 in 0.384s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:15 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d2e8f8dd-664a-41cd-a32f-95183a0c1674 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d8eccc5d-5606-49f5-83bd-8c9d266cbd85 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:15 devstack sudo[107894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d8eccc5d-5606-49f5-83bd-8c9d266cbd85 Nov 03 07:52:15 devstack sudo[107894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:16 devstack sudo[107894]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-d2e8f8dd-664a-41cd-a32f-95183a0c1674 tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d8eccc5d-5606-49f5-83bd-8c9d266cbd85" returned: 0 in 0.235s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:16 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-d2e8f8dd-664a-41cd-a32f-95183a0c1674 tempest-ProjectMemberTests-923615420 None] <== create_volume: return (656ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:52:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-d2e8f8dd-664a-41cd-a32f-95183a0c1674 tempest-ProjectMemberTests-923615420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.658s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:52:16 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d2e8f8dd-664a-41cd-a32f-95183a0c1674 tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c240822b-6582-441c-b08d-2f0025cc1c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8eccc5d-5606-49f5-83bd-8c9d266cbd85', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:16 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d2e8f8dd-664a-41cd-a32f-95183a0c1674 tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c3daad9-c299-4e5b-98af-97eec4ff20a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:16 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-d2e8f8dd-664a-41cd-a32f-95183a0c1674 tempest-ProjectMemberTests-923615420 None] Volume volume-d8eccc5d-5606-49f5-83bd-8c9d266cbd85 (d8eccc5d-5606-49f5-83bd-8c9d266cbd85): created successfully Nov 03 07:52:16 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d2e8f8dd-664a-41cd-a32f-95183a0c1674 tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c3daad9-c299-4e5b-98af-97eec4ff20a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:16 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-d2e8f8dd-664a-41cd-a32f-95183a0c1674 tempest-ProjectMemberTests-923615420 None] Flow 'volume_create_manager' (a893ef81-1f0d-473e-868c-9c500bf9819a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:52:16 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-d2e8f8dd-664a-41cd-a32f-95183a0c1674 tempest-ProjectMemberTests-923615420 None] Created volume successfully. Nov 03 07:52:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-87a7e477-0ec1-489d-88ca-595db0484241 tempest-ProjectMemberTests-923615420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:52:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-87a7e477-0ec1-489d-88ca-595db0484241 tempest-ProjectMemberTests-923615420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:52:16 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-87a7e477-0ec1-489d-88ca-595db0484241 tempest-ProjectMemberTests-923615420 None] Creating offline snapshot bb7465e6-08fd-4452-9250-567842ddebb9 of volume d8eccc5d-5606-49f5-83bd-8c9d266cbd85 {{(pid=86875) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:52:16 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[848cf87d-7a6a-4338-abb6-b2dbf701d976]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:52:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-87a7e477-0ec1-489d-88ca-595db0484241 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d8eccc5d-5606-49f5-83bd-8c9d266cbd85 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:16 devstack sudo[107897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d8eccc5d-5606-49f5-83bd-8c9d266cbd85 Nov 03 07:52:16 devstack sudo[107897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:16 devstack sudo[107897]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-87a7e477-0ec1-489d-88ca-595db0484241 tempest-ProjectMemberTests-923615420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d8eccc5d-5606-49f5-83bd-8c9d266cbd85" returned: 0 in 0.338s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:16 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-87a7e477-0ec1-489d-88ca-595db0484241 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d8eccc5d-5606-49f5-83bd-8c9d266cbd85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d8eccc5d-5606-49f5-83bd-8c9d266cbd85.bb7465e6-08fd-4452-9250-567842ddebb9 1G {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:16 devstack sudo[107902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d8eccc5d-5606-49f5-83bd-8c9d266cbd85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d8eccc5d-5606-49f5-83bd-8c9d266cbd85.bb7465e6-08fd-4452-9250-567842ddebb9 1G Nov 03 07:52:16 devstack sudo[107902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:17 devstack sudo[107902]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-87a7e477-0ec1-489d-88ca-595db0484241 tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d8eccc5d-5606-49f5-83bd-8c9d266cbd85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d8eccc5d-5606-49f5-83bd-8c9d266cbd85.bb7465e6-08fd-4452-9250-567842ddebb9 1G" returned: 0 in 0.373s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-87a7e477-0ec1-489d-88ca-595db0484241 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8eccc5d-5606-49f5-83bd-8c9d266cbd85 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d8eccc5d-5606-49f5-83bd-8c9d266cbd85.bb7465e6-08fd-4452-9250-567842ddebb9 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:17 devstack sudo[107907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8eccc5d-5606-49f5-83bd-8c9d266cbd85 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d8eccc5d-5606-49f5-83bd-8c9d266cbd85.bb7465e6-08fd-4452-9250-567842ddebb9 Nov 03 07:52:17 devstack sudo[107907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:17 devstack sudo[107907]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-87a7e477-0ec1-489d-88ca-595db0484241 tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8eccc5d-5606-49f5-83bd-8c9d266cbd85 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d8eccc5d-5606-49f5-83bd-8c9d266cbd85.bb7465e6-08fd-4452-9250-567842ddebb9" returned: 0 in 0.284s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:17 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-87a7e477-0ec1-489d-88ca-595db0484241 tempest-ProjectMemberTests-923615420 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d8eccc5d-5606-49f5-83bd-8c9d266cbd85.bb7465e6-08fd-4452-9250-567842ddebb9 is being set with open permissions: ugo+rw Nov 03 07:52:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-87a7e477-0ec1-489d-88ca-595db0484241 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d8eccc5d-5606-49f5-83bd-8c9d266cbd85.bb7465e6-08fd-4452-9250-567842ddebb9 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:17 devstack sudo[107912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d8eccc5d-5606-49f5-83bd-8c9d266cbd85.bb7465e6-08fd-4452-9250-567842ddebb9 Nov 03 07:52:17 devstack sudo[107912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:17 devstack sudo[107912]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-87a7e477-0ec1-489d-88ca-595db0484241 tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d8eccc5d-5606-49f5-83bd-8c9d266cbd85.bb7465e6-08fd-4452-9250-567842ddebb9" returned: 0 in 0.234s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:17 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-87a7e477-0ec1-489d-88ca-595db0484241 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d8eccc5d-5606-49f5-83bd-8c9d266cbd85.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:17 devstack sudo[107918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d8eccc5d-5606-49f5-83bd-8c9d266cbd85.info Nov 03 07:52:17 devstack sudo[107918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:18 devstack sudo[107918]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:18 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-87a7e477-0ec1-489d-88ca-595db0484241 tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d8eccc5d-5606-49f5-83bd-8c9d266cbd85.info" returned: 0 in 0.239s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:18 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-87a7e477-0ec1-489d-88ca-595db0484241 tempest-ProjectMemberTests-923615420 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d8eccc5d-5606-49f5-83bd-8c9d266cbd85.info is being set with open permissions: ugo+rw Nov 03 07:52:18 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-87a7e477-0ec1-489d-88ca-595db0484241 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d8eccc5d-5606-49f5-83bd-8c9d266cbd85.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:18 devstack sudo[107924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d8eccc5d-5606-49f5-83bd-8c9d266cbd85.info Nov 03 07:52:18 devstack sudo[107924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:18 devstack sudo[107924]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:18 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-87a7e477-0ec1-489d-88ca-595db0484241 tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d8eccc5d-5606-49f5-83bd-8c9d266cbd85.info" returned: 0 in 0.228s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:18 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-87a7e477-0ec1-489d-88ca-595db0484241 tempest-ProjectMemberTests-923615420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.777s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:52:18 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-87a7e477-0ec1-489d-88ca-595db0484241 tempest-ProjectMemberTests-923615420 None] Create snapshot completed successfully Nov 03 07:52:18 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-f6d4f39c-3cb5-48e4-9271-58e56d3cd55f tempest-ProjectMemberTests-923615420 None] Acquiring lock "cinder-bb7465e6-08fd-4452-9250-567842ddebb9-delete_snapshot" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:18 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-f6d4f39c-3cb5-48e4-9271-58e56d3cd55f tempest-ProjectMemberTests-923615420 None] Lock "cinder-bb7465e6-08fd-4452-9250-567842ddebb9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:18 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-f6d4f39c-3cb5-48e4-9271-58e56d3cd55f tempest-ProjectMemberTests-923615420 None] Acquiring lock "cinder-quobyte-d8eccc5d-5606-49f5-83bd-8c9d266cbd85" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:18 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-f6d4f39c-3cb5-48e4-9271-58e56d3cd55f tempest-ProjectMemberTests-923615420 None] Lock "cinder-quobyte-d8eccc5d-5606-49f5-83bd-8c9d266cbd85" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:18 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-f6d4f39c-3cb5-48e4-9271-58e56d3cd55f tempest-ProjectMemberTests-923615420 None] Acquiring lock "cinder-quobyte-bb7465e6-08fd-4452-9250-567842ddebb9" by "_delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:18 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-f6d4f39c-3cb5-48e4-9271-58e56d3cd55f tempest-ProjectMemberTests-923615420 None] Lock "cinder-quobyte-bb7465e6-08fd-4452-9250-567842ddebb9" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:18 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-f6d4f39c-3cb5-48e4-9271-58e56d3cd55f tempest-ProjectMemberTests-923615420 None] Deleting offline snapshot bb7465e6-08fd-4452-9250-567842ddebb9 of volume d8eccc5d-5606-49f5-83bd-8c9d266cbd85 {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:52:18 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-f6d4f39c-3cb5-48e4-9271-58e56d3cd55f tempest-ProjectMemberTests-923615420 None] snapshot_file for this snap is: volume-d8eccc5d-5606-49f5-83bd-8c9d266cbd85.bb7465e6-08fd-4452-9250-567842ddebb9 {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:52:18 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd68e38-512d-47bb-adbf-8dcd0a51617d]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:52:18 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f6d4f39c-3cb5-48e4-9271-58e56d3cd55f tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d8eccc5d-5606-49f5-83bd-8c9d266cbd85.bb7465e6-08fd-4452-9250-567842ddebb9 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:18 devstack sudo[107928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d8eccc5d-5606-49f5-83bd-8c9d266cbd85.bb7465e6-08fd-4452-9250-567842ddebb9 Nov 03 07:52:18 devstack sudo[107928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:19 devstack sudo[107928]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:19 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f6d4f39c-3cb5-48e4-9271-58e56d3cd55f tempest-ProjectMemberTests-923615420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d8eccc5d-5606-49f5-83bd-8c9d266cbd85.bb7465e6-08fd-4452-9250-567842ddebb9" returned: 0 in 0.340s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:19 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-f6d4f39c-3cb5-48e4-9271-58e56d3cd55f tempest-ProjectMemberTests-923615420 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8eccc5d-5606-49f5-83bd-8c9d266cbd85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:52:19 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a523b7-9a00-4428-8b58-e0dcd1510bd8]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:52:19 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f6d4f39c-3cb5-48e4-9271-58e56d3cd55f tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d8eccc5d-5606-49f5-83bd-8c9d266cbd85 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:19 devstack sudo[107933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d8eccc5d-5606-49f5-83bd-8c9d266cbd85 Nov 03 07:52:19 devstack sudo[107933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:19 devstack sudo[107933]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:19 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f6d4f39c-3cb5-48e4-9271-58e56d3cd55f tempest-ProjectMemberTests-923615420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d8eccc5d-5606-49f5-83bd-8c9d266cbd85" returned: 0 in 0.340s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:19 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f6d4f39c-3cb5-48e4-9271-58e56d3cd55f tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d8eccc5d-5606-49f5-83bd-8c9d266cbd85.bb7465e6-08fd-4452-9250-567842ddebb9 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:19 devstack sudo[107938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d8eccc5d-5606-49f5-83bd-8c9d266cbd85.bb7465e6-08fd-4452-9250-567842ddebb9 Nov 03 07:52:19 devstack sudo[107938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:19 devstack sudo[107938]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:19 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f6d4f39c-3cb5-48e4-9271-58e56d3cd55f tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d8eccc5d-5606-49f5-83bd-8c9d266cbd85.bb7465e6-08fd-4452-9250-567842ddebb9" returned: 0 in 0.320s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:19 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f6d4f39c-3cb5-48e4-9271-58e56d3cd55f tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d8eccc5d-5606-49f5-83bd-8c9d266cbd85.bb7465e6-08fd-4452-9250-567842ddebb9 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:19 devstack sudo[107944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d8eccc5d-5606-49f5-83bd-8c9d266cbd85.bb7465e6-08fd-4452-9250-567842ddebb9 Nov 03 07:52:19 devstack sudo[107944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:19 devstack sudo[107944]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:19 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-f6d4f39c-3cb5-48e4-9271-58e56d3cd55f tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d8eccc5d-5606-49f5-83bd-8c9d266cbd85.bb7465e6-08fd-4452-9250-567842ddebb9" returned: 0 in 0.232s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:19 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-f6d4f39c-3cb5-48e4-9271-58e56d3cd55f tempest-ProjectMemberTests-923615420 None] Lock "cinder-quobyte-bb7465e6-08fd-4452-9250-567842ddebb9" released by "_delete_snapshot" :: held 1.318s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:19 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-f6d4f39c-3cb5-48e4-9271-58e56d3cd55f tempest-ProjectMemberTests-923615420 None] Lock "cinder-quobyte-d8eccc5d-5606-49f5-83bd-8c9d266cbd85" released by "delete_snapshot" :: held 1.338s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:20 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-f6d4f39c-3cb5-48e4-9271-58e56d3cd55f tempest-ProjectMemberTests-923615420 None] Created reservations ['02053d28-8405-451c-8ec4-352bd65aebca', '1a8d8101-2366-493b-86d7-c46af4bfc03e', 'bc0ee2e8-d168-42d6-91a9-5965d5fdba11', '1e0a6c7e-fae5-4068-bec5-37c40f9080d2'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:52:20 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-f6d4f39c-3cb5-48e4-9271-58e56d3cd55f tempest-ProjectMemberTests-923615420 None] Delete snapshot completed successfully. Nov 03 07:52:20 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-f6d4f39c-3cb5-48e4-9271-58e56d3cd55f tempest-ProjectMemberTests-923615420 None] Lock "cinder-bb7465e6-08fd-4452-9250-567842ddebb9-delete_snapshot" released by "delete_snapshot" :: held 1.461s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:20 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-6dc1b5d5-840a-4995-ba56-f4327465c49d tempest-ProjectMemberTests-923615420 None] Acquiring lock "cinder-d8eccc5d-5606-49f5-83bd-8c9d266cbd85-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:20 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-6dc1b5d5-840a-4995-ba56-f4327465c49d tempest-ProjectMemberTests-923615420 None] Lock "cinder-d8eccc5d-5606-49f5-83bd-8c9d266cbd85-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:20 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-6dc1b5d5-840a-4995-ba56-f4327465c49d tempest-ProjectMemberTests-923615420 None] Acquiring lock "cinder-quobyte-d8eccc5d-5606-49f5-83bd-8c9d266cbd85" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:20 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-6dc1b5d5-840a-4995-ba56-f4327465c49d tempest-ProjectMemberTests-923615420 None] Lock "cinder-quobyte-d8eccc5d-5606-49f5-83bd-8c9d266cbd85" acquired by "delete_volume" :: waited 0.014s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:20 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba32ca01-2dff-4e7b-b8c8-2e0618a03e7f]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:52:20 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6dc1b5d5-840a-4995-ba56-f4327465c49d tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d8eccc5d-5606-49f5-83bd-8c9d266cbd85 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:20 devstack sudo[107947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d8eccc5d-5606-49f5-83bd-8c9d266cbd85 Nov 03 07:52:20 devstack sudo[107947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:21 devstack sudo[107947]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6dc1b5d5-840a-4995-ba56-f4327465c49d tempest-ProjectMemberTests-923615420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d8eccc5d-5606-49f5-83bd-8c9d266cbd85" returned: 0 in 0.336s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6dc1b5d5-840a-4995-ba56-f4327465c49d tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d8eccc5d-5606-49f5-83bd-8c9d266cbd85 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:21 devstack sudo[107952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d8eccc5d-5606-49f5-83bd-8c9d266cbd85 Nov 03 07:52:21 devstack sudo[107952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:21 devstack sudo[107952]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6dc1b5d5-840a-4995-ba56-f4327465c49d tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d8eccc5d-5606-49f5-83bd-8c9d266cbd85" returned: 0 in 0.228s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:21 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-6dc1b5d5-840a-4995-ba56-f4327465c49d tempest-ProjectMemberTests-923615420 None] Lock "cinder-quobyte-d8eccc5d-5606-49f5-83bd-8c9d266cbd85" released by "delete_volume" :: held 0.625s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:21 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-6dc1b5d5-840a-4995-ba56-f4327465c49d tempest-ProjectMemberTests-923615420 None] Created reservations ['4c83a43d-9ec8-43b2-b116-f85b0bacd322', 'dd29551d-ce82-48cd-9d11-40b3390a1d9b', 'cadf03b6-36df-417c-b9a3-1401eafbda7f', '8d4976c5-caa6-473b-ba55-7ecb6ba02a17'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:52:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-6dc1b5d5-840a-4995-ba56-f4327465c49d tempest-ProjectMemberTests-923615420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:52:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-6dc1b5d5-840a-4995-ba56-f4327465c49d tempest-ProjectMemberTests-923615420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:52:21 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-6dc1b5d5-840a-4995-ba56-f4327465c49d tempest-ProjectMemberTests-923615420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:52:21 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-6dc1b5d5-840a-4995-ba56-f4327465c49d tempest-ProjectMemberTests-923615420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:52:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-6dc1b5d5-840a-4995-ba56-f4327465c49d tempest-ProjectMemberTests-923615420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:52:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6dc1b5d5-840a-4995-ba56-f4327465c49d tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:21 devstack sudo[107955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:52:21 devstack sudo[107955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:21 devstack sudo[107955]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:21 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-6dc1b5d5-840a-4995-ba56-f4327465c49d tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.230s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:21 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-6dc1b5d5-840a-4995-ba56-f4327465c49d tempest-ProjectMemberTests-923615420 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:52:21 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-6dc1b5d5-840a-4995-ba56-f4327465c49d tempest-ProjectMemberTests-923615420 None] Deleted volume successfully. Nov 03 07:52:21 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-6dc1b5d5-840a-4995-ba56-f4327465c49d tempest-ProjectMemberTests-923615420 None] Lock "cinder-d8eccc5d-5606-49f5-83bd-8c9d266cbd85-delete_volume" released by "delete_volume" :: held 1.036s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:22 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-feca334b-6860-4f61-b66b-fe8d584fff25 tempest-ProjectMemberTests-923615420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:52:22 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-feca334b-6860-4f61-b66b-fe8d584fff25 tempest-ProjectMemberTests-923615420 None] Flow 'volume_create_manager' (3c5a3965-dfdd-4ccf-b6d9-7f3408a69d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:52:22 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-feca334b-6860-4f61-b66b-fe8d584fff25 tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2002d86b-7e91-438e-96db-3ad377a6667c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:22 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-feca334b-6860-4f61-b66b-fe8d584fff25 tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2002d86b-7e91-438e-96db-3ad377a6667c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:52:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1082801177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed2c0b7d26474c8aaafc23b6762bdc56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:52:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:52:22Z,use_quota=True,user_id='7d2824260e354882bea7f7a6989d9f16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:22 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-feca334b-6860-4f61-b66b-fe8d584fff25 tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c850ab9-a670-4e4f-8463-5dc176884ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:22 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-feca334b-6860-4f61-b66b-fe8d584fff25 tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c850ab9-a670-4e4f-8463-5dc176884ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:22 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-feca334b-6860-4f61-b66b-fe8d584fff25 tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11796574-5429-47de-af7d-04b1e3102284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:22 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-feca334b-6860-4f61-b66b-fe8d584fff25 tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11796574-5429-47de-af7d-04b1e3102284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd28a6c7c-973e-49d7-9cfa-c3cb02d43cb6', 'volume_name': 'volume-d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:22 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-feca334b-6860-4f61-b66b-fe8d584fff25 tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a9198e8-1ce8-4a09-aeb0-c6295926c329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:22 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-feca334b-6860-4f61-b66b-fe8d584fff25 tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a9198e8-1ce8-4a09-aeb0-c6295926c329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:22 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-feca334b-6860-4f61-b66b-fe8d584fff25 tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf8a1cd0-aa8d-4d1f-99a5-d08388a945b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:22 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-feca334b-6860-4f61-b66b-fe8d584fff25 tempest-ProjectMemberTests-923615420 None] Volume d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6', 'volume_size': 1} Nov 03 07:52:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-feca334b-6860-4f61-b66b-fe8d584fff25 tempest-ProjectMemberTests-923615420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:52:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-feca334b-6860-4f61-b66b-fe8d584fff25 tempest-ProjectMemberTests-923615420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:52:22 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-feca334b-6860-4f61-b66b-fe8d584fff25 tempest-ProjectMemberTests-923615420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:52:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1082801177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed2c0b7d26474c8aaafc23b6762bdc56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:52:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:52:22Z,use_quota=True,user_id='7d2824260e354882bea7f7a6989d9f16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:52:22 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-feca334b-6860-4f61-b66b-fe8d584fff25 tempest-ProjectMemberTests-923615420 None] Creating volume d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:52:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-feca334b-6860-4f61-b66b-fe8d584fff25 tempest-ProjectMemberTests-923615420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:52:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-feca334b-6860-4f61-b66b-fe8d584fff25 tempest-ProjectMemberTests-923615420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:52:22 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-feca334b-6860-4f61-b66b-fe8d584fff25 tempest-ProjectMemberTests-923615420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:52:22 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-feca334b-6860-4f61-b66b-fe8d584fff25 tempest-ProjectMemberTests-923615420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:52:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-feca334b-6860-4f61-b66b-fe8d584fff25 tempest-ProjectMemberTests-923615420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:52:22 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-feca334b-6860-4f61-b66b-fe8d584fff25 tempest-ProjectMemberTests-923615420 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:52:22 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-feca334b-6860-4f61-b66b-fe8d584fff25 tempest-ProjectMemberTests-923615420 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:52:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-feca334b-6860-4f61-b66b-fe8d584fff25 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:22 devstack sudo[107958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6 1073741824 Nov 03 07:52:22 devstack sudo[107958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:22 devstack sudo[107958]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-feca334b-6860-4f61-b66b-fe8d584fff25 tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6 1073741824" returned: 0 in 0.390s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:22 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-feca334b-6860-4f61-b66b-fe8d584fff25 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:22 devstack sudo[107963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6 Nov 03 07:52:22 devstack sudo[107963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:23 devstack sudo[107963]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-feca334b-6860-4f61-b66b-fe8d584fff25 tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6" returned: 0 in 0.229s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:23 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-feca334b-6860-4f61-b66b-fe8d584fff25 tempest-ProjectMemberTests-923615420 None] <== create_volume: return (658ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:52:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-feca334b-6860-4f61-b66b-fe8d584fff25 tempest-ProjectMemberTests-923615420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.661s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:52:23 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-feca334b-6860-4f61-b66b-fe8d584fff25 tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf8a1cd0-aa8d-4d1f-99a5-d08388a945b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:23 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-feca334b-6860-4f61-b66b-fe8d584fff25 tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc33580a-5178-4f18-9f5e-94a04ed626c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:23 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-feca334b-6860-4f61-b66b-fe8d584fff25 tempest-ProjectMemberTests-923615420 None] Volume volume-d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6 (d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6): created successfully Nov 03 07:52:23 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-feca334b-6860-4f61-b66b-fe8d584fff25 tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc33580a-5178-4f18-9f5e-94a04ed626c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:23 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-feca334b-6860-4f61-b66b-fe8d584fff25 tempest-ProjectMemberTests-923615420 None] Flow 'volume_create_manager' (3c5a3965-dfdd-4ccf-b6d9-7f3408a69d25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:52:23 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-feca334b-6860-4f61-b66b-fe8d584fff25 tempest-ProjectMemberTests-923615420 None] Created volume successfully. Nov 03 07:52:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e38ecc54-3cde-4caf-bcc8-0e910a76dce4 tempest-ProjectMemberTests-923615420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:52:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e38ecc54-3cde-4caf-bcc8-0e910a76dce4 tempest-ProjectMemberTests-923615420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:52:23 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-e38ecc54-3cde-4caf-bcc8-0e910a76dce4 tempest-ProjectMemberTests-923615420 None] Creating offline snapshot 441252dd-6d71-41f4-a67d-db134f2535b6 of volume d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6 {{(pid=86875) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:52:23 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[496919b0-648b-4705-a6c5-5fd780d8c92c]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:52:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e38ecc54-3cde-4caf-bcc8-0e910a76dce4 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:23 devstack sudo[107966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6 Nov 03 07:52:23 devstack sudo[107966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:23 devstack sudo[107966]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e38ecc54-3cde-4caf-bcc8-0e910a76dce4 tempest-ProjectMemberTests-923615420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6" returned: 0 in 0.344s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:23 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e38ecc54-3cde-4caf-bcc8-0e910a76dce4 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6.441252dd-6d71-41f4-a67d-db134f2535b6 1G {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:23 devstack sudo[107971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6.441252dd-6d71-41f4-a67d-db134f2535b6 1G Nov 03 07:52:23 devstack sudo[107971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:24 devstack sudo[107971]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e38ecc54-3cde-4caf-bcc8-0e910a76dce4 tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6.441252dd-6d71-41f4-a67d-db134f2535b6 1G" returned: 0 in 0.364s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e38ecc54-3cde-4caf-bcc8-0e910a76dce4 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6.441252dd-6d71-41f4-a67d-db134f2535b6 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:24 devstack sudo[107976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6.441252dd-6d71-41f4-a67d-db134f2535b6 Nov 03 07:52:24 devstack sudo[107976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:24 devstack sudo[107976]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e38ecc54-3cde-4caf-bcc8-0e910a76dce4 tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6.441252dd-6d71-41f4-a67d-db134f2535b6" returned: 0 in 0.268s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:24 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-e38ecc54-3cde-4caf-bcc8-0e910a76dce4 tempest-ProjectMemberTests-923615420 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6.441252dd-6d71-41f4-a67d-db134f2535b6 is being set with open permissions: ugo+rw Nov 03 07:52:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e38ecc54-3cde-4caf-bcc8-0e910a76dce4 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6.441252dd-6d71-41f4-a67d-db134f2535b6 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:24 devstack sudo[107981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6.441252dd-6d71-41f4-a67d-db134f2535b6 Nov 03 07:52:24 devstack sudo[107981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:24 devstack sudo[107981]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e38ecc54-3cde-4caf-bcc8-0e910a76dce4 tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6.441252dd-6d71-41f4-a67d-db134f2535b6" returned: 0 in 0.231s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e38ecc54-3cde-4caf-bcc8-0e910a76dce4 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:24 devstack sudo[107984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6.info Nov 03 07:52:24 devstack sudo[107984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:24 devstack sudo[107984]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e38ecc54-3cde-4caf-bcc8-0e910a76dce4 tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6.info" returned: 0 in 0.229s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:24 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-e38ecc54-3cde-4caf-bcc8-0e910a76dce4 tempest-ProjectMemberTests-923615420 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6.info is being set with open permissions: ugo+rw Nov 03 07:52:24 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e38ecc54-3cde-4caf-bcc8-0e910a76dce4 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:25 devstack sudo[107987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6.info Nov 03 07:52:25 devstack sudo[107987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:25 devstack sudo[107987]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-e38ecc54-3cde-4caf-bcc8-0e910a76dce4 tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6.info" returned: 0 in 0.225s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-e38ecc54-3cde-4caf-bcc8-0e910a76dce4 tempest-ProjectMemberTests-923615420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.736s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:52:25 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-e38ecc54-3cde-4caf-bcc8-0e910a76dce4 tempest-ProjectMemberTests-923615420 None] Create snapshot completed successfully Nov 03 07:52:25 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-39e59d51-932f-4eae-9589-b832b2853983 tempest-ProjectMemberTests-923615420 None] Acquiring lock "cinder-441252dd-6d71-41f4-a67d-db134f2535b6-delete_snapshot" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:25 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-39e59d51-932f-4eae-9589-b832b2853983 tempest-ProjectMemberTests-923615420 None] Lock "cinder-441252dd-6d71-41f4-a67d-db134f2535b6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:25 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-39e59d51-932f-4eae-9589-b832b2853983 tempest-ProjectMemberTests-923615420 None] Acquiring lock "cinder-quobyte-d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:25 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-39e59d51-932f-4eae-9589-b832b2853983 tempest-ProjectMemberTests-923615420 None] Lock "cinder-quobyte-d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:25 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-39e59d51-932f-4eae-9589-b832b2853983 tempest-ProjectMemberTests-923615420 None] Acquiring lock "cinder-quobyte-441252dd-6d71-41f4-a67d-db134f2535b6" by "_delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:25 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-39e59d51-932f-4eae-9589-b832b2853983 tempest-ProjectMemberTests-923615420 None] Lock "cinder-quobyte-441252dd-6d71-41f4-a67d-db134f2535b6" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:25 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-39e59d51-932f-4eae-9589-b832b2853983 tempest-ProjectMemberTests-923615420 None] Deleting offline snapshot 441252dd-6d71-41f4-a67d-db134f2535b6 of volume d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6 {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:52:25 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-39e59d51-932f-4eae-9589-b832b2853983 tempest-ProjectMemberTests-923615420 None] snapshot_file for this snap is: volume-d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6.441252dd-6d71-41f4-a67d-db134f2535b6 {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:52:25 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8f6fdd-c62e-40f1-9cd1-cbaec2a3e294]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:52:25 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-39e59d51-932f-4eae-9589-b832b2853983 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6.441252dd-6d71-41f4-a67d-db134f2535b6 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:25 devstack sudo[107990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6.441252dd-6d71-41f4-a67d-db134f2535b6 Nov 03 07:52:25 devstack sudo[107990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:26 devstack sudo[107990]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:26 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-39e59d51-932f-4eae-9589-b832b2853983 tempest-ProjectMemberTests-923615420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6.441252dd-6d71-41f4-a67d-db134f2535b6" returned: 0 in 0.335s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:26 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-39e59d51-932f-4eae-9589-b832b2853983 tempest-ProjectMemberTests-923615420 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:52:26 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[42dc9ba3-c64f-47ce-8e21-716732193057]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:52:26 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-39e59d51-932f-4eae-9589-b832b2853983 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:26 devstack sudo[107995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6 Nov 03 07:52:26 devstack sudo[107995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:26 devstack sudo[107995]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:26 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-39e59d51-932f-4eae-9589-b832b2853983 tempest-ProjectMemberTests-923615420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6" returned: 0 in 0.330s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:26 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-39e59d51-932f-4eae-9589-b832b2853983 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6.441252dd-6d71-41f4-a67d-db134f2535b6 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:26 devstack sudo[108000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6.441252dd-6d71-41f4-a67d-db134f2535b6 Nov 03 07:52:26 devstack sudo[108000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:26 devstack sudo[108000]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:26 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-39e59d51-932f-4eae-9589-b832b2853983 tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6.441252dd-6d71-41f4-a67d-db134f2535b6" returned: 0 in 0.321s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:26 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-39e59d51-932f-4eae-9589-b832b2853983 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6.441252dd-6d71-41f4-a67d-db134f2535b6 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:26 devstack sudo[108005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6.441252dd-6d71-41f4-a67d-db134f2535b6 Nov 03 07:52:26 devstack sudo[108005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:26 devstack sudo[108005]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:26 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-39e59d51-932f-4eae-9589-b832b2853983 tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6.441252dd-6d71-41f4-a67d-db134f2535b6" returned: 0 in 0.227s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:26 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-39e59d51-932f-4eae-9589-b832b2853983 tempest-ProjectMemberTests-923615420 None] Lock "cinder-quobyte-441252dd-6d71-41f4-a67d-db134f2535b6" released by "_delete_snapshot" :: held 1.301s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:26 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-39e59d51-932f-4eae-9589-b832b2853983 tempest-ProjectMemberTests-923615420 None] Lock "cinder-quobyte-d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6" released by "delete_snapshot" :: held 1.320s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:27 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-39e59d51-932f-4eae-9589-b832b2853983 tempest-ProjectMemberTests-923615420 None] Created reservations ['49b9e447-78fb-406d-91fe-238fc1086e5c', '38b2ec31-b067-4892-8189-1a9b80cb9f40', '98975fa8-12c1-4dc4-b0c1-00b7fea820fc', 'f8d9b224-8930-4d5f-b124-11e491035d88'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:52:27 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-39e59d51-932f-4eae-9589-b832b2853983 tempest-ProjectMemberTests-923615420 None] Delete snapshot completed successfully. Nov 03 07:52:27 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-39e59d51-932f-4eae-9589-b832b2853983 tempest-ProjectMemberTests-923615420 None] Lock "cinder-441252dd-6d71-41f4-a67d-db134f2535b6-delete_snapshot" released by "delete_snapshot" :: held 1.446s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:27 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-5b41de0b-89f4-48ba-af9f-420e25009b73 tempest-ProjectMemberTests-923615420 None] Acquiring lock "cinder-d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:27 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-5b41de0b-89f4-48ba-af9f-420e25009b73 tempest-ProjectMemberTests-923615420 None] Lock "cinder-d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:27 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-5b41de0b-89f4-48ba-af9f-420e25009b73 tempest-ProjectMemberTests-923615420 None] Acquiring lock "cinder-quobyte-d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:27 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-5b41de0b-89f4-48ba-af9f-420e25009b73 tempest-ProjectMemberTests-923615420 None] Lock "cinder-quobyte-d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6" acquired by "delete_volume" :: waited 0.013s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:27 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af3d0ee-9fbe-44f9-be14-afd381d5ad59]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:52:27 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5b41de0b-89f4-48ba-af9f-420e25009b73 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:27 devstack sudo[108008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6 Nov 03 07:52:27 devstack sudo[108008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:28 devstack sudo[108008]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5b41de0b-89f4-48ba-af9f-420e25009b73 tempest-ProjectMemberTests-923615420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6" returned: 0 in 0.341s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5b41de0b-89f4-48ba-af9f-420e25009b73 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:28 devstack sudo[108014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6 Nov 03 07:52:28 devstack sudo[108014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:28 devstack sudo[108014]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5b41de0b-89f4-48ba-af9f-420e25009b73 tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6" returned: 0 in 0.223s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:28 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-5b41de0b-89f4-48ba-af9f-420e25009b73 tempest-ProjectMemberTests-923615420 None] Lock "cinder-quobyte-d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6" released by "delete_volume" :: held 0.621s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:28 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-5b41de0b-89f4-48ba-af9f-420e25009b73 tempest-ProjectMemberTests-923615420 None] Created reservations ['f66d1b57-f56b-4036-a745-03b82bce607d', '3bb394ad-457a-4f81-8d5a-c8e146c2c990', '6e6c7231-7fec-46fe-8b61-302f0df8efcf', '054daa7b-e2b4-4598-83c2-d044e8939377'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:52:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-5b41de0b-89f4-48ba-af9f-420e25009b73 tempest-ProjectMemberTests-923615420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:52:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-5b41de0b-89f4-48ba-af9f-420e25009b73 tempest-ProjectMemberTests-923615420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:52:28 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-5b41de0b-89f4-48ba-af9f-420e25009b73 tempest-ProjectMemberTests-923615420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:52:28 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-5b41de0b-89f4-48ba-af9f-420e25009b73 tempest-ProjectMemberTests-923615420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:52:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-5b41de0b-89f4-48ba-af9f-420e25009b73 tempest-ProjectMemberTests-923615420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:52:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5b41de0b-89f4-48ba-af9f-420e25009b73 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:28 devstack sudo[108017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:52:28 devstack sudo[108017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:28 devstack sudo[108017]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:28 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-5b41de0b-89f4-48ba-af9f-420e25009b73 tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.226s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:28 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-5b41de0b-89f4-48ba-af9f-420e25009b73 tempest-ProjectMemberTests-923615420 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:52:28 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-5b41de0b-89f4-48ba-af9f-420e25009b73 tempest-ProjectMemberTests-923615420 None] Deleted volume successfully. Nov 03 07:52:28 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-5b41de0b-89f4-48ba-af9f-420e25009b73 tempest-ProjectMemberTests-923615420 None] Lock "cinder-d28a6c7c-973e-49d7-9cfa-c3cb02d43cb6-delete_volume" released by "delete_volume" :: held 1.025s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:29 devstack cinder-volume[86875]: DEBUG cinder.volume.flows.manager.create_volume [None req-64299fc6-4974-4a41-bae2-a1026d9f9c3a tempest-ProjectMemberTests-923615420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86875) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 07:52:29 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-64299fc6-4974-4a41-bae2-a1026d9f9c3a tempest-ProjectMemberTests-923615420 None] Flow 'volume_create_manager' (458dd188-c6c9-4efe-bcbc-89f58133eaa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:52:29 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-64299fc6-4974-4a41-bae2-a1026d9f9c3a tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1c7c628-6a35-4257-bb2f-104fee4cb77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:29 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-64299fc6-4974-4a41-bae2-a1026d9f9c3a tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1c7c628-6a35-4257-bb2f-104fee4cb77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:52:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-514983756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cef59bb-3e9e-433f-a17e-68c532f9f316,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed2c0b7d26474c8aaafc23b6762bdc56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:52:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:52:29Z,use_quota=True,user_id='7d2824260e354882bea7f7a6989d9f16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:29 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-64299fc6-4974-4a41-bae2-a1026d9f9c3a tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (677b950d-c50d-40fd-8594-2f76782debaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:29 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-64299fc6-4974-4a41-bae2-a1026d9f9c3a tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (677b950d-c50d-40fd-8594-2f76782debaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:29 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-64299fc6-4974-4a41-bae2-a1026d9f9c3a tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e932c0a5-ba2d-4609-b112-c65e098e651a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:29 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-64299fc6-4974-4a41-bae2-a1026d9f9c3a tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e932c0a5-ba2d-4609-b112-c65e098e651a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cef59bb-3e9e-433f-a17e-68c532f9f316', 'volume_name': 'volume-3cef59bb-3e9e-433f-a17e-68c532f9f316', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:29 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-64299fc6-4974-4a41-bae2-a1026d9f9c3a tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3562612b-3eed-471e-963b-4fab896ed97c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:29 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-64299fc6-4974-4a41-bae2-a1026d9f9c3a tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3562612b-3eed-471e-963b-4fab896ed97c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:29 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-64299fc6-4974-4a41-bae2-a1026d9f9c3a tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97a76faf-7ac6-45ad-bdc0-77314975034a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:29 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-64299fc6-4974-4a41-bae2-a1026d9f9c3a tempest-ProjectMemberTests-923615420 None] Volume 3cef59bb-3e9e-433f-a17e-68c532f9f316: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cef59bb-3e9e-433f-a17e-68c532f9f316', 'volume_size': 1} Nov 03 07:52:29 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-64299fc6-4974-4a41-bae2-a1026d9f9c3a tempest-ProjectMemberTests-923615420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:52:29 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-64299fc6-4974-4a41-bae2-a1026d9f9c3a tempest-ProjectMemberTests-923615420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:52:29 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-64299fc6-4974-4a41-bae2-a1026d9f9c3a tempest-ProjectMemberTests-923615420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T06:52:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-514983756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cef59bb-3e9e-433f-a17e-68c532f9f316,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed2c0b7d26474c8aaafc23b6762bdc56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T06:52:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T06:52:29Z,use_quota=True,user_id='7d2824260e354882bea7f7a6989d9f16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84a2556f-642e-43a0-b647-48323c5b2bf0),volume_type_id=84a2556f-642e-43a0-b647-48323c5b2bf0)}" {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 07:52:29 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-64299fc6-4974-4a41-bae2-a1026d9f9c3a tempest-ProjectMemberTests-923615420 None] Creating volume 3cef59bb-3e9e-433f-a17e-68c532f9f316 {{(pid=86875) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 07:52:29 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-64299fc6-4974-4a41-bae2-a1026d9f9c3a tempest-ProjectMemberTests-923615420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:52:29 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-64299fc6-4974-4a41-bae2-a1026d9f9c3a tempest-ProjectMemberTests-923615420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:52:29 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-64299fc6-4974-4a41-bae2-a1026d9f9c3a tempest-ProjectMemberTests-923615420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:52:29 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-64299fc6-4974-4a41-bae2-a1026d9f9c3a tempest-ProjectMemberTests-923615420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:52:29 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-64299fc6-4974-4a41-bae2-a1026d9f9c3a tempest-ProjectMemberTests-923615420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:52:29 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-64299fc6-4974-4a41-bae2-a1026d9f9c3a tempest-ProjectMemberTests-923615420 None] Selected osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 as target Quobyte volume. {{(pid=86875) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 07:52:29 devstack cinder-volume[86875]: INFO cinder.volume.drivers.remotefs [None req-64299fc6-4974-4a41-bae2-a1026d9f9c3a tempest-ProjectMemberTests-923615420 None] casted to osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1 Nov 03 07:52:29 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-64299fc6-4974-4a41-bae2-a1026d9f9c3a tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3cef59bb-3e9e-433f-a17e-68c532f9f316 1073741824 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:29 devstack sudo[108020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3cef59bb-3e9e-433f-a17e-68c532f9f316 1073741824 Nov 03 07:52:29 devstack sudo[108020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:29 devstack sudo[108020]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:29 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-64299fc6-4974-4a41-bae2-a1026d9f9c3a tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3cef59bb-3e9e-433f-a17e-68c532f9f316 1073741824" returned: 0 in 0.384s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:29 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-64299fc6-4974-4a41-bae2-a1026d9f9c3a tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3cef59bb-3e9e-433f-a17e-68c532f9f316 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:29 devstack sudo[108025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3cef59bb-3e9e-433f-a17e-68c532f9f316 Nov 03 07:52:29 devstack sudo[108025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:30 devstack sudo[108025]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-64299fc6-4974-4a41-bae2-a1026d9f9c3a tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3cef59bb-3e9e-433f-a17e-68c532f9f316" returned: 0 in 0.224s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:30 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-64299fc6-4974-4a41-bae2-a1026d9f9c3a tempest-ProjectMemberTests-923615420 None] <== create_volume: return (648ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'} {{(pid=86875) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 07:52:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-64299fc6-4974-4a41-bae2-a1026d9f9c3a tempest-ProjectMemberTests-923615420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.651s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:52:30 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-64299fc6-4974-4a41-bae2-a1026d9f9c3a tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97a76faf-7ac6-45ad-bdc0-77314975034a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cef59bb-3e9e-433f-a17e-68c532f9f316', 'volume_size': 1}' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:30 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-64299fc6-4974-4a41-bae2-a1026d9f9c3a tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3ec0bae-0d52-4743-8af1-87b9d2b751bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 07:52:30 devstack cinder-volume[86875]: INFO cinder.volume.flows.manager.create_volume [None req-64299fc6-4974-4a41-bae2-a1026d9f9c3a tempest-ProjectMemberTests-923615420 None] Volume volume-3cef59bb-3e9e-433f-a17e-68c532f9f316 (3cef59bb-3e9e-433f-a17e-68c532f9f316): created successfully Nov 03 07:52:30 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-64299fc6-4974-4a41-bae2-a1026d9f9c3a tempest-ProjectMemberTests-923615420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3ec0bae-0d52-4743-8af1-87b9d2b751bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86875) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 07:52:30 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-64299fc6-4974-4a41-bae2-a1026d9f9c3a tempest-ProjectMemberTests-923615420 None] Flow 'volume_create_manager' (458dd188-c6c9-4efe-bcbc-89f58133eaa6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86875) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 07:52:30 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-64299fc6-4974-4a41-bae2-a1026d9f9c3a tempest-ProjectMemberTests-923615420 None] Created volume successfully. Nov 03 07:52:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3798aa50-d89c-4cef-996d-5f79b18ce69a tempest-ProjectMemberTests-923615420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:52:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3798aa50-d89c-4cef-996d-5f79b18ce69a tempest-ProjectMemberTests-923615420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:52:30 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-3798aa50-d89c-4cef-996d-5f79b18ce69a tempest-ProjectMemberTests-923615420 None] Creating offline snapshot 23dd835d-a6d9-44be-a505-b68326452b72 of volume 3cef59bb-3e9e-433f-a17e-68c532f9f316 {{(pid=86875) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 07:52:30 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[24cf270f-9fdc-460e-9cbf-ef971f370ffc]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:52:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3798aa50-d89c-4cef-996d-5f79b18ce69a tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3cef59bb-3e9e-433f-a17e-68c532f9f316 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:30 devstack sudo[108062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3cef59bb-3e9e-433f-a17e-68c532f9f316 Nov 03 07:52:30 devstack sudo[108062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:30 devstack sudo[108062]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3798aa50-d89c-4cef-996d-5f79b18ce69a tempest-ProjectMemberTests-923615420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3cef59bb-3e9e-433f-a17e-68c532f9f316" returned: 0 in 0.354s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:30 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3798aa50-d89c-4cef-996d-5f79b18ce69a tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3cef59bb-3e9e-433f-a17e-68c532f9f316,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3cef59bb-3e9e-433f-a17e-68c532f9f316.23dd835d-a6d9-44be-a505-b68326452b72 1G {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:30 devstack sudo[108070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3cef59bb-3e9e-433f-a17e-68c532f9f316,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3cef59bb-3e9e-433f-a17e-68c532f9f316.23dd835d-a6d9-44be-a505-b68326452b72 1G Nov 03 07:52:30 devstack sudo[108070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:31 devstack sudo[108070]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3798aa50-d89c-4cef-996d-5f79b18ce69a tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3cef59bb-3e9e-433f-a17e-68c532f9f316,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3cef59bb-3e9e-433f-a17e-68c532f9f316.23dd835d-a6d9-44be-a505-b68326452b72 1G" returned: 0 in 0.365s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3798aa50-d89c-4cef-996d-5f79b18ce69a tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cef59bb-3e9e-433f-a17e-68c532f9f316 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3cef59bb-3e9e-433f-a17e-68c532f9f316.23dd835d-a6d9-44be-a505-b68326452b72 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:31 devstack sudo[108075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cef59bb-3e9e-433f-a17e-68c532f9f316 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3cef59bb-3e9e-433f-a17e-68c532f9f316.23dd835d-a6d9-44be-a505-b68326452b72 Nov 03 07:52:31 devstack sudo[108075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:31 devstack sudo[108075]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3798aa50-d89c-4cef-996d-5f79b18ce69a tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cef59bb-3e9e-433f-a17e-68c532f9f316 -F qcow2 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3cef59bb-3e9e-433f-a17e-68c532f9f316.23dd835d-a6d9-44be-a505-b68326452b72" returned: 0 in 0.274s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:31 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-3798aa50-d89c-4cef-996d-5f79b18ce69a tempest-ProjectMemberTests-923615420 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3cef59bb-3e9e-433f-a17e-68c532f9f316.23dd835d-a6d9-44be-a505-b68326452b72 is being set with open permissions: ugo+rw Nov 03 07:52:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3798aa50-d89c-4cef-996d-5f79b18ce69a tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3cef59bb-3e9e-433f-a17e-68c532f9f316.23dd835d-a6d9-44be-a505-b68326452b72 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:31 devstack sudo[108080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3cef59bb-3e9e-433f-a17e-68c532f9f316.23dd835d-a6d9-44be-a505-b68326452b72 Nov 03 07:52:31 devstack sudo[108080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:31 devstack sudo[108080]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3798aa50-d89c-4cef-996d-5f79b18ce69a tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3cef59bb-3e9e-433f-a17e-68c532f9f316.23dd835d-a6d9-44be-a505-b68326452b72" returned: 0 in 0.232s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:31 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3798aa50-d89c-4cef-996d-5f79b18ce69a tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3cef59bb-3e9e-433f-a17e-68c532f9f316.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:31 devstack sudo[108083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3cef59bb-3e9e-433f-a17e-68c532f9f316.info Nov 03 07:52:31 devstack sudo[108083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:32 devstack sudo[108083]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:32 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3798aa50-d89c-4cef-996d-5f79b18ce69a tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3cef59bb-3e9e-433f-a17e-68c532f9f316.info" returned: 0 in 0.243s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:32 devstack cinder-volume[86875]: WARNING cinder.volume.drivers.remotefs [None req-3798aa50-d89c-4cef-996d-5f79b18ce69a tempest-ProjectMemberTests-923615420 None] /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3cef59bb-3e9e-433f-a17e-68c532f9f316.info is being set with open permissions: ugo+rw Nov 03 07:52:32 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3798aa50-d89c-4cef-996d-5f79b18ce69a tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3cef59bb-3e9e-433f-a17e-68c532f9f316.info {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:32 devstack sudo[108086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3cef59bb-3e9e-433f-a17e-68c532f9f316.info Nov 03 07:52:32 devstack sudo[108086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:32 devstack sudo[108086]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:32 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-3798aa50-d89c-4cef-996d-5f79b18ce69a tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3cef59bb-3e9e-433f-a17e-68c532f9f316.info" returned: 0 in 0.225s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:32 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-3798aa50-d89c-4cef-996d-5f79b18ce69a tempest-ProjectMemberTests-923615420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.768s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:52:32 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-3798aa50-d89c-4cef-996d-5f79b18ce69a tempest-ProjectMemberTests-923615420 None] Create snapshot completed successfully Nov 03 07:52:32 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-730cf8d1-f9e6-4c2a-b58a-b9c98cd45505 tempest-ProjectMemberTests-923615420 None] Acquiring lock "cinder-23dd835d-a6d9-44be-a505-b68326452b72-delete_snapshot" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:32 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-730cf8d1-f9e6-4c2a-b58a-b9c98cd45505 tempest-ProjectMemberTests-923615420 None] Lock "cinder-23dd835d-a6d9-44be-a505-b68326452b72-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:32 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-730cf8d1-f9e6-4c2a-b58a-b9c98cd45505 tempest-ProjectMemberTests-923615420 None] Acquiring lock "cinder-quobyte-3cef59bb-3e9e-433f-a17e-68c532f9f316" by "delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:32 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-730cf8d1-f9e6-4c2a-b58a-b9c98cd45505 tempest-ProjectMemberTests-923615420 None] Lock "cinder-quobyte-3cef59bb-3e9e-433f-a17e-68c532f9f316" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:32 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-730cf8d1-f9e6-4c2a-b58a-b9c98cd45505 tempest-ProjectMemberTests-923615420 None] Acquiring lock "cinder-quobyte-23dd835d-a6d9-44be-a505-b68326452b72" by "_delete_snapshot" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:32 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-730cf8d1-f9e6-4c2a-b58a-b9c98cd45505 tempest-ProjectMemberTests-923615420 None] Lock "cinder-quobyte-23dd835d-a6d9-44be-a505-b68326452b72" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:32 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-730cf8d1-f9e6-4c2a-b58a-b9c98cd45505 tempest-ProjectMemberTests-923615420 None] Deleting offline snapshot 23dd835d-a6d9-44be-a505-b68326452b72 of volume 3cef59bb-3e9e-433f-a17e-68c532f9f316 {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 07:52:32 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-730cf8d1-f9e6-4c2a-b58a-b9c98cd45505 tempest-ProjectMemberTests-923615420 None] snapshot_file for this snap is: volume-3cef59bb-3e9e-433f-a17e-68c532f9f316.23dd835d-a6d9-44be-a505-b68326452b72 {{(pid=86875) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 07:52:32 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[92582eeb-7760-4050-851d-c35ee436b51a]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:52:32 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-730cf8d1-f9e6-4c2a-b58a-b9c98cd45505 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3cef59bb-3e9e-433f-a17e-68c532f9f316.23dd835d-a6d9-44be-a505-b68326452b72 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:32 devstack sudo[108089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3cef59bb-3e9e-433f-a17e-68c532f9f316.23dd835d-a6d9-44be-a505-b68326452b72 Nov 03 07:52:32 devstack sudo[108089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:33 devstack sudo[108089]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-730cf8d1-f9e6-4c2a-b58a-b9c98cd45505 tempest-ProjectMemberTests-923615420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3cef59bb-3e9e-433f-a17e-68c532f9f316.23dd835d-a6d9-44be-a505-b68326452b72" returned: 0 in 0.336s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:33 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.remotefs [None req-730cf8d1-f9e6-4c2a-b58a-b9c98cd45505 tempest-ProjectMemberTests-923615420 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3cef59bb-3e9e-433f-a17e-68c532f9f316(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86875) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 07:52:33 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4bb54b-2c10-4b45-947a-648fae0d7de8]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:52:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-730cf8d1-f9e6-4c2a-b58a-b9c98cd45505 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3cef59bb-3e9e-433f-a17e-68c532f9f316 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:33 devstack sudo[108094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3cef59bb-3e9e-433f-a17e-68c532f9f316 Nov 03 07:52:33 devstack sudo[108094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:33 devstack sudo[108094]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-730cf8d1-f9e6-4c2a-b58a-b9c98cd45505 tempest-ProjectMemberTests-923615420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3cef59bb-3e9e-433f-a17e-68c532f9f316" returned: 0 in 0.331s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-730cf8d1-f9e6-4c2a-b58a-b9c98cd45505 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3cef59bb-3e9e-433f-a17e-68c532f9f316.23dd835d-a6d9-44be-a505-b68326452b72 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:33 devstack sudo[108099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3cef59bb-3e9e-433f-a17e-68c532f9f316.23dd835d-a6d9-44be-a505-b68326452b72 Nov 03 07:52:33 devstack sudo[108099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:33 devstack sudo[108099]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-730cf8d1-f9e6-4c2a-b58a-b9c98cd45505 tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3cef59bb-3e9e-433f-a17e-68c532f9f316.23dd835d-a6d9-44be-a505-b68326452b72" returned: 0 in 0.307s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-730cf8d1-f9e6-4c2a-b58a-b9c98cd45505 tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3cef59bb-3e9e-433f-a17e-68c532f9f316.23dd835d-a6d9-44be-a505-b68326452b72 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:33 devstack sudo[108104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3cef59bb-3e9e-433f-a17e-68c532f9f316.23dd835d-a6d9-44be-a505-b68326452b72 Nov 03 07:52:33 devstack sudo[108104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:33 devstack sudo[108104]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:33 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-730cf8d1-f9e6-4c2a-b58a-b9c98cd45505 tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3cef59bb-3e9e-433f-a17e-68c532f9f316.23dd835d-a6d9-44be-a505-b68326452b72" returned: 0 in 0.230s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:34 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-730cf8d1-f9e6-4c2a-b58a-b9c98cd45505 tempest-ProjectMemberTests-923615420 None] Lock "cinder-quobyte-23dd835d-a6d9-44be-a505-b68326452b72" released by "_delete_snapshot" :: held 1.287s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:34 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-730cf8d1-f9e6-4c2a-b58a-b9c98cd45505 tempest-ProjectMemberTests-923615420 None] Lock "cinder-quobyte-3cef59bb-3e9e-433f-a17e-68c532f9f316" released by "delete_snapshot" :: held 1.307s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:34 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-730cf8d1-f9e6-4c2a-b58a-b9c98cd45505 tempest-ProjectMemberTests-923615420 None] Created reservations ['91b283ca-5a11-4c19-823b-03146fef98c5', '33327deb-8e0a-4cbc-93f3-a26e5a8d8679', 'cd34bf81-da77-48a7-97e2-a7407cd33c6e', 'ac1da6f9-14d2-4056-87c6-f15bacce527c'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:52:34 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-730cf8d1-f9e6-4c2a-b58a-b9c98cd45505 tempest-ProjectMemberTests-923615420 None] Delete snapshot completed successfully. Nov 03 07:52:34 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-730cf8d1-f9e6-4c2a-b58a-b9c98cd45505 tempest-ProjectMemberTests-923615420 None] Lock "cinder-23dd835d-a6d9-44be-a505-b68326452b72-delete_snapshot" released by "delete_snapshot" :: held 1.430s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:34 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-41a6b819-f05c-48a9-8679-5758096d60fd tempest-ProjectMemberTests-923615420 None] Acquiring lock "cinder-3cef59bb-3e9e-433f-a17e-68c532f9f316-delete_volume" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:34 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-41a6b819-f05c-48a9-8679-5758096d60fd tempest-ProjectMemberTests-923615420 None] Lock "cinder-3cef59bb-3e9e-433f-a17e-68c532f9f316-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:34 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-41a6b819-f05c-48a9-8679-5758096d60fd tempest-ProjectMemberTests-923615420 None] Acquiring lock "cinder-quobyte-3cef59bb-3e9e-433f-a17e-68c532f9f316" by "delete_volume" {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 07:52:34 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-41a6b819-f05c-48a9-8679-5758096d60fd tempest-ProjectMemberTests-923615420 None] Lock "cinder-quobyte-3cef59bb-3e9e-433f-a17e-68c532f9f316" acquired by "delete_volume" :: waited 0.014s {{(pid=86875) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 07:52:34 devstack cinder-volume[86875]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c88bcab-316b-4bed-95d6-fb80bb38d871]: (4, 'qcow2') {{(pid=88573) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 07:52:34 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-41a6b819-f05c-48a9-8679-5758096d60fd tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3cef59bb-3e9e-433f-a17e-68c532f9f316 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:35 devstack sudo[108108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3cef59bb-3e9e-433f-a17e-68c532f9f316 Nov 03 07:52:35 devstack sudo[108108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:35 devstack sudo[108108]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-41a6b819-f05c-48a9-8679-5758096d60fd tempest-ProjectMemberTests-923615420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3cef59bb-3e9e-433f-a17e-68c532f9f316" returned: 0 in 0.340s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-41a6b819-f05c-48a9-8679-5758096d60fd tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3cef59bb-3e9e-433f-a17e-68c532f9f316 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:35 devstack sudo[108113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3cef59bb-3e9e-433f-a17e-68c532f9f316 Nov 03 07:52:35 devstack sudo[108113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:35 devstack sudo[108113]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-41a6b819-f05c-48a9-8679-5758096d60fd tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387/volume-3cef59bb-3e9e-433f-a17e-68c532f9f316" returned: 0 in 0.234s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:35 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-41a6b819-f05c-48a9-8679-5758096d60fd tempest-ProjectMemberTests-923615420 None] Lock "cinder-quobyte-3cef59bb-3e9e-433f-a17e-68c532f9f316" released by "delete_volume" :: held 0.633s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:35 devstack cinder-volume[86875]: DEBUG cinder.quota [None req-41a6b819-f05c-48a9-8679-5758096d60fd tempest-ProjectMemberTests-923615420 None] Created reservations ['c561cfa4-b626-46fd-9d7f-2944ea6f4d79', '80b0ede8-095e-4cb7-8933-76a07754dc77', 'c4208bc0-ac0d-4e37-a668-2b4a81849cd1', '64893f35-947a-4275-887d-e6a72bb5c293'] {{(pid=86875) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 07:52:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-41a6b819-f05c-48a9-8679-5758096d60fd tempest-ProjectMemberTests-923615420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:52:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-41a6b819-f05c-48a9-8679-5758096d60fd tempest-ProjectMemberTests-923615420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:52:35 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-41a6b819-f05c-48a9-8679-5758096d60fd tempest-ProjectMemberTests-923615420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:52:35 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-41a6b819-f05c-48a9-8679-5758096d60fd tempest-ProjectMemberTests-923615420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:52:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-41a6b819-f05c-48a9-8679-5758096d60fd tempest-ProjectMemberTests-923615420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:52:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-41a6b819-f05c-48a9-8679-5758096d60fd tempest-ProjectMemberTests-923615420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:52:35 devstack sudo[108116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:52:35 devstack sudo[108116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:52:35 devstack sudo[108116]: pam_unix(sudo:session): session closed for user root Nov 03 07:52:35 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-41a6b819-f05c-48a9-8679-5758096d60fd tempest-ProjectMemberTests-923615420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.228s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:52:35 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-41a6b819-f05c-48a9-8679-5758096d60fd tempest-ProjectMemberTests-923615420 None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:52:35 devstack cinder-volume[86875]: INFO cinder.volume.manager [None req-41a6b819-f05c-48a9-8679-5758096d60fd tempest-ProjectMemberTests-923615420 None] Deleted volume successfully. Nov 03 07:52:35 devstack cinder-volume[86875]: DEBUG cinder.coordination [None req-41a6b819-f05c-48a9-8679-5758096d60fd tempest-ProjectMemberTests-923615420 None] Lock "cinder-3cef59bb-3e9e-433f-a17e-68c532f9f316-delete_volume" released by "delete_volume" :: held 1.049s {{(pid=86875) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 07:52:45 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:SELECT=63,cinder:INSERT=25,cinder:UPDATE=86,cinder:DELETE=6 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:52:45 devstack cinder-volume[86875]: DEBUG dbcounter [-] [86875] Writing DB stats cinder:UPDATE=87,cinder:DELETE=8,cinder:SELECT=69,cinder:INSERT=23 {{(pid=86875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 07:53:03 devstack cinder-volume[86875]: DEBUG oslo_service.periodic_task [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86875) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:53:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 07:53:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 07:53:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1': None} {{(pid=86875) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 07:53:03 devstack cinder-volume[86875]: DEBUG cinder.volume.drivers.quobyte [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9905103-6897-4d8d-999e-404d479232f1'] {{(pid=86875) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 07:53:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.lockutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86875) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 07:53:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 07:53:03 devstack sudo[108130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387 Nov 03 07:53:03 devstack sudo[108130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 07:53:03 devstack sudo[108130]: pam_unix(sudo:session): session closed for user root Nov 03 07:53:03 devstack cinder-volume[86875]: DEBUG oslo_concurrency.processutils [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/78ba87ea8c356295d65aabbc5779e387" returned: 0 in 0.243s {{(pid=86875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 07:53:03 devstack cinder-volume[86875]: DEBUG cinder.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Notifying Schedulers of capabilities ... {{(pid=86875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 07:53:03 devstack cinder-volume[86875]: DEBUG oslo_service.periodic_task [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] Running periodic task VolumeManager._thread_info {{(pid=86875) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 07:53:03 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] thread count: 29 {{(pid=86875) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 07:53:03 devstack cinder-volume[86875]: DEBUG cinder.volume.manager [None req-b6e2c3cf-1f9d-4882-9252-f1037bf42154 None None] thread info: [<_MainThread(MainThread, started 125626325639296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86875) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}